Ei6/SSKrSSKrSSKJr SSKJr SSKJrJr SSK r SSK J r J r J r JrJrJrJrJr SSKJr SSKJr SSKJr SS KJr "S S 5r"S S \5r"SS5r"SS\5rg)N)Callable)partial)AnyOptional) AHContext AHMetadata AHOperationChoice CHOICE_COLFeedback FEEDBACK_COLget_metadata_str_from_log)LearnedHeuristicController) ChoiceCaller) cache_dir)get_gpu_shared_memorycH\rSrSrSrS\\/\4SS4SjrS\S\4Sjr S r g) LocalFeedbacka' To be able to collect data for a choice, a function providing feedback given a choice has to be provided. LocalFeedback can be used when AutoHeuristic should immediately run the function to collect feedback for each choice (see pad_mm.py, where the autotuning happens locally, for an example). feedback_fnreturnNcXlgNr)selfrs h/home/mande/repo/quber/.venv/lib/python3.13/site-packages/torch/_inductor/autoheuristic/autoheuristic.py__init__LocalFeedback.__init__!s&choicec$URU5$rrrr s r__call__LocalFeedback.__call__$s''rr) __name__ __module__ __qualname____firstlineno____doc__rr r rr#__static_attributes__rrrrs9 'HfXx-?$@'T'(v(((rrc\rSrSrSrSrg)InconsistentMetadata(z Exception that is thrown when AutoHeuristic tries to log data to a file where the metadata stored in the file does not match the metadata it would store if the file didn't exist. r+N)r%r&r'r(r)r*r+rrr-r-(srr-cB\rSrSr%Sr\\\4\S'SS\ /\4S\ \S\ \ S\ S \S \ \ \S \ \ \\ /\4S S4S jjrS \4SjrS \4SjrSS\S\ \ \S \ \ \4SjjrS\S \4Sjr\S \4Sj5rS \4SjrS \4SjrS\S\S S4SjrSrg) AutoHeuristic/a  AutoHeuristic is a framework that allows one to collect data, learn a heuristic (i.e. a regression tree) and generate the heuristic to code. This class allows one to collect data. The collected data can then be used to train a heuristic (see torchgen/autoheuristic/). collected_feedbackNfallbackchoicesfeedbackcontextnameaugment_context preconditionrcXlX lX0lX@lXPl0UlX`l[[5[RR5URUR5Ul Xpl UR5(dg[RR R"S:XaUR%5UlO)[RR R"Ul[RR R)UR5(aDURb6URH%nURU5n UR+X5 M' ggg)a Initializes an instance of the AutoHeuristic class. Args: fallback: A callable that returns a Choice when the heuristic is unsure which choice to make, or AutoHeuristic is in data collection mode. choices: A list of possible choices the heuristic can make. feedback: An instance of LocalFeedback that provides feedback for a given choice. context: Context to store with each choice and feedback. name: A string that identifies the heuristic. augment_context: An optional list of AHOperation instances that augment the context. precondition: A callable that returns a boolean indicating whether AutoHeuristic should run. NDEFAULT)r3r4r5r6r7r2r8rrtorchcudaget_device_capabilitymetadatar9satisfies_precondition _inductorconfigautoheuristic_log_pathget_default_log_pathlog_pathcollect_autoheuristic save_data) rr3r4r5r6r7r8r9r feedback_vals rrAutoHeuristic.__init__8s.!     "$." ! # JJ , , . LL II   )**,,  ?? ! ! 8 8I E 557DM!OO22IIDM ?? ! ! 7 7 B B}}("llF#'==#8LNN68+) CrcxURSL=(d& URURUR5$r)r9r?r6)rs rr@$AutoHeuristic.satisfies_preconditionls4  D( D,=,= MM4<<-  rcUR5(dUR5$[RRR UR 5(aURb%URRUR5 [URUR5nUR5nX R;aUR5$UbU$UR5$)z Returns the chosen option based on the value of autoheuristic_use. If self.name is one of the comma separated strings in autoheuristic_use, it queries a learned heuristic to make a decision. Otherwise, it returns the fallback option. )r@r3r<rArBuse_autoheuristicr7r8r6apply_operationsrr? get_decisionr4)r controllerdecisions r get_choiceAutoHeuristic.get_choiceqs**,,==? " ?? ! ! 3 3DII > >##/ --d.B.BC3  J"..0H||+}}&#}}rtop_kalways_includedcUR5(dg[RRR UR 5(aUR b%URRUR 5 [URUR5nURU5nUcgUb!UHnXT;dM URU5 M U$gr) r@r<rArBrMr7r8r6rNrr?get_decisions_rankedappend)rrTrUrPr4r s rget_top_k_choicesAutoHeuristic.get_top_k_choicess**,, ?? ! ! 3 3DII > >##/ --d.B.BC3  J!55e $v-3c,6GGG T (C A GGDIIe$t+ ,! s +$E E&) r8r4r2r6r3r5rEr?r7r9NNr)r%r&r'r(r)dictr r __annotations__rlistrrrrr rboolrr@rRintrYrr] staticmethodrerDrxrGr*r+rrr0r0/sS VX-..8 $v, ,9V993c)C)--h-4-rr0c^\rSrSrSrSS\/\\4S\\S\\ S\ S\ S \\\ S \\\ \ /\4S S4U4S jjjrS\\ S\\S S4S jrS \\4SjrSS\S\\\ S \\\4SjjrSrU=r$)AutoHeuristicSelectAlgorithmz AutoHeuristicSelectAlgorithm is a subclass of AutoHeuristic that allows one to collect data and learn a heuristic when one wants to use AutoHeuristic for kernel choice selection. Nr3r4 input_nodesr6r7r8r9rc >^X0l0UlUHnXRUR5'M! [URR 55n S[ 4U4Sjjn [ T U]U U SUUUU5 [RRRUR5(a(UR5(aURX25 ggg)a The arguments choices, input_nodes and name have to match the ones used in the call to autotune_select_algorithm(), e.g. if the following call is made autotune_select_algorithm(name, choices, input_nodes, layout), the same name, choices and input_nodes have to be used here. rc:>T"5nUcgUR5$)Nunsure)autoheuristic_id)fallback_choicer3s r fallback_str;AutoHeuristicSelectAlgorithm.__init__..fallback_strs"&jO&"335 5rN)rchoicestr2choicerrkeysrsuperrr<rArBrFr7r@register_global_feedback) rr3r4rr6r7r8r9r choices_strr __class__s ` rr%AutoHeuristicSelectAlgorithm.__init__s '9;F?E ! !&"9"9"; <4005578  6c 6          OO " " 8 8 C C++--  ) )+ ?. Drcp^^^ SSKJnJmJm S[S[S[ [ [4S[S[[S[[ S [/[ [ [44S [ [ [4S S 4UU U4S jjnT"U5nT "TRXR5n[XEU5nU"U5 g )z[ Registers a callback in select_algorithm, which is called with the timing of each choice. r)add_feedback_savercreate_inputs_keycreate_precompile_key ah_inputs_keyah_precompile_keytimingsr7rr4 profiled_timeprecompile_timesrNc>T "U5nX:wagT "X8U5n X:wagUR5H%upTRU R5U 5 M' gr)itemsrGr)rrrr7rr4rrcurrent_inputs_keycurrent_precompile_keyr timerrrs rstore_global_feedbackTAutoHeuristicSelectAlgorithm.register_global_feedback..store_global_feedbacks]"3;!? !2%:'& "&: '  v668$?!0r) torch._inductor.select_algorithmrrrrrrfloatrrrr7r) rrr4rr inputs_keyprecompile_keyfeedback_saverrrs ` @@rr5AutoHeuristicSelectAlgorithm.register_global_feedback s   @ @" @,-. @  @ c  @ ,'  @$B\5-@(A$AB @#<#67 @ @ @*'{3 .tyy*N !6NS>*rcZUR5nURRUS5$r)rRrr\r"s rget_choice_caller.AutoHeuristicSelectAlgorithm.get_choice_caller4s'"$$((66rrTrUctURX5nUcgUVs/sHo@RUPM sn$s snfr)rYr)rrTrUr4r s rget_top_k_choices_caller5AutoHeuristicSelectAlgorithm.get_top_k_choices_caller8s=((@ ?E $|$ %EErr) rsrjcollections.abcr functoolsrtypingrrr<1torch._inductor.autoheuristic.autoheuristic_utilsrrr r r r r r:torch._inductor.autoheuristic.learned_heuristic_controllerrtorch._inductor.irr%torch._inductor.runtime.runtime_utilsrtorch._inductor.utilsrr Exceptionr-r0rr+rrrsi $    ,;7 ( (9h-h-VdE=dEr