Ei %SSKrSSKrSSKrSSKrSSKJr SSKJr SSKJ r SSK J r SSK r SSK Jr SSKJrJr SSKJr SSKJrJr SS KJrJrJr SS KJrJrJr SS KJ r SS K!J"r" SS K#J$r$J%r% SSK&J'r'J(r( SSK)J*r*J+r+ SSK,J-r- SSK.J/r/ /SQr0\ RRbRd\ RRbRf\ RRbRh1r5\ "SS55r6S\+S\ S\74Sjr8S\+S\ S\74Sjr9S\:\\:\;\;44S\<\ 4Sjr=Sr>S\S\4Sjr?S \@S\4S!jrAS\+S\<\+S-4S"jrBS#\'S$\<\+S\'4S%jrC\RS&\ RRS\ 4S'j5rFS]S&\ RRS(\*S \@S)\ S*\ RS-S\+4 S+jjrHS\+S,\:\@\ RR4S-\:\+\74S\74S.jrIS\+S\<\J4S/jrKS0\<\JS\\+/\<\J44S1jrL\"S2S35rM\M"S4S55\ Rn\L"S/5\N\L"S6/50\M"S4S75\J\K0\M"S4S85\J\K0\M"S4S95\J\K0\M"S4S:5\J\L"S/50\M"S4S;5\J\K0\M"S4\ R5\J\K0\M"S4S<5\J\L"S/50\M"S4S=5\J\L"S/50\M"S4\ R5\J\L"S/50\M"S4S>5\J\K00 rQ\:\M\:\;\ R-\\+/\<\J444\SS?'0rT\:\;\ R-\\+/\<\J44\SS@'S\+S\:\;\ R-\\+/\<\J444SAjrUS^S\+S,\:\@\R4SB\;\RS-SC\ S\+S-4 SDjjrVSE\*SF\W\ SG4SH\+S\+4SIjrXSJ\/SK\7S\W\<\@\<\;\ 44SLjrYS^S\+SM\:\@\ RR4SN\SO\ S-S\74 SPjjrZS^S\+SM\:\@\ RR4SN\SO\ S-S\74 SQjjr[S\+SM\:\@\ RR4S\ RRS-4SRjr\S\+SS\ RRSM\:\@\ RR4S(\*S\+4 STjr]S\+SS\ RRSM\:\@\ RR4S(\*S\+4 SUjr^S\+SM\:\@\ RR4S\+S-4SVjr_S(\*4SWjr`SX\\-S\4SYjraS_SN\SZ\S[\7S\74S\jjrbg)`N) namedtuple)Callable) dataclass)Any) QConfigAny QuantType)DTypeWithConstraints)FakeQuantizeBaseFixedQParamsFakeQuantize)_is_activation_post_processFixedQParamsObserver ObserverBase)float16_dynamic_qconfigfloat16_static_qconfigqconfig_equals)QConfigMapping) DeQuantStub)_assert_and_get_unique_device"activation_is_statically_quantized) GraphModulemap_arg)GraphNode)quantized_decomposed_lib)PrepareCustomConfig)all_node_args_except_firstall_node_args_have_no_tensorsassert_and_get_unique_devicecollect_producer_nodescreate_getattr_from_value'create_node_from_old_node_preserve_metaEMPTY_ARG_DICTget_custom_module_class_keysget_linear_prepack_op_for_dtypeget_new_attr_name_with_prefix(get_non_observable_arg_indexes_and_typesget_qconv_prepack_op#get_skipped_module_name_and_classes graph_module_from_producer_nodesmaybe_get_next_moduleNodeInfonode_arg_is_biasnode_arg_is_weightNON_OBSERVABLE_ARG_DICTNON_QUANTIZABLE_WEIGHT_OPSreturn_arg_listObservedGraphModuleAttrsc\rSrSr%\\\4\S'\\\\\ 44\S'\ \S'\\\ 4\S'\ \S'\ \S'\\\S'S r\ \S 'S r\\S -\S 'S r\\S -\S 'Srg )r2Lnode_name_to_qconfignode_name_to_scopeprepare_custom_config!equalization_node_name_to_qconfigqconfig_mappingis_qatobserved_node_namesFis_observed_standalone_moduleN&standalone_module_input_quantized_idxs'standalone_module_output_quantized_idxs)__name__ __module__ __qualname____firstlineno__dictstrr__annotations__tupletyperrrboolsetr<r=listintr>__static_attributes__r?[/home/mande/repo/quber/.venv/lib/python3.13/site-packages/torch/ao/quantization/fx/utils.pyr2r2LssJ//S%T "2233..'+CH~5## LS!*/!4/?C*DI,<C@D+T#Y-=DrNr2nodeargreturncSnSUR;aURSRSS5nUb,U[UR5:aURUULagURRS5UL$)zReturns if node arg is weightNtarget_dtype_info weight_indexTweightmetagetlenargskwargs)rPrQrUs rOr.r.ZsqLdii'yy!4599.$O  3tyy> ) IIl #s * ;;??8 $ ++rNcSnSUR;aURSRSS5nUb,U[UR5:aURUULagURRS5UL$)zReturns if node arg is biasNrT bias_indexTbiasrW)rPrQr^s rOr-r-hsqJdii'YY2377 dK  TYY ' IIj !S ( ;;??6 "c ))rNcustom_module_mappingc[5n[R[R[R4H2nUR U05n[UR 55nX-nM4 [U5$)aGet all the unique custom module keys in the custom config dict e.g. Input: { QuantType.STATIC: { CustomModule1: ObservedCustomModule }, QuantType.DYNAMIC: { CustomModule2: DynamicObservedCustomModule }, QuantType.WEIGHT_ONLY: { CustomModule3: WeightOnlyObservedCustomModule }, } Output: # extract the keys across all inner STATIC, DYNAMIC, and WEIGHT_ONLY dicts [CustomModule1, CustomModule2, CustomModule3] )rJrSTATICDYNAMIC WEIGHT_ONLYrYkeysrK)r`float_custom_module_classes quant_modequant_mode_custom_module_config quant_mode_custom_module_classess rOr$r$vsp.-0E ''):):IS[4U4SjjnSnU"U5n[X5(aUS- nU"U5n[X5(aMU$)Nic >T[U5-$N)rE)rrs rO get_attr_nameOget_new_attr_name_with_prefix..get_new_attr_name..get_attr_namesCF? "rNrr)rLhasattr)rrr attr_namers rOget_new_attr_name8get_new_attr_name_with_prefix..get_new_attr_namesS #S # !!$ f(( FA%a(If((rN)replacerkrvModule)rrs` rOr&r&s/ ^^C %F %((//  rNcU/nU/nU(aUR5n[UR5[URR 55-nUHsn[ U[ 5(dMURS:Xa gURU5 URS:XaUR[LaMbURU5 Mu U(aMU$)aStarting from a target node, trace back until we hit input or getattr node. This is used to extract the chain of operators starting from getattr to the target node, for example:: def forward(self, x): observed = self.observer(self.weight) return F.linear(x, observed) collect_producer_nodes(observed) will either return a list of nodes that produces the observed node or None if we can't extract a self contained graph without free variables(inputs of the forward function). placeholderN call_function) poprKr[r\values isinstanceropappendtargetgetattr)rPnodesfrontierall_argsrQs rOr r sFEvH ||~ ?T$++*<*<*>%??Cc4((vv& LL FFo-#**2G$ ( LrNrootproducer_nodesc^[U5S:Xa [S5eUR5 [5n0mU4SjnUHnUR XC5TU'M UR U"US55 [ X5nU$)aConstruct a graph module from extracted producer nodes from `collect_producer_nodes` function Args: root: the root module for the original graph producer_nodes: a list of nodes we use to construct the graph Return: A graph module constructed from the producer nodes rz'list of producer nodes can not be emptyc$>[UU4Sj5$)Nc>TU$rr?)rPenvs rODgraph_module_from_producer_nodes..load_arg..s s4yrN)r)ars rOload_arg2graph_module_from_producer_nodes..load_argsq011rN)rZrreverser node_copyoutputr)rrgraphr producer_node graph_modulers @rOr*r*s >aFGG GEC2( "__]EM( LL.,-.t+L rNrc[U5$)zz Returns the unique device for a module, or None if no device is found. Throws an error if multiple devices are detected. )r)rs rOrrs ) 00rNrvaluedevicec0[U5nU"U5nUc [U5n[U[R5(aUR 5R 5O[R"X4S9nURXg5 URSU5nU$)z Given a value of any type, creates a getattr node corresponding to the value and registers the value as a buffer to the module. )rget_attr) r&rrrkTensordetachclonetensorregister_buffer create_node) rrrrrrr new_value attr_nodes rOr!r!s6f=!&)I ~-f5 eU\\ * *   \\% /  90!!*i8I rNmodulescachecU(a X;aX $Sn[U[5(dSnGO6URS:XaSnGO"URS:Xaa[UR[5(d [ S5e[ XR5(a[URSX5nGOURS:XaSnGOURS:Xa8UR[RLa[URSX5nGOUURS:XaSnGOAUR[LaURS S ;aSnGOURS :XaURS :XaSnOSnURHn[U[5(a\UHUn[U[5(dM[XaU5nU=(d U(+nU(dM?U(+nU(aX2U'Us s $ Og[U[5(aOQ[U[5(a:[XQU5nU=(d U(+nU(aU(+nU(aX2U'Us $OSnU(+nM U(aX2U'U$) z If we know for sure that all of this node's args have no tensors (are primitives), return True. If we either find a tensor or are not sure, return False. Note: this function is not exact. FTr call_modulez2node.target must be a string for call_module nodesrrrr)ndimshape call_methodsize)rrrrrErr rr[operatorgetitemrrKrL) rPrrresultfound_one_tensorrQlist_el!this_list_el_args_have_no_tensorsthis_arg_args_have_no_tensorss rOrr!s { F dD ! ! M ! M !$++s++ !UV V &w{{'; < <2499Q<PF M ! O # x7G7G(G.tyy|WL J   DIIaL4E$E M !dkkV&; 99C#t$$"G!'4009'ER:,<, AA),+)9%9F$.4d #)M# #$C%%c4((4Qe51(8(99%(%5!5 *0$K% ( (,$))FUV d MrNcR[[S[UR555$)z* Returns all node arg indices after first r)rKrangerZr[)rPs rOrrus aTYY( ))rN arg_indicesc>^S[S[[4U4SjjnU$)zi Constructs a function that takes a node as arg and returns the arg_indices that are valid for node.args rPrRch>TVs/sHo[UR5:dMUPM! sn$s snfr)rZr[)rPrrs rOarg_indices_func)return_arg_list..arg_indices_funcs(&=;ac$))n*<;===s//)rrKrL)rrs` rOr1r1|s" >t>S > rNr,z op targetr masked_fillpermuterepeatreshaper transpose unsqueeze unsqueeze_viewr/r#cv[URUR5n[R U[ 5$)z Returns a dict with of non float tensor types as keys and values which correspond to a function to retrieve the list (which takes the node as an argument) )r,rrr/rYr#)rPinfos rOr'r's+ DGGT[[ )D " & &t^ < > @!   $ ! ; ; @ @ B#   "> ! ; ;#   77rN named_modulesqconfigqhandlerc[X5nUbUb[U[RRR R R5(d [S5e[U[RR5=(a" [U5=(a UR5$[U[RRRR5$)z< Return whether this refers to the custom module LSTM flow. 0qhandler must be a QuantizeHandler when provided) _get_modulerrkao quantizationfxquantize_handlerQuantizeHandlerrrvLSTMris_custom_module quantizablerPrrrmods rO_is_custom_module_lstmr s d *Cx3 ehh++..??OO  !!ST T sEHHMM * ,27; ,))+ #uxx{{66;;<