EiI%SSKrSSKrSSKrSSKJr SSKJr SSKJr SSK J r J r J r SSK Jr SSKJr SS KJr SS KJr SS KJr \R."\5r/S Qr0q\\\ 4\S 'Sq\ \\S'Sq Sq!Sr"0r#\\\\\ 44\S'S\S\\\ 4SS4Sjr$\"SS9"SS\55r%\"SS9"SS55r&\"SS9\S0Sj55r'\S0Sj5r(\"SS9S\)\4Sj5r*\"SS9\S\4S j55r+\"SS9S\4S!j5r,\"SS9S"5r-\"SS9S#5r.\"SS9S\)\4S$j5r/\"SS9S\04S%j5r1S\04S&jr2\"SS9\S1S'j55r3\"SS9S\\\ 44S(j5r4\"SS9\S)55r5\"SS9S*5r6\"SS9S+\S\\\ 44S,j5r7S-\S\4S.jr8S-\ \\)\4S\)\)\4S/jr9g)2N) defaultdict)contextmanager)Enum)AnyOptionalUnion)signpost_event) compatibility)Graph) GraphModule)Node)annotate annotate_fnpreserve_node_metahas_preserved_node_metaset_stack_traceset_grad_fn_seq_nrreset_grad_fn_seq_nr format_stackset_current_metaget_current_meta NodeSourceNodeSourceActionget_graph_provenance_jsonset_current_replay_nodeget_current_replay_node current_metacurrent_replay_nodeFzFFD))XFAa!122$'FtAwi%PQQ !]]YYs4;;'7"TZZ.+DN $))+ dii 45 N "DNDN.2/3 r'r#cTUR(aURR$S$N)rIr:r@s r%r:NodeSource.names&*nnt~~""<"B>r'cTUR(aURR$S$)N)rIr<r\s r%r<NodeSource.graph_ids*...t~~&&@b@r'c"UR5$r>)print_readabler\s r%__repr__NodeSource.__repr__s""$$r'cURcHSRURVs/sHoRR 5PM sn5UlUR$s snf)N+)rKjoinrGr:lower)r@rWs r%_get_action_stringNodeSource._get_action_stringsL    &"%((DKK+PKqFFLLNK+P"QD """,Qs#A"c US:agSnUR5nUSU-S-SURSURSUSURS 3 -- nURHnX$R US -5- nM U$) N r[ z(name=z , pass_name=z , action=z , graph_id=z) r )rkr:rFr<rHrd)r@indentresult action_stringitems r%rdNodeSource.print_readables A://1  &L1 tyykdnn-=Y}oU`aeanan`oors t NND ))&1*5 5F# r'c JURcnUR5nURURURUR UUR Vs/sHo"R5PM snS.UlURc [S5eUR$s snf)N)r:r;r<rFrGrHz"_dict is None after initialization) rJrkr:r;r<rFrHto_dictrP)r@rsrLs r%rwNodeSource.to_dicts ::  335M ++ MM!^^'9=HllnH DJ ::  !EF Fzz IsB othercp[U[5(dgUR5UR5:H$)NF)rNrrw)r@rys r%__eq__NodeSource.__eq__s)%,,||~00r'cN^U4Sjm[T"UR555$)Nc>[U[5(a,[[U4SjUR 5555$[U[ 5(a[U4SjU55$U$)Nc3<># UHupUT"U54v M g7fr>r-).0kv_make_hashables r% >NodeSource.__hash__.._make_hashable..s#S{tqQq(9$:{sc34># UH nT"U5v M g7fr>r-)rrtrs r%rrsBcd^D11cs)rNdicttuplesorteditemsrO)objrs r%r+NodeSource.__hash__.._make_hashablesO#t$$V#Ssyy{#SSTTC&&BcBBB r')hashrw)r@rs @r%__hash__NodeSource.__hash__s  N4<<>233r'dcUcg[U[5(d[S[U535e[R [5nSUlSUlURSS5Ul URSS5n/nU(aURS5HmnUR5S:Xa!UR[R5 M8UR5S:XdMNUR[R5 Mo XBlS U;aZS U;aTS U;aN[R#URS S5URS S5URS S 55nXblOSUlURS S5b@URS /5Vs/sHnUR'U5=ncMUPM snUlU$/UlU$s snf)z Recursively deserialize from_node metadata from dictionary data. It is used to deserialize the from_node field from serialized metadata. Please use constructor NodeSource(node, ...) to create a NodeSource object. NzExpected a dict, got rFr[rGrhr2r3r:r;r<rarH)rNrrPrQr__new__rKrJgetrFsplitupperappendrr2r3rGrErI _from_dictrH) clsr node_source action_stractions action_namerIfnrrs r%rNodeSource._from_dicts 9!T"" #8a !BC C!((4 &* " !"k2 6 UU8R(  )//4 $$&(2NN#3#:#:; &&(I5NN#3#;#;< 5 % Q;8q=Z1_"++fb!1552#6j"8MI%. !$(K ! 55d # /%% R0%0B!nnR00F0%K !%'K !%s G<G)rKrJrGrHrIrF)r[N)r)r.r/r0r1__doc__rErC__annotations__rOrrrrrrApropertyr:r;rDr<rerkrdrwobjectr{r classmethodrr4r-r'r%rrMsF %% N # $$L!! ## DcN ##SM! PT 4tn44148J3KKLM 4B=c==???A#AA%# "1F1 448D>4h|.D44r'rc#h# [n[R5nUqSv UqUqg!UqUqf=f7fr>)should_preserve_node_metarrU)enablesaved_should_preserve_node_metasaved_current_metas r%rrsE '@#%**,*$*! $C!) %D!) s2)2/2c#8# [nUqSv Uqg!Uqf=f7f)za Temporarily enables or disables the preservation of node.meta["seq_nr"] in the tracing context. N_should_preserve_node_meta)preserve_seq_nrsaveds r%_preserve_node_seq_nrrs& 'E+%4" %*"U"stackc\[(a!U(aSRU5[S'ggg)Nr[ stack_trace)rrir)rs r%rrs&! U&(ggen ]#&+ r'annotation_dictc#6# S[;n[R"[RS055nU(d 0[S'[SRU5 Sv U(a U[S'g[S g!U(a U[S'f[S f=f7f)a Temporarily adds custom annotations to the current tracing context. The fx_node produced from this tracing context will have the custom annotations in node.metadata["custom"] field. This context manager allows you to insert arbitrary metadata into the PT2 tracing system by updating the global `current_meta["custom"]` dictionary. The annotations are automatically reverted after the context exits. Gradient accumulation nodes will not be annotated. This is intended for advanced users who need to attach additional metadata to the fx nodes (e.g., for debugging, analysis, or external tooling) during export tracing. Note: This API is **not backward compatible** and may evolve in future releases. Note: This API is not compatible with fx.symbolic_trace or jit.trace. It's intended to be used with PT2 family of tracers, e.g. torch.export and dynamo. Args: annotation_dict (dict): A dictionary of custom key-value pairs to inject into the FX trace metadata. Example: After exiting the context, custom annotations are removed. >>> with annotate({"source": "custom_pass", "tag": 42}): ... pass # Your computation here customN)rrUrupdate)r has_custom old_customs r%rr&sJ\)J<++Hb9:J '%'L " X%%o6 %/L "X& %/L "X&s4B,A<#B<BBc$^^SSKJm UU4SjnU$)a A decorator that wraps a function with the annotate context manager. Use this when you want to annotate an entire function instead of a specific code block. Note: This API is **not backward compatible** and may evolve in future releases. Note: This API is not compatible with fx.symbolic_trace or jit.trace. It's intended to be used with PT2 family of tracers, e.g. torch.export and dynamo. Args: annotation_dict (dict): A dictionary of custom key-value pairs to inject into the FX trace metadata for all operations in the function. Example: All operations in my_function will have {"pp_stage": 1} in their metadata. >>> @annotate_fn({"pp_stage": 1}) ... def my_function(x): ... return x + 1 r)wrapsc.>^T"T5UU4Sj5nU$)Nc`>[T5 T"U0UD6sSSS5 $!,(df  g=fr>)r)argskwargsrfuncs r%wrapper/annotate_fn..decorator..wrapperxs$/*T,V,+**s -r-)rrrrs` r% decoratorannotate_fn..decoratorws t -  -r') functoolsr)rrrs` @r%rr]s0  r'c[(aB[RS/5U/-[S'[RSS5S-[S'gg)Ngrad_fn_seq_nr in_grad_fnrr )rrr)seq_nrs r%rrsT! )5)9)9:JB)O S * %&&2%5%5lA%F%J \" !r'c[(a_[RSS5nUS::a[SU35eUS:Xa[S [S gUS- [S'[SSS[S'gg)Nrrz Expected current_level > 0, got r rra)rrrrP) current_levels r%rrs| ! $((q9 A  #CM?!ST T A \*-.)6):L &-9:J-KCR-PL) *!r'c[(a[RSS5/$[R"[R "5SS5$)Nrr[ra)rrr traceback format_list extract_stackr-r'r%rrsA    344$$Y%<%<%>s%CDDr'c[$r>)rr-r'r%rrs $$r'c[$r>rr-r'r%_is_preserving_node_seq_nrrs %%r'c## [(a[UR(aJ[nURR5q[ X[ R 5/[S'Sv UqgSv g!Uqf=f7f)NrH)rrTrrUrrr2)rLrF saved_metas r%rrsa! TYY!  &99>>+L4,<,C,CD)L % %L &Ls#A5AA.&A5.A22A5c[$r>)rr-r'r%rrs r'c#8# [nUqSv Uqg!Uqf=f7f)z Set the currently replay node. If `current_replay_node` is not None, then we're re-generating the `current_replay_node` in FunctionalTensorMode. Nr)rLsaved_current_replay_nodes r%rrs(!48" 77rc[$)z Get the currently replay node rr-r'r%rrs r'rSc 0nURH`nURS:XdMSUR;a-URSVs/sHo3R5PM snO/XR'Mb U$s snf![ a9n[ SSS[U5[R"5S.5 0sSnA$SnAff=f)zY Given an fx.Graph, return a json that contains the provenance information of each node. call_functionrHinductorprovenance_tracking_errorr)function error_msgrN) nodesoprTrwr: Exceptionr rCr format_exc)rSprovenance_tracking_jsonrLsourcees r%rrs #% KKDww/)#dii/59IIk4JK4J&^^%4JK)3 (' L     '7 V(335    s4A;!A;A6A;6A;; B>.B93B>9B>gmc^[U[5(d[S[U535eS[4U4SjjmSR ST"U555$)NzExpected GraphModule, got rc >/nURRHn[US5(aVURR SS5(a5UR UR URURS45 UR S:XdM|[[XR5[5(dMUR T"[XR555 M U$)NrTrget_attr) rSrhasattrrTrrrr:rNgetattrr;r )rcustom_metadatarLhelpers r%r$_get_custom_metadata..helpersHHNNDtV$$x)F)F&&DIIh)rC)rxs r%r'_get_custom_metadata..s0ZSVVZs)rNr rPrQri)rrs @r%_get_custom_metadatarsN b+ & &9$r(DEE ;  990VBZ0 00r'c[U[5(aU/nOUn[[5nUHonURR HRnUR S:XdMURRS5nUcM5X%RUR5 MT Mq [UR55Vs/sHn[X&5PM sn$s snf)a Group call_function nodes by seq_nr, order by seq_nr value, and return a list of lists of node names (sorted alphabetically). Args: gm: A single GraphModule or a list of GraphModules to process. When a list is provided, nodes from all graphs are grouped together. Returns: A list of lists, where each inner list contains node names that share the same seq_nr, sorted alphabetically. The outer list is ordered by seq_nr value. rr) rNr rrOrSrrrTrrr:rkeys)rgms seq_nr_dict graph_modulerLrrs r%_get_ordered_seq_nr_groupsrs "k""d(3D(9K  &&,,Dww/)x0%'..tyy9 --3;3C3C3E,F G,FqF;> ",F GG Gs;C)T)r[):rUloggingr collectionsr contextlibrenumrtypingrrrtorch._utils_internalr _compatibilityr rSr rr rLr getLoggerr.log__all__rrrCrrrrGRADIENT_ACC_SPECIAL_STACKr r&rrrrrOrrrrrrboolrrrrrrrrrr-r'r%rs" #%''0)%! $ " d38n!&*Xd^*!"C46tCc3h/05 2s 2d38n 2 2e,t- e,mm-m`e, *- * + +e,5495-5e,2'd2'-2'je,!!-!He,K-Ke, Q- Q e,Ed3iE-Ee,%%-%&D&e,-*e,$sCx.-e, 8- 8e,-e,UtCH~-:1[1S1$H k4 ,,-H $s)_Hr'