Ei$ESSKrSSKrSSKrSSKJr SSKJrJr SSKJ r J r SSK r SSK J r Jr SSKJr SS/rS r\"5r\"S S 9\"S S555r\"S S 9"S S55rg)N) defaultdict) dataclassfield)AnyUnion)GraphNode) compatibilitySubgraphMatcher InternalMatchc[R"[5n[RR SS5R 5nURU5 [R"5n[R"S5nURU5 URU5 URU5 SUl U$)NPYTORCH_MATCHER_LOGLEVELWARNINGz%(filename)s > %(message)sF) logging getLogger__name__osenvirongetuppersetLevel StreamHandler Formatter setFormatter addHandler propagate)loggerlevelconsole formatters `/home/mande/repo/quber/.venv/lib/python3.13/site-packages/torch/fx/passes/utils/matcher_utils.py _init_loggerr"s   x (F JJNN5y A G G IE OOE##%G!!">?I # U gF MF)is_backward_compatiblec\rSrSr%\\\S'\"\S9r \\\4\S'\"\S9r \\\S'\"\S9r \\\S'\"\S9r \\ \4\S'SrS rg ) r $anchors)default_factory nodes_mapplaceholder_nodesreturning_nodes name_node_mapc[URURR5URR5UR R5S9$)N)r'r)r*r+)r r'r)copyr*r+)selfs r!__copy__InternalMatch.__copy__6sJLLnn))+"4499; 00557   r#N)r __module__ __qualname____firstlineno__listr __annotations__rdictr)r*r+r,strr0__static_attributes__r2r#r!r r $so$Z"'"=ItD$J=%*$$?tDz?#("=OT$Z=&+4%@M4T ?@ r#c \rSrSrSS\S\S\S\S\SS4 S jjrS \S \S\4S jrSS \S \S \ S\4Sjjr S\ \\4S\4Sjr S\ \S\ \4SjrS \S \S\S\4SjrSS \S \S\S \ S\4 SjjrSS\S \ S\ \4SjjrSrg)r ?pattern match_outputmatch_placeholderremove_overlapping_matchesignore_literalsreturnNcXlX lX0lX@lXPl[ UR 5S:Xa [S5eUR HPnURS:wdMUR5(aM,[ UR5S:XdMG[S5e UR Vs/sHowRS:XdMUPM snUl [[[UR 555nUR Ul/UlU(a U/UlgUR Vs/sH n[ UR5S:XdMUPM" snUlgs snfs snf)a Args: pattern: the targeted matching pattern, represented in fx.Graph. match_output: If True, output node in the pattern graph will be treated as a part of the targeted pattern. If False, output node is ignored during match. match_placeholder: If True, placeholder node in the pattern graph will be treated as a part of the targeted pattern. If False, placeholder nodes will be used a wildcard. remove_overlapping_matches: If True, in the case of overlapping matches, only the first match will be returned. ignore_literals: If True, will not check if literals are equal and will instead treat them as wildcards. rz;SubgraphMatcher cannot be initialized with an empty patternoutputzDSubgraphMatcher cannot be initialized with an pattern with dead code placeholderN)r=r>r?r@rAlennodes ValueErrorop is_impureusersAssertionErrorpattern_placeholder_nodesnextiterreversedall_input_nodespattern_returning_nodespattern_anchors) r/r=r>r?r@rAnoden output_nodes r!__init__SubgraphMatcher.__init__As0* (!2*D'. w}}  "M MMDww("4>>+;+;tzz?a'(^"}}* $! (=A}* &4 789 3>3N3N$+- $/=D '66$6a#agg,!:K6$D * $s1E#E#3E(E(pngnc[UR[5(d[SURS35e[UR[5(d[SURS35e[R R RURRUR5n[R R RURRUR5n[U5[U5Lag[U[R5(a[U[R5$[SUS35e)Nz pn.target z must be a string.z gn.target FzUnsupported type z when matching attributes) isinstancetargetr9rMtorchfx graph_module _get_attrgraph owning_moduletypeTensor RuntimeError)r/rZr[pn_valuegn_values r!_match_attributes!SubgraphMatcher._match_attributes{s"))S)) :bii[8J!KL L"))S)) :bii[8J!KL L88((222883I3I299U88((222883I3I299U >h / h - -h 5 5!28*uu %():*$--b5599 ) )r#r)cUR5VVs0sHup#URS:wdMX2_M nnnUR5H1up2X R;aMURH nXT;dM g M3 gs snnf)NrEFT)itemsrJrSrL)r/r)rZr[lookupusers r! _is_containedSubgraphMatcher._is_containeds "+!2$ !2vrbee}6LFBF!2 $ llnFB111% ! %$ s A=A=matchescp/n[5nUHnSnURR5H upgURS;dMXs;dMSn O U(aMLUR U5 URR5H(upgURS;dMUR U5 M* M U$)NF>rDrET)setr)rsrJappendadd)r/rxnon_overlapping_matches nodes_matchedmatch found_overlaprZr[s r!_remove_overlapping_matches+SubgraphMatcher._remove_overlapping_matchess8:#&5 E!M////155 99b>Q$(M2 !='..u5#oo335FBuu$==%))"-6'&r#rc[U[5(a [U[5(a [S5e[U[5(aV[U[5(dAURS:Xa0XR;aURUU:H$X#RU'gg[U[5(d[U[5(ag[ U5[ U5L=(a X!:H$)Nzpn and gn cannot both be NoderETF)r]r rMrJr)re)r/rZr[rs r!_match_literalsSubgraphMatcher._match_literalss b$  Jr4$8$8 !@A A b$   2t(<(<uu %( ??2."44&(#B%%*R*>*>8tBx'4BH 4r#c ^^^ ^ [RSX5 [U[5(a[U[5(d[ SUSU35eUTR ;aTR UU:H$UTR R 5;agTRXU5(dg[R"T5nUTR U'URS:XagSnS[[[4S[[[4S [4U UU4S jjm S upx[UR5[UR5:wdH[UR R#55[UR R#55:waURS :Xa[UR$[&R(R*5(abUR$R,R.m U 4S jn U "URUR 5nU "URUR 5nGO[UR5[UR5:Xa[UR R#55[UR R#55:Xa[UR5n[UR5nUR1[UR R 555 UR1[UR R 555 OSnU=(a USL=(a USL=(a T "Xx5nU(d[R"U5mgg)Nz matching %s to %szpn and gn must be Node, pn: z, gn: FrETargs1args2rBc>[U5[U5:wag[X5Hup#[U[5(a([U[5(aTR X#T5nOd[U[ [ 45(a$[U[ [ 45(a T"X#5nO%TRX#T5=(d TRnU(aM g g)NFT) rGzipr]r _match_nodesr6tuplerrA)rra1a2matched _match_argsrr/s r!r1SubgraphMatcher._match_nodes.._match_argss5zSZ'e+b$''Jr4,@,@"//>GT5M22z"tUm7T7T)"1G,,RU;St?S?Sw ,r#)NN call_functionc2>/n[T5Hup4URU;aURXR5 M4UR(d$U[ U5:aURX5 MiURUR 5 M U$)N) enumerateror{ kwarg_onlyrG default_value) orig_args orig_kwargsall_argsischema args_schemas r!get_all_arguments7SubgraphMatcher._match_nodes..get_all_argumentsss!*;!7IA{{k1  KK(@A#..1s9~3E  5 (<(<= "8 r#)rinfor]r rMr)valuesrpr.rJrr6rboolrGargskwargskeysr^r__ops OpOverload_schema argumentsextend) r/rZr[rrl saved_match match_foundpn_argsgn_argsrrrs ` ` @@r!rSubgraphMatcher._match_nodess  )222t$$B)=)= #?t6"!NO O  ??2&", , '') )$$R_==ii&   55M !  uT5[1 %e :L QU  (&BGG BGG , ()T"))..2B-CC(299ejj&;&;<<))++55K (;G';G \S\ )d299>>3C.D IINN I / 277mG277mG NN4 0 0 23 4 NN4 0 0 23 4K  .t# .t# .G- IIk*Er#rcc^^^^^SSKJn [[5nTRHBnUR H/nTR XVT5(dMXERU5 M1 MD [UR55m[RST5 /mUUUUU4Sjm[TRS9nT(a T"SU5 [T5nTVs/sH'nTRUR5(dM%UPM) snm[T5n X:wa[RSX- 5 /n THcnURR5V V s/sHupU RS;dMU PM n n n U"U 5(dMRU RU5 Me [U 5[T5:wa+[RS[T5[U 5- 5 TR (aD[U 5nTR#U 5m[T5n X:wa[RS X- 5 [RS T5 T$s snfs sn n f) a Returns: The matched subgraphs. The returned subgraph would be fully self-contained, meaning the nodes (except placeholder and nodes returned by output) can only be consumed by nodes within the matched subgraph. Subgraph pattern matcher is implemented with the backtracking style in the following steps: 1. We first identify all the anchor nodes in the pattern graph. The anchor nodes are the "sinks" (nodes with no user other than the output node) of the pattern graph. One pattern graph could have multiple anchors if it has multiple return values. 2. In the target graph, we identify the potential candidate nodes that can be matched with each anchor. These anchor-candidate pairs are the starting points for pairwise per-node matching. 3. For each anchor-candidate pair, we simultaneously traverse backwards (DFS) in both pattern and target graphs. For every pattern nodes along traversal path, we compare it against the target nodes. In case any comparison failed, the match for this anchor-candidate pair fails. A match is found when DFS completes traversing the graph. See `self._match_nodes` for more details. 4. In the case of multiple anchors, every anchor will need to find a match using step 3. In addition, the matches found between anchors need to have a common intersection node in order for the match to be valid. This is implemented with backtracking. See `backtracking` for more details. Notice: graph traversal must be done in the reverser order because a tensor can have multiple consumers, but can only have a single producer. Only with reverser order, we can we jointly traverse the pattern and target graph in a deterministic path. Warning: In theory, this backtracking algorithm have an **exponential** time complexity. However, in practice, it's unlikely to blow up. r)validate_partitionz"Initial match_candidates_list: %s c^>U[T 5:XaT RVs/sHo!RUPM snUlT RVs/sHo!RUPM snUlT R U5 [RSU5 gT Uup4[R"U5nUHln[RSX65 T RX6UT 5nU(a T"US-U5 O[RSX65 [R"U5nMn gs snfs snf)NzFound a match: %s zTrying to match anchor %s to %srFz Failed to match anchor %s to %s ) rGrNr)r*rSr+r{rrr.r) anchor_indexrrZpattern_anchorcandidate_nodesrrUr backtrackingmatch_candidates_listrxrlr/s r!r+SubgraphMatcher.match..backtrackinguss#899262P2P+2PBOOB'2P+'372N2N)2NBOOB'2N)%u% 159.CL.Q +N))E*K' =~T"//"%  !159KK;^  +.(+)s D% D*)r'zrDrEzfFiltered out %s matches because matched subgraph would form a cycle if fusedzAFiltered out %s matches because matched subgraphs are overlappingzMatches returned: %s)!torch.fx.passes.utils.fuser_utilsrrr6rTrHrpr{rsrrr rGrvr)rJr@r)r/rcrlrmatch_candidatesrrUrbeforeafter valid_matchesrZr[matched_compute_nodesrrrxs` ` @@@r!rSubgraphMatcher.matchCs H I4?t3D"22N ((OO$4;;DA$3!%%5%;%;%= > 9;PQ') / /Bd&:&:; E "W&-UgU1C1CEOO1T5gUG  ? KKN   E$oo335%5FB55 995 "% ""788$$U+ } W - KKHG s=11   * *'F66}EGLE WN  *G4KV%s$III1I)rAr>r?r=rTrNrSr@)FFTF))rr3r4r5rrrXr rjr9rpr8rvr6r rrrrrr:r2r#r!r r ?sL #"'+/ % 888 8 %) 8  8 8tDdt*4TCQU tD$J'7D*'M*' m '(5#535}55*PRdd d)6dILd dL~5~3~]@S~~r#)r.rr collectionsr dataclassesrrtypingrrr_torch.fxrr torch.fx._compatibilityr __all__r"rr r r2r#r!rs  #( 1 o .  e,    - 2e,AA-Ar#