EiX %SrSSKJr SSKrSSKrSSKrSSKrSSKrSSKrSSK r SSK r SSK r SSK r SSK r SSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKJr SSKrSSKJr SSKJr SSKJrJ r J!r!J"r" SSKJ#r#J$r$J%r%J&r&J'r' SSK(J)r) SS KJ*r* SSK+r+SSK,r+SS K-J.r. SS K/J0r0 SS K1J2r2 SS K3J4r4 SSK5J6r6J7r7J8r8J9r9 SSK,J:r: SSK;Jr> SSK?J@r@ SSKAJBrBJCrC SSKDJErF SSKGJHrH SSKIJJrJ SSKKJLrL SSKMJNrNJOrOJPrP SSKQJRrRJSrS SSKTJUrUJVrVJWrWJXrXJYrY SSKZJ[r[ SSK\J]r]J^r^ SSK_J`r`JaraJbrbJcrcJdrd SSKeJfrfJgrgJhrhJiri SSKjJkrkJlrlJmrmJnrnJoroJprpJqrq SS KWJrrrJsrsJtrtJuruJvrvJwrwJxrxJyryJzrzJ{r{J|r|J}r} SS!K~Jr SS"KJrJrJr SS#KJr SS$KJrJr SS%KJrJrJr SS&KJr SS'KJr SS(KJrJrJrJrJr SS)KYJr SS*KJrJrJrJr SS+KJrJrJrJrJrJrJrJrJrJrJrJrJrJrJrJrJrJrJrJrJrJr SS,KJr S-\S.'SSKr\GRr(a.SS/KJr SS0KJr SS1KZJr SS2KJr SS3KJr SS4KJrJrJr SS5KJr \ GR"\5r\+GRGR\S65r\+GRGR\S75r\GR"5r\&"S85r\)"S95r"S:S;5rSzS<jr"S=S>5r\"5r\"5rSqS?\S@'\GR"\F5S{S|SAjj5rS}S~SBjjrSSCjr\qGRSSDj5rSSSFjjrSq\GR"5rSG\SH'SSIjrSSJjr\"SKSL55rSSMjr"SNSO5rSSSQjjrSSRKJr SSSKJr \"5rST\SU'SSVjr\SESSSSSW.SSXjj5r\"SYSZ55r\"S[S\55r\"SPS]9"S^S_55r\"S`Sa55r\"SbSc55rSSdjrSSejrS{SSgjjrS{SSESh.SSijjjr\"SjSf55rSSESh.SSkjjrSSmjrSESSSSSW.SSnjjrSSSSSo.SSpjjjr"SqSr5rS{SSsjjrSStjrSSujGr"SvSl\GR5Gr"SwSx5GrSSyjGrg!\a SrGNEf=f)a This module implements TorchDynamo's core frame conversion functionality, transforming Python frames into FX graphs. It handles: - Frame analysis and bytecode transformation - Guard creation and management for dynamic behaviors - Cache management for recompilation - Error handling and fallback mechanisms Key classes: - ConvertFrame: Main entry point for frame conversion with error handling - ConvertFrameAssert: Implements core frame to graph conversion logic - Tracker: Tracks input/output code objects during conversion - CatchErrorsWrapper: Provides error handling and suppression logic The conversion process preserves program semantics while enabling optimizations through torch.compile() and related systems. NOTE: _torchdynamo_orig_backend is used for convert frame wrappers to identify the inner wrapped function. By going down the _torchdynamo_orig_backend chain, one can recover the original unwrapped backend, which is checked for during the Dynamo cache lookup. ) annotationsN) dataclass)Path)CellTypeCodeType FunctionType ModuleType)AnyNoReturnOptionalTypeVarUnion) ParamSpec) ReferenceType)GlobalStateGuard)CallbackTrigger)get_compile_pg)TensorifyState)compile_contextCompileContext CompileIdtracing) structured)compile_time_strobelight_meta#maybe_upload_prof_stats_to_manifoldsignpost_event)_use_lazy_graph_module)ConstraintViolationErrorGuardOnDataDependentSymNode)_forward_from_src) _WaitCounter)DistributedDataParallel) OrderedSet)_disable_current_modes any_torch_dispatch_mode_on_stack/is_in_any_mode_without_ignore_compile_internals)CapturedTracebackformat_traceback_short)config decoratorsexcgraph_break_hints trace_rules)_is_registered_backend)remove_dead_coderemove_pointless_jumps) check_inst_exn_tab_entries_valid Instruction is_generator propagate_inst_exn_table_entriestransform_code_object)CacheSizeRelevantForFramecompute_cache_sizeexceeds_recompile_limitis_recompilation)always_optimize_code_objects Constraint dynamo_tlsinnermost_backend innermost_fn skip_code TorchPatcher) augment_exc_messageBackendCompilerFailedFailOnRecompileLimitHitformat_error_msgInternalTorchDynamoError PackageErrorResumePrologueTracingErrorShortenTracebackTorchRuntimeErrorUncapturedHigherOrderOpError unimplemented Unsupported)reset_user_object_tracking)CheckFunctionManager'get_and_maybe_log_recompilation_reasons GuardedCode)Hooks)DynamoTracerOutputOutputGraphCommon)_log_size_mismatch_recompilelog_frame_dynamic_whitelistput_code_state)ExecutionRecord)TORCH_DYNAMO_RESUME_IN_PREFIX)DistributedStateExceptionStackInstructionTranslator LocalStateSpeculationLog)is_numpy)ConvertFrameReturn FrameActionFrameExecStrategywrap_guarded_code)_get_error_on_graph_breakchromium_event_timedCleanupManagerCompileTimeInstructionCountercounters dynamo_timedformat_bytecodegen_record_file_name#get_hook_for_recompile_user_contextget_metrics_contextincrement_frame is_namedtupleistype LazyStringmaybe_disable_inference_mode*maybe_disable_inference_mode_for_fake_prop orig_code_mapreset_graph_break_dup_checkersetup_compile_debug to_int_ustroubleshooting_urlwrite_record_to_file)#torch_function_mode_stack_state_mgrzOptional[ModuleType]np)Callable)WeakIdKeyDictionary) CompilerFn)CompilePackage)WrapBackendDebug) BytecodeHook CacheEntryDynamoFrameType)FrameStateSizeEntrybytecode graph_breaks_T_Pc\rSrSrSrg) TODO_UNKNOWNN)__name__ __module__ __qualname____firstlineno____static_attributes__rX/home/mande/repo/quber/.venv/lib/python3.13/site-packages/torch/_dynamo/convert_frame.pyrrsrrcUcgURRRnURR 5 UR R 5 g)z:Clear WeakIdRef entries from a FakeTensorMode's describer.N)fake_tensor_convertermeta_converter describer lookup_tensorclearlookup_storage) fake_moders r_clear_fake_mode_weakrefsrsH//>>HHI !!# ""$rc<\rSrSrSSjrS SjrS SjrSSjrSrg) Trackerc0/Ul[5UlgN)seensetseen_idsselfs r__init__Tracker.__init__s35 "%% rc^^[U5mTTR;aS[R"UUU4Sj5nTRR U5 TRR T5 gg)Nc:>TRRT5$r)rremove)_idxrs rTracker.add..sDMM4H4H4Mr)idrweakrefrefrappendadd)r strong_objobjrs` @rr Tracker.addsRn dmm #++j*MNC II  S ! MM  c " $rc2[U5UR;$r)rr)ritems r __contains__Tracker.__contains__s$x4==((rclURR5 URR5 gr)rrrrs rr Tracker.clears   r)rrNreturnNone)rrrr)rrrbool) rrrrrrrrrrrrrrs(#)rrzOptional[GlobalStateGuard]initial_global_statecH[XU5n[UR5 U$r)original_forward_from_srcr@__code__)srcglobals co_fieldsresults rfx_forward_from_src_skip_resultrs! 'sY ?F foo Mrc ^^[R"[5m[R"SU-S9R 5n[R "U5n[[R"U4SjU55URUR[R"UR5S./-m[RRSU4Sj5 UVs/sH>nUR T:wdMSUR"SUR$S UR 3PM@ snSURSURS UR3/-nU$s snf) Nskipc>UST:g$)Nfilenamer)fconvert_frame_interns rr"log_dynamo_start.. sa m';;r)linenamer dynamo_startc >ST0$)Nstackr)rsrrrs % rzLine: z, Name: z , Filename: )r intern_string__file__r'extractsummaryfrom_tracebacklist itertools takewhileco_firstlinenoco_name co_filenametorch_loggingtrace_structuredrlinenor)coder captured_tbframes_internedframe stack_stringsrrs @@rlog_dynamo_startrs>%33H=#++T:BBDK // >1 1 P&huzzl,u~~>NO  $$%Xdll^<HXHXGYZ  M s E6-EcX^[R"T5SU4Sjj5nTUlU$)z Context manager to: 1) Save/restore torch.is_grad_enabled() state 2) Save/restore python random state 3) Save/restore torch random state 4) Monkey patch torch.fx.graph_module._forward_from_src c n >[5n[R"5n[RR 5 [ 5 [ 5 [R"5n[R"5n[R"5n[RR5n[R"5n[R"5n [RR5n Sn [RR!5(aE[RR#5 [RR5n SSS5 [RR%SS5n [R&R(R*n [,[R&R(l[/5n[0R2"5nUR5[R&R6R955 UR5[:5 [=5 T"U0UD6UR?5 [RRA5S:XdS5eUR?5 [RRCU5 [RDRFRIU5 [RJ"XVS9 [RL"U5 [RROU 5 [RP"U 5 [RR5nUU:wa[RRS5 U bF[RR#5 [RROU 5 SSS5 [RRUSSU 5 U [R&R(lURW5(dSURY5S35esSSS5 sSSS5 sSSS5 $!,(df  GN=f!,(df  N=f!UR?5 [RRA5S:XdS5eUR?5 [RRCU5 [RDRFRIU5 [RJ"XVS9 [RL"U5 [RROU 5 [RP"U 5 [RR5nUU:wa[RRS5 U bX[RR#5 [RROU 5 SSS5 O!,(df  O=f[RRUSSU 5 U [R&R(lURW5(dSURY5S35ef=f!,(df  O=fSSS5 O!,(df  O=fSSS5 g!,(df  g=f)NcudamatmulrzQTorch function mode stack state changed while dynamo tracing, please report a bug) warn_onlyzGlobal z7state changed while dynamo tracing, please report a bug)-rris_grad_enabled_C_PreserveDispatchKeyGuardrrrsis_inference_mode_enabled$are_deterministic_algorithms_enabled-is_deterministic_algorithms_warn_only_enabled$_is_default_mobile_cpu_allocator_setrandomgetstateget_default_dtype get_rng_stater is_availableDisableTorchFunction_get_fp32_precision_getterfx graph_moduler rrv contextlib ExitStack enter_context_symbolic_trace_maybe_revert_all_patchesrzrNclose_len_torch_function_stack_set_grad_enabledautograd grad_mode_enter_inference_modeuse_deterministic_algorithmssetstate set_rng_stateset_default_dtype#_unset_default_mobile_cpu_allocator_set_fp32_precision_settercheckreason)argskwargsguardsprior_grad_modeprior_inference_modeprior_deterministicprior_warn_onlyprior_mobile_allocator_state py_rng_state prior_dtypetorch_rng_statecuda_rng_statecuda_matmul_fp32_precprior_fwd_from_srccleanup exit_stackcurr_mobile_allocator_statefns r_fn"preserve_global_state.._fn-s!#//1 HH . . 0 ( * 6 8#(#B#B#D "'"L"L"N #QQSO==? )"??,L113K#ll88:O!Nzz&&((XX224%*ZZ%=%=%?N5$)HH$G$G% !"'!6!6!H!H 6UEHH ! ! 3)+G#--/J  $ $((BBD   $ $%H I & ( 4*6* xx99;q@g@  "**?;((>>?ST22' - **?;'' 4HHAAC,03NNHH@@B!-668 00@933H&;;M%%7||~~fmmo..ef~o 9 8 + * 1 054H98' xx99;q@g@  "**?;((>>?ST22' - **?;'' 4HHAAC,03NNHH@@B!-668 00@98833H&;;M%%7||~~fmmo..ef~o 9 8 8 + * * 1 0 0s Z& Z C)Y1>Q C$Y1Q1 EY1 Q ^[T5nUT;aTU$STU'[T[R[RR 45(d>[ T[5(a3[T[RR 5(a STU'TU$[R(aS[(aH[ T[R5(d[T[R5(a STU'TU$[ T[[45(a[!U4SjT55TU'TU$[ T["5(a6[TR%55n[!U4SjU55TU'TU$[ T[&[([*[S5[,45(a STU'TU$[/T5(a9[1TS5(a([!UU4SjTR255TU'TU$g)z)Recursively check if the obj has a tensorFTc34># UH nT"U5v M g7frr.0v has_tensors r :has_tensor_in_frame..has_tensor..s">#Q:a==#c34># UH nT"U5v M g7frrr2s rr6r7s"A&Q:a==&r8N_fieldsc3H># UHnT"[TU55v M g7fr)getattr)r3r4r5rs rr6r7s"T 1:gc1o#>#> s")r isinstancerTensornnModulerptype issubclassr* trace_numpyr{ndarraygenericrtupleanydictvaluesstrintfloatrrohasattrr:)robj_idrIr5rs` rr5'has_tensor_in_frame..has_tensorsC X F# #  cELL%((//: ; ; 3  *S%((//"B"B#HV F# #   RZZ((JsBJJ,G,G#HV F# # C$ ' '"">#">>HV F# # C  #**,'F""A&"AAHV F# # C#sE4:t< = =$HV F# # 3  GC$;$;""T "TTHV F# # rz0skipping because no torch.* %s %s %sF)robjectrr)f_coder;co_names f_globalsr=r r startswithrr{r*rCr_f_localsrIlogdebugrrr)rrrvaluer5rs @@rhas_tensor_in_framerYxs ||33<<(( oo %//'*C#z** ''11SE\rf(((cRi8C==)!#H((V&&( e  )II      ##  rFcSn[US5(a&[X5n[X@R5 X@l[ XS9 g)N exec_recordexport)rMrkryr[record_filenamerB)errr]r^s rexception_handlerr`s: Oq-  .q7_mm<+)rz/typing.Counter[Union[int, FrameStateSizeEntry]]FRAME_COMPILE_COUNTERcF[R(a [U5$U$r)r*cprofilecprofile_wrapper)funcs rmaybe_cprofilerfs %% KrcJ^[R"T5SU4Sjj5nU$)Nc &>^ [R"5nU(dS5e[[RR [ R"5T RS[U5RSS5S355n[R"5n[R"5nUR"T /UQ70UD6n[R"5U- n[ R%ST RUU5 [&R("U5nUR+U5 [ R%S U5 UR/S 5n [0R2"S S S SSS[U5/[0R4S9n [0R6"SSS[U 5/U R8S9 [ R%SU 5 SSS5 [G[U55=m (a$[HRJRMSU 4Sj5 U$![a# [ R#S5 SnT "U0UD6nGN]f=f![,a [ R#SU5 GN:f=f!,(df  N=f![:a [ R%S5 UR=[&R>R@5RCS5 UR=[&R>RD5RCS5 GN;f=f)NzTrace id is Noner/z.profilezfailed to enable cProfilerz7### Cprofile for %s trace id [%s] took %.3f seconds ###zCannot write to %szRaw profile at %sz.svg gprof2dotz-fpstatsz"--node-label=total-time-percentagez!--node-label=self-time-percentagez--node-label=total-time)stdoutdotz-Tsvgz-o)stdinz Generated SVG from profile at %szxFailed to generate SVG from profile -- dumping stats instead.Try installing gprof2dot and dot for a better visualizationlinkc>STS.$)Ncprofile_manifold_url)rurlr) manifold_linksrr;cprofile_wrapper..profile_wrapper..&s !8Or)'rcurrent_trace_idrospathjointempfile gettempdirrrJreplacecProfileProfiletimeruncall ValueErrorrV exceptionwarningrkStats dump_statsOSError with_suffix subprocessPopenPIPE check_callrlFileNotFoundError sort_statsSortKeyTIME print_stats CUMULATIVErrrr) rrtrace_id profile_pathprofstart_tsretvalprofile_latencypssvg_pathgprof2dot_processrtres @rprofile_wrapper)cprofile_wrapper..profile_wrappers!224+++x GGLL##%==/3x=#8#8c#B"C8L  ! +yy{H \\$888F"iikH4O E MM    \\$  > OOL ) '6++F3 E!!87- %" #%%GT3x=9+22 >I! 2@    =  NN + +O  e + MM5 6O4*6*F + > MM. = >  "! E KKN  MM&..-- . : :2 > MM&..33 4 @ @ D  EsW!AHI3I= AI, I=)II I)(I), I:6I=:I==BLLr*)r+r,)rers` rrdrds)__TDDL rc$\rSrSr%SrS\S'Srg)ConvertFrameBoxi-NzOptional[bool]error_on_graph_breakr)rrrrr__annotations__rrrrrr-s +/./rrcSU;a[US'[S- qUSn[U[5(de[Un[U==S- ss'Sn[R "5=n(a UR n[UUUS9$)N_idr))compiled_autograd_idframe_idframe_compile_id) FRAME_COUNTERr=rKrarcurrent_compile_idrr) frame_staterrrpriors rget_compile_idr2s K* E 5!H h $ $$ $,X6(#q(#1133u3$99 1) rc|\rSrSrS S Sjjr\S Sj5rSS.S SjjrSrg) ConvertFrameAssertiINcr[5 XlX lX0lX@lXPl[ 5Ulgr)rur- _one_graph_export_export_constraints_packager_box)r compiler_fn one_graphr]export_constraintspackages rrConvertFrameAssert.__init__Js/ &')4&# #5  #% rc^U4Sj$)Nc\>[UTRTRTR5$r)convert_frame_assertrrrbackendrs rr8ConvertFrameAssert._clone_with_backend..]s%3  OO LL  $ $  rrrs`r_clone_with_backend&ConvertFrameAssert._clone_with_backend[s   rrrc4 [5 URn[X5n[R U5 U[ ;a [ 5$[RRS5(a7[RRS5UR:wa [ 5$URS:Xa*URRS5(a [ 5$URS:Xa [ 5$URS:Xa_URR[RR[ R"R$55(a [ 5$URS:XaURS:Xa [ 5$URS:Xa4URS:Xa$['UR(5(d [ 5$[+U5(a[-S S S S /[.R0QS 9 [3U5(d [ 5$[4R6"5nU(aISURR;a/UR8nU(aSURR;aM/U(a&UR[:R<La [ SS9$[>n [A5q[CU5n U RDn [GSSURU [IU 5URURJURLURNS.5 URR5(dGURSURSURJ3n [RRTRWU 5 [Y[[U 55 []URUR^UR`UR(URbURdURfURhURjUUUUUU US-URlURnS9n SSS5 U q[pRr(a.URlb!SSK:J;n URyURl5 W $!,(df  NU=f!U qf=f)NTORCHDYNAMO_DEBUG_FUNCTIONz )ztransformers/file_utils.pyztransformers/utils/generic.pyzdiffusers/utils/outputs.py __setattr__rzzzAttempt to trace generatorzTRR5 [TRR5 TR 5 TR 5 SSS5 SSS5 TRR5 0Tlg!,(df  N8=f!,(df  NA=f![ Ra TR5 e[ R[ R[ R4a e[a* T"5(aT"TRR5 ef=f!TRR5 0Tlf=fr)outputmark_bytecode_tracing_startrtracing_contextset_current_txrunr,UnspecializeRestartAnalysisrSpeculationRestartAnalysisTensorifyScalarRestartAnalysis SkipFrame Exception shape_envcall_cleanup_hooksrU)rrtracerrsr run_tracertrace_frame..run_tracerHs ! MM 5 5 76679N9N9P :Q7 MM , , . FO#:Q9P77..   ! ! #   * *  . . MM    -//v}}../   MM , , . FOsS9B2B! BB!&B2 B B!! B/+B2.E/B22B D==E#E#T)errorr)torch.fx.experimental.validatorrrrestartr[r\rS output_graphoutput_instructionsupdate code_optionsr5r2r1r0r_torch_dynamo_tracer_output)rrlocalsbuiltinsrr tf_mode_stackrr instructionsrr]rrrrrr tracer_outputrr_rrrs ` @@@r trace_framer!s(W!#L " '!+#F(!!,  *62 ++!!!)))) 44 QF//0(6(601A,1OP Q  (:6(N% s B C C:%C55C:c\rSrSr%SrS\S'S\S'S\S'S SS jjrSSS jjrS rg ) DynamoOutputioaS Represents the core data returned from a single dynamo run, including: - Guards, wrapped inside tracer_output.output_graph.guards - Generated bytecode - Other information needed for compilation. This data structure should capture all the "interesting" information dynamo produces on the frontend side before it enters user backend. rSr types.CodeTyperzOptional[float]last_attempt_start_timeNc URRnUce[UUUU(a UROSU(a UROSUUS9$N) save_guards strict_error)r rrO guard_fail_fnguard_filter_fn)rrrsaverr)rs r build_guardsDynamoOutput.build_guards~sW))66 '''#   #(E  d%*E ! !%  rc nURRnUce[[UR 5UR UR URUR5UR URURURRUUURR5$r) r rGraphCaptureOutputrTdump_guards_stateimport_sourcesrexport_metadatatracked_fakes_id_to_source traced_coderrrS)rargdefs kwdefaultsrs rgraph_capture_output!DynamoOutput.graph_capture_outputs ))66 '''! ..0++&&,,77    ' '  $ $ MM    & &      ( (  rrNFNF rr$rzOptional[Hooks]r,rrrr)rrrONN)r6Optional[tuple[Any, ...]]r7Optional[dict[str, Any]]rr0) rrrr__doc__rr-r8rrrrr#r#os&%,, "&,0"      *      ,.2/3 * -     rr#cL\rSrSr%SrS\S'S\S'S\S'S \S 'S \S 'S rg) BackendInputia Represents core data structure that dynamo will pass to a backend, including: - Graph module - Example inputs - The FakeTensorMode used for compiling graph. This data structure should capture all the information dynamo produces on for the user backend. rJ backend_idtorch.fx.GraphModulerr example_inputsz,torch._subclasses.fake_tensor.FakeTensorModerr}tensor_to_contextrN)rrrrr?rrrrrrArAs&O&&;;**rrA)frozenc\rSrSr%S\S'S\S'S\S'S\S 'S\S 'S rS \S '\R"\S9r S\S'S S.SSjjr SSjr Sr g )GraphRuntimeEnvir$rdict[str, str]r2dict[str, Any] used_globalsr=rr6Nr>r7)default_factoryset[str] external_refs extra_globalscURR5VVs0sHupEU[R"U5_M nnn0UEUREU=(d 0EX0EnUR U5 [ R"URUURURS9nUR(aURUl U$s snnf)N)rr6) r2items importlib import_modulerK_check_external_refstypesrrrr6r7__kwdefaults__) rrB compiled_fnrPalias module_namer2rSr's rforward_callable GraphRuntimeEnv.forward_callables'+&9&9&?&?&A &A" 9**;7 7&A     "     !!),    MM LLLL   ?? $B  - s#C c/nURHnX1;dM URU5 M U(a[SUS35eg)Nz&Missing required external references: zM. Please load AOT compiled function with `f_globals=`)rNr RuntimeError)rrS missing_refsrs rrU$GraphRuntimeEnv._check_external_refssV %%C###C(& 8G^^  rr)rBrJrXCallable[..., Any]rPr>rra)rSrJrr) rrrrrr7 dataclassesfieldrrNr[rUrrrrrHrHsu""  && &&+/J(/)//DM8D37 ( 0   > rrHc\rSrSr%SrS\S'S\S'S\S'S \S 'S \S 'S \S 'S\S'S\S'SSSjjrSSjr\SSj5r Sr g)r0iz! Minimal version of DynamoOutput rTrrIr2zlist[CodeType]r5rrr=rr6r>r7rJrSNc [UURUU(a UROSU(a UROSUUS9$r')rOrr*r+)rrrr,rr)s rr-GraphCaptureOutput.build_guardss@$     #(E  d%*E ! !%  rc SSKJn 0nURRRR 5H2nU"U5nUcMX@R ;dM!UR UX$'M4 URUR5n[URURUURURURUS9$)Nr)get_global_source_name)rr2rKrr6r7rN)torch._dynamo.sourcerhrr3graph_input_idx_to_local_sourcerIrS_get_external_refsrrHr2rr6r7)rrhrKsource global_namerNs rget_runtime_env"GraphCaptureOutput.get_runtime_envs?    . . N N U U W 08K"nn,,0NN;,G ) X// > ]]..%LLLL'  rcTSSKn[5nUR"U5HnURS:Xa0UR(aUR UR5 MAMCURS:XdMUUR(dMhUR UR5 M U$)Nr LOAD_GLOBAL LOAD_NAME)disrget_instructionsopnameargvalr)rrsrN instructions rrk%GraphCaptureOutput._get_external_refs/s"%% //9K!!]2%%!%%k&8&89&##{2%%%!%%k&8&89:rrr:r;)rrH)rr$rrM) rrrrr?rr-rn staticmethodrkrrrrr0r0s$#"" && &&(( "&,0"      *      $ 4rr0cL\rSrSr%SrS\S'S\S'SSS.S S jjrS rg) CaptureOutputiCa CaptureOutput should represent all the information produced from torch compiler for a single graph capture. This intends to be consumed by various compiler frontends so that we can share as much compiler internals as possible and avoid great divergence between different stacks. This data structure should eventually contain all the information compiler produces as more refactors happens to converge different compiler frontends. r0r8zOptional[BackendInput] backend_inputN)rXrPcURR5nURceURRnU=(d URRnUR UUUS9$)NrO)r8rnr|rBrr[)rrXrP runtime_envrBs rr[CaptureOutput.forward_callableSsr //??A !!---''22 !DT%7%7%D%D ++  ',  rr)rXzOptional[Callable[..., Any]]rPr>rra)rrrrr?rr[rrrrr{r{CsE-,)) 5926  2 0     rr{cSSKn[U[RR5(GaEUR n[ US5(a URnURn[ US5(a URn[UR5S:XGa[UR5S:XGa}[[RRRR5S:XGaA[[RRRR5S:XGa[UR 5S:Xa[UR"5S:Xa[[RRRR$5S:Xa[[RRRR&5S:Xa]U[RRR :wa5U[RRR:Xa UR nOB[U[R(R*5(a UR,nO URn[ US5(aURUR.4$UR0"U5(aUS4$[3SU35e)z Utility function to get the function to trace, and optionally a bound self object, from a callable (nn.Module, function, or method). rN__self__zUnsupported model code type )inspectr=rr?r@forwardrM__func__rlen_forward_pre_hooks_forward_hooksmodulesmodule_global_forward_pre_hooks_global_forward_hooks_backward_pre_hooks_backward_hooks_global_backward_pre_hooks_global_backward_hooksr GraphModule _call_implr isfunctionr^)modrresolved_forward resolved_calls r get_traced_fnres #uxx'';; #Z 0 0/88  =* - -)22M && '1 ,C&&'1,EHH$$++EEF!KEHH$$++AABaGC++,1C''(A-EHH$$++FFG1LEHH$$++BBCqH EHHOO$;$;;!9!99 ++C UXX11 2 2..C,,CsJ||S\\))   C Dy9#?@@rc,[R"USS9$)NF)follow_wrapped)r signature)r's r_get_signaturers   R 66r FrameInfoc ~SSKn[U5upEUbU4U-nUc0n[U5nUR"U0UD6nUR 5 UR nUR =(d Sn URRn U (dU (aS[U 5[U 5:XdeUR[X5V V s0sHupXR_M sn n 5 [URURUURUR =(d SUR UR"S9$s sn n f)zD Create a frame to trace, given a model, args, and optional kwargs. rNr)rr6r7)rrrbindapply_defaults arguments __closure__r co_freevarsrrzip cell_contentsr __globals____dict__ __defaults__rW) rrrrr'self_optrbound_argumentsrUrfreevarsrcells r _get_framers %LB{T! ~r"Innd5f5O""$((Hnn"G{{&&H77|s8},,,8;H8N O8N*$T%% %8N O    $"$$  PsD9  constraints _is_export_deprecated_do_not_usec[XU5n[[[0555 [ UUUS9sSSS5 $!,(df  g=f)aI This API captures a full graph for a model, given example inputs to trace with. Specifically, it takes a callable (nn.Module, method, or function), args, and optional kwargs, and returns Dynamo-captured graph along with other important compile-time information. This serves as the common graph-capture mechanism for different torch compiler AOT frontends (e.g. AOT precompile, export). Note that this API doesn't apply context managers like metrics context, and the expectation is that the caller will apply them depending on the use case. The CaptureOutput is separated into two parts: 1. Frontend specific information, which includes: - guards - generated bytecode - other information tracked by OutputGraphCommon. 2. Backend specific information (indexed by unique backend id) such as: - fx graph - example inputs rN)rrrr_fullgraph_capture_frame)rrrrrrs rfullgraph_capturers?: s& )E r(:; <' #-M  = < r7rN)rrrrrrrrrrrs,     &&((rc b^^SSKJm SmSUU4Sjjn[URURUR UR URUUUS[5S9 n[!UR#UR$UR&5T5$![[4an[U5 [R(aeUnURb6URRS5 URnURbM6URS5UReSnAff=f)Nr)TracingContextc>TR5nURnURnUce[URS[ 5(de[ URSXX45mU$)NrB)rrrEr=metarJrA)gmrDrrrErr|s rfullgraph_compiler4_fullgraph_capture_frame..fullgraph_compilerss),,.#-- +==$$$"'',/5555$ GGL !2y  rT)rr]rrrestart_reasons)rrCrDzlist[torch.Tensor]rrC) torch._guardsr compile_framerrrrrrrMrKrBr*verbose __cause__with_tracebackr{r8r6r7) rrrr dynamo_outputr_cur_exnrr|s @@rrrs -,0M   2D    6% JJ MM LL NN MM*3*E  4 **5==%:J:JK  5 6 6A >> !"+    , ,T 2''G+t$!++5 6sA BD.'A$D) D))D.ConvertFrameProtocolcX^^[TSS5nUbU$SSjmSUU4SjjnUTlU$)N_dynamo_fail_callbackc[S5e)NzDynamo: expected not to compile nested code - this happens because a Dynamo callback was triggered and succeeded in compiling when running fullgraph=True compiled code.)r^)rrs rcompile_frame_error.get_fail_callback..compile_frame_error4s 9  rc>[R"[S-T5 T"U0UD6sSSS5 $!,(df  g=f)Nz.compile_frame)mockpatchr)rrcallbackrs r fail_callback(get_fail_callback..fail_callback;s2 ZZ#335H IT,V,J I Is 2 A)rr rr rr )rr rr rr`)r<r)rrrs` @rget_fail_callbackr/s=H&=tDM  -- &3H" rc^^^^^^^^^ ^ ^ ^ ^[5mSUUUUU UU U UUUU U4 Sjjn Sn[R"5HTnU[R"5l[ SU3SS9 [TU 5unnUce[UUUS9sSSS5 s $ g!,(df  Mh=f![Ran[U[R5(d[R"5 [R!S[#[$UR&55 [)USS5nU(aUR+5 UR-UR.=(d [1[3U555 [4R4"5nUS :a[7S S S /S 9 SnAGMiSnAGMpSnAf[R8an[U[R5(d[R"5 [)USS5nU(aUR+5 [R;SUTR<TR>TR@5 eSnAff=f)a  A helper function taking a frame and backend, then return the generated bytecode and guards as a common data structure. This is a shared interface for multiple compiler frontends (e.g. torch.compile, torch.export) that needs to capture a graph out of python code. c~> [RR5n[TT T TTTUTTUUT T T TTS9nUceU$)Nr)r overrides _get_current_function_mode_stackr!)rrrr rrrrrr]rrrrrrrs r transform compile_frame..transform^sj OO < < > $           1#/! &(((rNcompile_attempt_Tlog_pt2_compile_event)r rr%zRestarting analysis due to %srdz!Excessive RestartAnalysis() callsrzDynamo attempted to trace the same frame 100+ times. Giving up on compiling as the compile time tradeoff is likely not worth the performance gain.rzPReceived signal to skip frame (without graph break): %s %s %s %s)rlist[Instruction]rrrrS)!r^rcountrrattemptrir6r#r,RestartAnalysisr=r rrrVrrqr( __traceback__r<_cleanup_output_graphrrestart_reasonrJrArrLr rWrrr)rrrrrrrrr]rrrrrr%rrr r_failed_tracer_outputrs``````` ````` @rrrDs0%&O'7H 8#??$'.$0  0 :RVW*?i*P'-$000#"/%,CXW %XW"" a!C!CDD$$& HH/11??C  $+1.KT#R #$::<    0 0 @CQL A&*iik #}?!2 }} a!C!CDD$$&#*1.KT#R #$::< II   ##    sD' B44B" B4" B1 ,B41B44I%C#F99I%BI  I%)rrrc^^^^^^^^ ^ ^^^>^?^@^A^BSSKJnJn Sm@[SS9SBU>4Sjj5n[SCUU UUUU?U@UUU UUUUB4Sjj5m>[ 5nTbTR U5O[R"5n[[R5 [[T55 [SS S S 9 [S 5R!5 U [#S S SS9 U [%5mB['5=n(a[)U[+55m?OSm?Sn[-U 5(a+U (a$[/T U [1T55nU(dSOUSnSn[R2(d5U (a.[/T U [1T5S S9nU(dSOUSnUbSU;aS nUR5UUS.5 [75nU(a,UVs1sH nU"5SSiM nnUR%SU5 [9U T5un mAU (aGSDSjn![:R=STA[?[TA5U!"U5U[@5 SEUA4Sjjn"U""5 [:RQSURRURTURVUS-SRY[ZR\"SU-S9R_555 [aX5n$[bRd"5n%Sn&Sn'Sn(Sn)Sn*[fRhRjRlRo5 Sn+Sn,U"XU 5un+n,[q5 U,(aJU,Rr=n-(a7U-Ru5(a"[wU5 U(aS U;a [y5 U+[fRhRRz(a>[#S!S"S#9 [:R}S$5 [~R"S%5 SSS5 Sn.U,(a U,Rrn.U.(a!0U.lAU.R=n/(a0U/lCS%S&K5JDn0 [U05n1U'Gc U.Gb[U.R5n2[U.RR5n3U.R5n4[U.RR5n5U.R5n6[U.R5n7U.RV8s1sHn8U8RiM n9n8U.RV8s1sHn8U8RiM n:n8[fRhRjRlR;5 OGSn2Sn3Sn4Sn50n6Sn7[%05n9[%05n:[%5mB[bRd"5U%- S'- m@0S(U1_S)URR_S*URT_S+URV_S,U R_S-U R_S.U2_S/U3_S0U4_S1U5_S2U7_S3U&_S4U'_S5U)_S6U*_S7U9_S8U:_TBT@U+SL[RS [T@5U$[U65U(S9. En;UR5U;5 U(a"U,(a U,RO [5UlUU,b_U,RrbRU,RrR(d7[5U,RrRRRl\[RnS?9 [R"U#T5un)n*[?U#S@S5n,[U#[B[[[[[U[U[[[4 5(ae[[U#5RSA[U#535RU#R5SeSn#A#ff=f![fRhRRz(aP[#S!S"S#9 [:R}S$5 [~R"S%5 SSS5 O!,(df  O=fSn.U,(a U,Rrn.U.(a!0U.lAU.R=n/(a0U/lCS%S&K5JDn0 [U05n1U'GcU.Gb[U.R5n2[U.RR5n3U.R5n4[U.RR5n5U.R5n6[U.R5n7U.RV8s1sHn8U8RiM Os sn8fn9n8U.RV8s1sHn8U8RiM Os sn8fn:n8[fRhRjRlR;5 OGSn2Sn3Sn4Sn50n6Sn7[%05n9[%05n:[%5mB[bRd"5U%- S'- m@0S(U1_S)URR_S*URT_S+URV_S,U R_S-U R_S.U2_S/U3_S0U4_S1U5_S2U7_S3U&_S4U'_S5U)_S6U*_S7U9_S8U:_TBT@U+SL[RS [T@5U$[U65U(S9. En;UR5U;5 U(a"U,(a U,RO [5UlUU,b_U,RrbRU,RrR(d7[5U,RrRRRl\[Rn[R"5nUR[RR R [R[[R"5555 UR[R"55 T"XU5sSSS5 $!,(df  O=f[5S4$r)rrrr_dynamocallback_handlerinstall_callbacksrDYNAMOrJrrrgrecordr`)rrrr_compile_inners rr_compile..compile_inners ! ! #u    ..@@#**C0Q0Q0S,T     = D D F G!$59$ # #    s BB11 B?c>[R"5=p4SSjnU"SURURURU5 Sn[ UT T!TTTUT#TTTTT"S9 nTbTRcS5eURnURn URb URnUceU"SURURURU5 [[ R#55H(up[%SU 3SS 9 U "X5n U bU nSSS5 M* U[&U'[(R+U5 X4- mU R,ceU R,n SS jnUceU"U5nU"U5nS nUS UR.SUS 3- nUSUR.SU3- nUR.SUUR.SU:XdU5eSnUSUR0S 3- nUSUR03- nUR0UR0:XdU5eSnUSUR2S 3- nUSUR23- nUR2UR2:XdU5eU R4(a!U R75(a [5U 4$U R8ceU R:[<R>U'[%SSS 9 URAUUT"SLTS9nSSS5 T"buWRBceT"REURBU5 T"RGU RHRJ5 T"RMU RNRP5 Tb [ST5OSnSU-n[UUWRVTU5nU R75(d(URXbURYU R85 [[U5U 4$![ R aKnU(a[RS5 URce[5UR4sSnA$SnAff=f!,(df  GMM=f!,(df  GNs=f)Nc [R[R5(a![R [ XX#U55 ggr) bytecode_log isEnabledForloggingDEBUGrWrj)prefixrrline_nors r log_bytecode6_compile.._compile_inner..log_bytecodes8((77""#F(TJ8rzORIGINAL BYTECODErz,No graph captured with export/fullgraph=Truez;compiler collective wasn't run before compilation completedzMODIFIED BYTECODEbytecode_hooks_TrcSSKnURUR-[URUR -5-[URUR -5-$)Nr)r co_argcountco_kwonlyargcountrco_flags CO_VARARGSCO_VARKEYWORDS)rrs r count_args4_compile.._compile_inner..count_args5s]   (()t}}w'9'99:;t}}w'='==>? rzarg mismatch: zold code object has args z, znew code object has args zfree var mismatch: zold code object has free var znew code object has free var zcell var mismatch: zold code object has cell var znew code object has cell var r-)rr,rUnknownzTorch-Compiled Region: ) rrJrrJrrJrrKrrrrrrrrK).rrrrrr,r rVrWrr` all_statesrr r% enumeraterrIrirtrrr co_varnamesr co_cellvarsr]is_empty_graphrcleanupsrfinstancer- guards_stateadd_guarded_codeadd_inlined_sourcerr5update_device_typecurrent_tracergraphrJrQ guard_managerguard_export_fnrc)$rrrr% start_timerout_coderr_r rr hook_outputrrtotal_argcount_oldtotal_argcount_newmsgcheck_fncompile_id_strannotation_str guarded_coderrrrrrdynamo_time_before_restartr]rrrrrrs$ rr _compile.._compile_inners04yy{:  " .1 .format_func_infos04<<.D,<,<+=Qt?R?R>SSTUUrztorch._dynamo hit config.%s (%s) function: %s last reason: %s To log all recompilation reasons, use TORCH_LOGS="recompiles". To diagnose recompilation issues, see %sc j>[SST3STS[[T5S3STS3S[S 3/S 9 g) NzDynamo recompile limit exceededz Limit type: zLDynamo attempted to recompile the code object too many times, exceeding the z$ cache size limit (currently set to zj). Excessive recompilations can degrade performance due to the compilation overhead of each recompilation.zTo monitor recompilations, enable TORCH_LOGS=recompiles. If recompilations are expected, consider increasing torch._dynamo.config.z to an appropriate value.zSee z) for tips on dealing with recompilations.r)rLr<r*rx) limit_typesr(raise_unimplemented_cache_limit_exceeded:_compile..raise_unimplemented_cache_limit_exceededsj=*:,7!%%/L0TU\]ceoUpTqrY!Y ;;E,F_a233\]  rz/Hard failure due to fail_on_recompile_limit_hitz"Hard failure due to fullgraph=TruezBtorchdynamo start compiling %s %s:%s, stack (elided %s frames): %srrzsize mismatch at indexgc gc_time_us)r#z run_gc_after_compile: running gcr)) curr_framegeA frame_keyrrrrr guard_countshape_env_guard_countgraph_op_countgraph_node_countgraph_input_count fail_type fail_reasonfail_user_frame_filenamefail_user_frame_linenonon_compliant_opscompliant_custom_ops) rdynamo_time_before_restart_shas_guarded_codespecialize_float is_forward%dynamo_compile_time_before_restart_us stack_tracegraph_node_shapesexception_stack_trace_old_fake_moder\artifactc SSS.$)N dynamo_errorstringrencodingrrrrr_compile..Ds * (%rc,[R"5$r traceback format_excrrrrrQHs 9#7#7#9r metadata_fn payload_fnrz: )rrrrrrRrz7tuple[ConvertFrameReturn, Optional[DynamoTracerOutput]])rrrrrrRrz-tuple[ConvertFrameReturn, DynamoTracerOutput])rrrrJ)rr ){rrrrrfrm code_contextr nullcontextrr*use_lazy_graph_modulerrrer!guardrirrrZr]r:rPr?inline_inbuilt_nn_modules update_outerrlr9rVrr<rxrMfail_on_recompile_limit_hitrDrbraRUN_ONLYframe_exec_strategyrWrrrryr'rformatrrtime_nsrrutilsReinplaceCountersrrWr has_outputsrVrUrun_gc_after_compilerr3collect local_scoperoot_txrUr5rJrrr count_callsrnodesget_graph_sizes_structured placeholdersr@rrArrrDrwrrdr]r#rguards_context dynamo_guardsinner#invalidate_compile_context_weakrefsr/r>rErrrMrJrrArTrUr`rrr,get_exc_messager=rJrCAssertionErrorrrrKrIrGrHrFrr)Crrrrrrrr]rrrrrrrrrrrrrmetrics_contextrY compile_pgr%reasonsr&inbuilt_nn_reasonsinbuilt_nn_recompile_reasonr( user_contextuser_contexts_msgexceededr,r0r_rG start_time_nsr<r=rIr>r?rr rrrr5r6r7r8r9r:rHr;opr@rAmetrics should_cleartcrrrr/rsC ````` `` ` `` ` @@@@@rrrs .),"o>  #' 05 @ ? "\>\>\>\> 7 \>\>\>\>|*+O&-&9T"z?U?U?W v;;<z23 d$  BCIIK $-%H $'E') ): ) 0Z\ J  $ +/ J ' 'E=UL$=G?F67ST: /4+//E!HUL$=D" /4Fq4I ( ,7;./7;3 $$$47Z  #F"G ":Q!9P t$9P !    9;L M6z:N*  V KK;  + & #    8:" Q LL       1H GG%--1t8<CCE F 4't2   #' %) 5926 04 --335   *7*O 'L-  %2%?%??\? ,,..+D1#(@DT(T02f}}##88!$NHH?@JJqMOF&33%'"#^^+6+&(FO )JI"v'9!&--0 (+F,<,<,C,C(D%!'!3!3!5#&v||'9'9#: $*$E$E$G!$'(;(;$<!?E?W?W$X?WR__?W!$X.4.I.I(.IBOO.I%( ##5599;" (,%!%#' $&!$(!$'G!'*2w$"%%.2lln}.LPS-S*Y4<<t//!$"5"5  jTT  )**F*F {()>!.#$4$%6Y{+,D)*@ $%6!"'(<#$$30J$0$<$*$;$;"9B.: +%():%;)>9GB  ( ( 1!%"6624"6)!..:%2299`j`l **::IIWW]"EEL# 66G 6TU  ]%?%?&33CCB((..0.bll;}99;KLL1)66EEY      LK   43 =#,,k.B.B-A) |ON2%Y([+ <Q,,Ia&K%.%9%9%;$< ! aV < NN + +: , @C?R?R:@ < $&<$A'DdKM%)",/'0-$ . "/Aw++,Bs1vh7 .1t!.#$4$%6Y{+,D)*@ $%6!"'(<#$$30J$0$<$*$;$;"9B.: +%():%;)>9GB  ( ( 1!%"6624"6)!..:%2299`j`l **::IIWW]"EEL# 66G 6TU  ]%?%?&33CCB((..0.bll;}99;KLL1)66EEM &@=I       LKK    433 =< x? x%$x ' w1 3w 6C%v<_/A)v<_ C v<.A(a,3v< ,a5C4v<)a"?v<a'%I2v< w w1 ) x 2 x%; x? yv< a &A"aa  v< av<, f7Df  ff4v9,g=4 v9= h C3v9:lv9&l=[UTR5$r) convert_framerrs rr2ConvertFrame._clone_with_backend..s}  KK rrrs`rr ConvertFrame._clone_with_backends   rc^[RUR5 [SS==S- ss'UR XX4US-S9n[SS==S- ss'U$![ Gan[ U[5(aeURRRSLnUceURRR(ae[ U[5(ae[ U[5n URn U (Ga,[USS5(Gd[R[R 5(a[#US5(a[#US 5(a[%['UR(55 UR*n S R-[.R0"U 55n [2R4"U 5n S U S U 3m[6R8R;S SU4SjS9 [R=TS[>R@S9 SSS5 O!,(df  O=f[>RB(dU (de[USS5nURn [EXzX5nU (a[FRIUSS9 O[FRKUSS9 [ U[2RL5(a%URNb[QURNS9sSnA$SnA[Q5$SnAff=f)Nframestotalr)rokloggedFr real_stackrzGraph break: torch.compile cannot properly resume from this graph break, which results in a skip. torch.compile will skip tracing the frame zN and fall back to eager. The graph break occurred in the following user code: rKc SSS.$)Ndynamo_graph_break_reasonrNrOrrrrr'ConvertFrame.__call__..Is (C,41rc8>TS[R"53$)N rS)user_stack_tracesrrrMs2B1C2iFZFZF\E]/^rrVT)exc_info stack_infor^)r)ra))rrrQrhrrr=rHrrrKrMr<graph_break_logrrrrMrrrrryrT format_listr,format_frame_inforrrrWr*rsuppress_errorsrErVrrTorchDynamoExceptionrar`)rrrrrrrr_r soft_failr user_stackuser_stack_formatted frame_infor^ error_msgrs @rrConvertFrame.__call__s  %7#q(#g U((ETAX)F X t $ ) $Ma U!788##((==TI !(3 33""''<<  !9::"1k2I<S>STT!##Ga Us8)A K=+DK8BH# K8# H1 -B7K8$K=8K=)rrr-r)rr~rrRrOptional[CompilePackage]rr)rz*Callable[[WrapBackendDebug], ConvertFrame]rrrrrrrrs -1   *      s$s$*s$ s$ @ s$  s$ s$s$rrc[XUS9$)zHTry to convert a frame into an FX graph, if error leave frame unmodified)r)r)rrrs rrros  G <*>*@')//BSTUFN  ( ( / ?   !#'g4Q: $b3G $,?F () 0 /  0,?F () 0 /s0D06E8A#E E0 D> EE Ec[RS:ag[R"U5H$nURS:XdMUR S-s $ [ S5e)N) rRESUMEr2z$RESUME instruction not found in code)r version_inforsrtruoffsetr^)rinsts rfirst_real_inst_idxrsQ '!$$T* ;;( ";;!# #+ = >>rc<\rSrSrSS.SSjjrSrg)rirrcgrr)rrrrrrs rrConvertFrameProtocol.__call__s!rrNr)rrrrrrrrrrrsL!!*! ! @ !! !!rc8\rSrSrSSjrSSjrSrg)CatchErrorsWrappericT[R"U5"U5 XlX lgr)r+r,r-r)rrrs rrCatchErrorsWrapper.__init__s!$')1& rc 8Uce[RUR5 [R"UR5n[ R S:a#UR[UR5:nO"UR[UR5:n[R(a [5nO [5nU(d?U(d8[R(d#U(a[URSS5(d[ R#[$R&5(a~U(aSnO4[R"UR5(aSnO U(aSnOSn[ R)SURR*UURR,5 [/5$URR,S :XaURR*S :XdDURR,R1S 5(a$URR*S :Xa [/5$[2R4R6R95S :Xa[:R<"5nU(a[> SSK J!n U "URDURRS9n [GURS5(dS5eURRIU RJ5n U "XURLU5sSSS5 $[> [O5 URXURLUSS9n U sSSS5 sSSS5 $!,(df  NP=f!,(df  O=fSSS5 g!,(df  g=f)N)r rFztraced frame alreadyz in skipfileszSnon-infra torch dispatch mode present, this is not supported today in torch.compilezdynamo tracing is disabledz#skipping: %s (reason: %s, file: %s)r__new__zcollections/__init__.py_make ddp_optimizerr) DDPOptimizer)bucket_bytes_capbackend_compile_fnrzJDDPOptimizer only supports callback fns that know how to clone themselves.r)r)(rrrQr.rrrf_lastirr*#inline_torch_dispatch_torch_compiler%r&disabler<r-rVrrrrWrrr`rrrrdget_optimize_ddp_moder"_get_active_ddp_module compile_lock"torch._dynamo.backends.distributedrrrMr compile_fnrr$) rrrr is_skipfilehas_started_executionshould_skip_for_dispatch_mode skip_reason ddp_modulerrhijacked_callbackrs rrCatchErrorsWrapper.__call__s &&& %!'' 5   w &$)MM4G 4U$U !$)MM5H5V$V !  5 5,L,N )@A * "~~- > > 5QQ ..("8K &&u||44"0K2"wK">K 9LL((LL,,  &' ' LL $ $ 2u||7K7Ky7X LL $ $ - -.G H H $$/&' ' ==   4 4 6/ I0GGIJ!O$0)3)D)D+/+I+I+c+c%M#668Me 66JJ)44& -DJJ #"\*1333DJJ !4F 43\\+"\*43\\\s1BM $ N /M1 N  M.1 M? ;N  N)r-rN)rrrrRrr)rrrrrrrr`)rrrrrrrrrrrrs8 [[*[@ [  [rrc[X5$r)r)rrs rcatch_errors_wrapperr s h ..r)rz6Optional[torch._subclasses.fake_tensor.FakeTensorMode]rrr)rrJrrJrzOptional[dict[str, str]]rrr)rrrrKrz list[str])r'Callable[_P, _T]rr)rrrr)NF) r_rrrrOptional[DynamoFrameType]r]rrr)rerrr)rrrrr) rr~rrr]rrrrrrr)rrrr)"rr$rrrrrrrrrr~rz'list[torch.overrides.TorchFunctionMode]rrrr^rrrrr]rrrr4Optional[dict[str, Union[int, FrameStateSizeEntry]]]rOptional[DistributedState]rrrrS)rr rz%tuple[FunctionType, Optional[object]])r'r rzinspect.Signature)rr rtuple[Any, ...]rr>rr) rr rrrr>rOptional[list[Constraint]]rrrr{)rrrrrrrr{)rrrr)rr$rrrrrrrrrr~rrrrMr]rrrrrrrrrrr#r<)&rrrrrrrrrrrr~rrr]rrrrrRrrrr7rrrrrrrrKrrrzOptional[ConvertFrameBox]rr`)rr~rrRrrrr)rrJrrr)rrrrRrr(r? __future__r collectionsrr}rbrsr+r3rSrrrrwrkrrrrz threadingrrTrVtyping unittest.mockrrrpathlibrrrrr r r r r rtyping_extensionsrrrtorch._loggingtorch._C._dynamo.guardsrtorch._dynamo.callbackrtorch._dynamo.distributedrtorch._dynamo.symbolic_convertrrrrrrrtorch._utils_internalrrrtorch.fx._lazy_graph_moduler%torch.fx.experimental.symbolic_shapesrrtorch.fx.graph_moduler r torch.monitorr!torch.nn.parallel.distributedr"torch.utils._ordered_setr#torch.utils._python_dispatchr$r%r&torch.utils._tracebackr'r(rr*r+r,r-r.backends.registryr/bytecode_analysisr0r1bytecode_transformationr2r3r4r5r6rr7r8r9r: eval_framer;r<r=r>r?r@rArBrCrDrErFrGrHrIrJrKrLrMgraph_bytecode_inputsrNrrOrPrQrrRrrSrTpgorUrVrW replay_recordrXresume_executionrYsymbolic_convertrZr[r\r]r^r_r`rarbrcrdrdrerfrgrhrirjrkrlrmrnrorprqrrrsrtrurvrwrxryvariables.torch_functionrzrnumpyr{ModuleNotFoundError TYPE_CHECKINGcollections.abcr|torch.utils.weakr}r~rrrepro.after_dynamorrrrvariables.builderr getLoggerrrVrgetArtifactLoggerrrRLockrrrrrrrrrr,rrr.#suppress_torch_distributed_warningsrYr`rCounterrarfrdrrrrrtorch.utils.hooksrrrr!r#rArHr0r{rrrrrrrrrrrrrProtocolrrrrrrrs,.#      !>>::'! 4249MM% ?Q&A/ MEE5G     > ? +;"XX0J  (4-'4@@6!~~//*E ..228^L  T]t_  %E% %(i y 3707 *+MQ %2J,DQh11K2Kb(, * *  * % *  *  * F  HV 00 0;.mmd%)(,     #  &   $-,7=(8%)HL48(,#O O O O O  O  O;OO$O$O$O O#OFO 2!O"&#O$%OOd 8 8  8 v ++ +" $333l KK K\     B/Ad7(,% % % %% %V(,$ /3-2 $ $ $  %$ , $ '+ $ $ N )) )/3-2 6 6,6'+ 6  6t>%)HL48(,j j j j j  j  jjj j#jFj2j&j !jt(,HLp"(,48+p p p p p  p  pp p#p p&p*p %pFp !p" #p$&%p*1+p,-pfH$H$\)-== =&= =?@? !6?? !aaH/"/+0//B BsUUU