Eig+SSKrSSKrSSKrSSKJrJr SSKJr SSKJ r SSK J r SSK J r SSKJrJr SSKJrJrJr SS KJr \R."\5r\R4"S S 9"S S \55r"SS5r\R4"SS55rS\SSSS4SjrS\SS4Sjr\ \!\"\4r#"SS5r$g)N)ABCabstractmethod) defaultdict) Generator)contextmanager)chain)AnyOptional)AppendingByteSerializer BytesReader BytesWriter) OrderedSetT)frozenc\rSrSr%Sr\\S'\R"SS9r \ \S'\ S\ SSS S 4S j5r \ S \S \S S4Sj5r\ S\S \ 4Sj5r\SSj5r\ S \4Sj5rSrg ) CacheArtifactzG Data for each cache artifact that will be serialized and deserialized keyF)reprcontentwriterclsreturnNcpURUR5 URUR5 gN) write_strr write_bytesr)rrs R/home/mande/repo/quber/.venv/lib/python3.13/site-packages/torch/compiler/_cache.py serializeCacheArtifact.serializes&!3;;' artifact_typereadercnUR5nUR5n[RXU5$r)read_str read_bytesCacheArtifactFactorycreate)r!r"rrs r deserializeCacheArtifact.deserialize$s/oo##%#**=wGGr c^[U[5(d[S[U535eU$)NzExpected bytes, got ) isinstancebytesAssertionErrortype)rs rencodeCacheArtifact.encode*s+'5)) #7W !GH Hr cgrselfs rpopulate_cacheCacheArtifact.populate_cache0s r c[S5e)z Returns the type of the artifact. Must be unique across all CacheArtifact classes. CacheArtifactFactory.register will add property method to CacheInfo based on this (def {type}_artifacts) that returns all artifacts for specific cache. z9CacheArtifact is an abstract class, please use a subclass) RuntimeErrorr2r rr.CacheArtifact.type4sVWWr r2rN)__name__ __module__ __qualname____firstlineno____doc__str__annotations__ dataclassesfieldrr, staticmethodr rr r(r r/rr5r.__static_attributes__r2r rrrs H &&E2GU2(+(O(((H3H HHH    X#XXr rc \rSrSr%Sr0r\\\\ 4\ S'\ S\\ S\\ 4Sj5r \ S\S\\ 4Sj5r \ S\S \S \S\ 4S j5r\ S\S \S \S\ 4S j5rS rg)r&?z@ Factory for creating CacheArtifact objects based on their type _artifact_types artifact_clsrc^UR5mUR5UR;a[STS35eXRT'[[TS3[ U4Sj55 U$)NArtifact of type=z2 already registered in mega-cache artifact factory _artifactsc">URT$r artifacts)r4artifact_type_keys r/CacheArtifactFactory.register..Qs$..1B"Cr )r.rHr-setattr CacheInfoproperty)rrIrPs @rregisterCacheArtifactFactory.registerFs}(--/    #"5"5 5 #$5#66hi 2>-.  ! , C D r rPc\XR;a[SUS35eURU$)NrKz. not registered in mega-cache artifact factory)rHr-)rrPs r_get_artifact_type'CacheArtifactFactory._get_artifact_typeUs> $7$7 7 #$5#66de ""#455r rrc4URU5nU"X#5$r)rYrrPrrrIs rr'CacheArtifactFactory.create]s--.?@ C))r cRURU5nU"X$RU55$r)rYr/r\s r encode_create"CacheArtifactFactory.encode_createcs+--.?@ C!4!4W!=>>r r2N)r;r<r=r>r?rHdictr@r.rrA classmethodrVrYr,r'r r_rEr2r rr&r&?s79OT#tM2238 D$7 Dts D 1r )default_factoryrOrcgrr2r3s rinductor_artifactsCacheInfo.inductor_artifactsx r cgrr2r3s rautotune_artifactsCacheInfo.autotune_artifacts|rlr cgrr2r3s raot_autograd_artifacts CacheInfo.aot_autograd_artifactsrlr cgrr2r3s r pgo_artifactsCacheInfo.pgo_artifactsrlr cgrr2r3s rprecompile_artifactsCacheInfo.precompile_artifactsrlr artifactNcpURUR5RUR5 gr)rOr.appendr)r4rys radd CacheInfo.adds# x}}'..x||>!!r r2r:)r;r<r=r>r?rBrCrOrr@rfrArUrjrnrqrtrwrr|rboolrrEr2r rrTrTls .9->->1.I{3S >*  DI   DI   S    tCy   d3i  =M=d="t"r rTrrztuple[str, list[CacheArtifact]]rcURUS5 UR[US55 USHn[R X5 M g)Nr)r write_uint64lenrr)rrrys r_serialize_single_cachersH SV CF $F1r r"c/nUR5nUR5n[U5H'nUR[R X 55 M) X!4$r)r$ read_uint64ranger{rr()r"rOrP num_artifacts_s r_deserialize_single_cachersXI)&&(M = !223DMN"  ''r c \rSrSr%Sr\"\5r\\ S'\ "5r \ \ \ S'\ "\S9r\ \\\\ 4\ S'\"5r\\ S'\SS j5r\\S\S 4S j55r\S \S\S\SS 4Sj5r\S\4Sj5r\S\\\\44Sj5r\ S\S\\4Sj5r!\ S\S\4Sj5r"\SSj5r#Sr$g )CacheArtifactManagera! Lightweight manager class for collecting and processing cache artifacts for hot loading Intended Lifecycle: - Execute code via torch.compile, this will call CacheArtifactManager.record_artifact on each cache artifact - Call CacheArtifactManager.serialize to convert all the cache artifacts to portable format - Call CacheArtifactManager.deserialize to hot load the cache artifacts on a potentially different process NOTE: There's no FB/FC guarantees, results of cache artifacts will not be used unless code version matches. _new_cache_artifacts_seen_artifacts serialize_fn _serializer _cache_inforNcURR5 URR5 URR5 URR5 gr)rrrrrrs rrCacheArtifactManager.clearsF   &&( !!#  r )NNNc## URnURnURnURn[ [ 5Ul[ 5Ul[[S9UlURR5UlSv XlX lX0lX@lg!XlX lX0lX@lf=f7f)Nr) rrrrrrfrr r __class__)roriginal_new_cache_artifactsoriginal_seen_artifactsoriginal_serializeroriginal_cache_infos rwith_fresh_cache%CacheArtifactManager.with_fresh_caches(+'?'?$"%"5"5!oo!oo#.t#4 (l1?VW//335 2 'C $"9 1O1O(D $"9 1O1OsBCB% C%B??Cr!rrc[RXU5nX@R;ag[R S[ U55 UR URU5 URRU5 g)zO Called from each caching operation to record the artifact in this "mega" list Nz Recording %s) r&r_rlogdebugr@rr{r|)rr!rrrys rrecord_artifact$CacheArtifactManager.record_artifactsd(55m'R ** *  .#h-0   /66x@ )r c2[UR5S:g$)z7 Have we seen new artifacts since last serialize call? r)rrrs rneed_serialize#CacheArtifactManager.need_serializes 3++,11r cP[URR56H4n[R SU5 UR R U5 M6 UR R5(ag[R"UR 5nURRURR55 URR5nURR5 X24$![a [R!SSS9 gf=f)z/ Converts the "mega" list into portable format z saving: %sNz Failed to pickle cache artifactsTexc_info)rrvaluesrrrr|rcopydeepcopyrextenditemsto_bytesr Exceptionwarning)rryinfoartifact_bytess rrCacheArtifactManager.serializes s77>>@AH IIlH - OO   )B ?? " " K==1D OO " "3#;#;#A#A#C D __557N  $ $ * * ,!' ' K KK:TK J Ks:B DD%$D%serialized_artifactsc[R5 [[R"U[ S95nU$![ a [RSSS9 gf=f)z7 Converts the portable format back into CacheArtifacts )deserialize_fnz#Failed to un-pickle cache artifactsTrN) r"_ensure_cache_artifacts_registeredrar to_listrrrr)rrOs rr( CacheArtifactManager.deserializes^  C C E'//(#<I   KK=K M s6:AArOc[5n[UR56H:n[R SU5 UR U5 UR 5 M< U$)Nz writing: %s)rTrrrrr|r5)rOrrys rpopulate_caches$CacheArtifactManager.populate_caches-sN{y//12H IImX . HHX   # # %3  r c@SSKJn SSKJn SSKJn SSKJn SSKJ n g)zWhen deserializing caches in fresh process, we need to ensure that all cache artifacts are registered in the cache registry. This is done by simply importing all the cache artifacts already wrapped with register call. r)PrecompileCacheArtifact)PGOCacheArtifact)AOTAutogradCacheArtifact)InductorCacheArtifact)AutotuneCacheArtifactN) torch._dynamo.packagertorch._dynamo.pgor-torch._functorch._aot_autograd.autograd_cachertorch._inductor.codecacher&torch._inductor.runtime.autotune_cacher)rrrrrrs rr7CacheArtifactManager._ensure_cache_artifacts_registered7s B6  D r r2r:)%r;r<r=r>r?rrfrCacheArtifactsResultrArrrr rrtupler@rTrrbrrrrr rrrr r,rrDr(rrrEr2r rrrs"2=T1B.B2<OZ .= -DE(sD4G/G)HI'[K(  2+;!<22$*** *  **"2t22 (5 )9#:;2%H=Q4R$#7I    r r)%rrBloggingabcrr collectionsrcollections.abcr contextlibr itertoolsrtypingr r &torch.utils._appending_byte_serializerr r r torch.utils._ordered_setr getLoggerr;r dataclassrr&rTrrrar@rfrrr2r rrs ##%%  0! d#%XC%X$%XP*?*?Z &"&"&"R2 2?2 2 (  (& (Cm!445W W r