!EiJ %SrSSKrSSKrSSKJr SSKJr SSKrSSKJr SSK J r J r SSK J r SSKJr S S KJr \R$r\R&rS r\\R,R.S 4\S 'Sq/q\\\/S4\\4\S'\R:"5r\R>"5r \ "5q!\""\R,S5(a\R,RFr$O S\%S\%4Sjr$\""\R,S5(a\R,RLr'O S\%S\%4Sjr'Sr(Sr)Sr*S\+4Sjr,SFSjr-"SS\.5r/S\+4Sjr0S\+4Sjr1SGS\SS4Sjjr2S\%4S jr3S\%4S!jr4SGS\S\4S"jjr5SGS\S\4S#jjr6SHS$\S-S%\S&\%SS4S'jjr7S\8\\44S(jr9S)\\%\%\%\%/S4SS4S*jr:SIS+\+4S,jjr;SGS\S\\%\%44S-jjrS\SS4S1jr?SGS\S\8\\44S2jjr@"S3S5rA"S4S55rBS6rCS/\S-S\B4S7jrDSJS\S\4S8jjrES\\4S9jrFSJS:\S\SS4S;jjrGS<\\SS4S=jrHS>\%SS4S?jrIS>\%SS4S@jrJS\%4SAjrKS\%4SBjrLS\%4SCjrMS SDKN7 S SDKO7 /SEQrPg)KzH This package enables an interface for accessing MTIA backend in python N)Callable)Any)Tensor) is_fbcodeis_prod)_LazySeedTracker)Device)_get_device_index.default_generatorsF _queued_calls_mtia_exchangeDevicedevicereturnc&US:ag[S5eNrz)PyTorch was compiled without MTIA support RuntimeErrorrs P/home/mande/repo/quber/.venv/lib/python3.13/site-packages/torch/mtia/__init__.py_exchange_devicer) A:FGG_mtia_maybeExchangeDevicec&US:ag[S5errrs r_maybe_exchange_devicer3rrc[5 gN) _lazy_initr rrinitr"9sLrc:[=(a [5(+$)z9Return whether PyTorch's MTIA state has been initialized.) _initialized_is_in_bad_forkr rris_initializedr&=s  1 111rc [ [5(aU"5sSSS5 $URSS5(a*[R U[ R "55 OkURSS5(a*[RU[ R "55 O*[RU[ R "545 SSS5 g!,(df  g=f)Nseed_allFseed) _initialization_lockr&get_lazy_seed_trackerqueue_seed_all traceback format_stack queue_seedrappend)callablekwargss r _lazy_callr4Bs    :   zz*e,,"11(I[RR5$r )torch_C_mtia_isInBadForkr rrr%r%Ps 88 % % ''rc Z[5(d[[S5(ag[ [5(a SSS5 g[ 5(a [ S5e[ 5(d [S5e[5(a&[5(aSSK J n UR5 [RR!5 S[l[$R'S[(R+555 [$H upU"5 M [5[S5 SqSSS5 g![a Nf=f![,a1nS[/U5S S R1U53n[3U5UeSnAff=f![5[S5 f=f!,(df  g=f) Nis_initializingzwCannot re-initialize MTIA in forked subprocess. To use MTIA with multiprocessing, you must use the 'spawn' start methodzTorch not compiled with MTIA enabled. Ensure you have `import mtia.host_runtime.torch_mtia.dynamic_library` in your python src file and include `//mtia/host_runtime/torch_mtia:torch_mtia` as your target dependency!r)cxx_resource_managerTc36# UHo(dM Uv M g7fr r ).0callss r _lazy_init..sX0NuRWUU0Ns  z6MTIA call failed lazily at initialization with error: z( MTIA call was originally invoked at: )r&hasattr_tlsr*r%r _is_compiledAssertionErrorrrlibfb.py.cxx_resourcesr;installModuleNotFoundErrorr6r7 _mtia_initr:rextendr, get_calls ExceptionstrjoinDeferredMtiaCallErrordelattrr$)r; queued_callorig_tracebackemsgs rr!r!Ts}74):;;          I ~~ *  ;;799 G$,,.  $X0B0L0L0NXX -/<+ <M0= D+ , o  >'   !<PQTUVQWPXYCCE77>CZB[]04!; < D+ ,m  ssFAFD9/AF FE FF9 EFEF F,E??FFFF F*c\rSrSrSrg)rOr N)__name__ __module__ __qualname____firstlineno____static_attributes__r rrrOrOsrrOc>[RR5$)z*Return true if compiled with MTIA support.)r6r7 _mtia_isBuiltr rrrDrDs 88 ! ! ##rc<[5(dg[5S:$)z'Return true if MTIA device is availableFr)rD device_countr rr is_availabler`s >> >A rc[RRU5 [RR 5sSSS5 $!,(df  g=f)z?Waits for all jobs in all streams on a MTIA device to complete.N)r6mtiarr7_mtia_deviceSynchronizers r synchronizerds0   6 "xx//1 # " "s A Ac>[RR5$)z,Return the number of MTIA devices available.)r6r7_mtia_getDeviceCountr rrr_r_ 88 ( ( **rc>[RR5$)z0Return the index of a currently selected device.)r6r7%_accelerator_hooks_get_current_devicer rrcurrent_devicerjs 88 9 9 ;;rcP[RR[USS95$)a;Return the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the currently selected :class:`Stream` for the current device, given by :func:`~torch.mtia.current_device`, if :attr:`device` is ``None`` (default). Toptional)r6r7_mtia_getCurrentStreamr rs rcurrent_streamro! 88 * *+[RR5$)z4Return a dictionary of MTIA memory allocator history)r6r7_mtia_memorySnapshotr rrsnapshotr|rgrobservercB[RRU5 g)z9Attach an out-of-memory observer to MTIA memory allocatorN)r6r7_mtia_attachOutOfMemoryObserver)r}s rattach_out_of_memory_observerrs HH,,X6rincluding_emulationcg)zLReturn a bool indicating if the current MTIA device supports dtype bfloat16.Tr )rs ris_bf16_supportedrs rcP[RR[USS95$)aReturn capability of a given device as a tuple of (major version, minor version). Args: device (torch.device or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). Trl)r6r7_mtia_getDeviceCapabilityr rs rget_device_capabilityr" 88 - -.?QU.V WWrc>[RR5$)zEmpty the MTIA device cache.)r6r7_mtia_emptyCacher rr empty_cachers 88 $ $ &&rstreamcJUcg[RRU5 g)aSet the current stream. This is a wrapper API to set the stream. Usage of this function is discouraged in favor of the ``stream`` context manager. Args: stream (Stream): selected stream. This function is a no-op if this argument is ``None``. N)r6r7_mtia_setCurrentStreamrs r set_streamrs~ HH##F+rcf[U5nUS:a [RRU5 gg)zSet the current device. Args: device (torch.device or int): selected device. This function is a no-op if this argument is negative. rN)r r6r7%_accelerator_hooks_set_current_devicers r set_devicers,v &F { 66v>rcP[RR[USS95$)zReturn a dictionary of MTIA device properties Args: device (torch.device or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). Trl)r6r7_mtia_getDevicePropertiesr rs rget_device_propertiesrrrcB\rSrSrSrS\4SjrSrS\S\S\4SjrS r g ) ri&zContext-manager that changes the selected device. Args: device (torch.device or int): device index to select. It's a no-op if this argument is a negative integer or ``None``. c0[USS9UlSUlg)NTrlr)r idxprev_idx)selfrs r__init__device.__init__.s$Vd; rc`[RRUR5Ulgr )r6r7(_accelerator_hooks_maybe_exchange_devicerr)rs r __enter__device.__enter__2sII$((S rtypevaluer.c`[RRUR5Ulg)NF)r6r7rrr)rrrr.s r__exit__device.__exit__5s88DDT]]Sr)rrN) rWrXrYrZ__doc__rrrrr[r rrrr&s3sTSrcZ\rSrSr%Sr\S-\S'S\S-4SjrSrS\ S \ S \ 4S jr S r g) StreamContexti:aContext-manager that selects a given stream. All MTIA kernels queued within its context will be enqueued on a selected stream. Args: Stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: Streams are per-device. N cur_streamrcSUlXl[SS5Ul[R R 5(dURcSUl[R R 5(dSO[RRS5Ul [R R 5(dSUl g[RRS5Ul g)NTr) rrr rr6jit is_scriptingrbrssrc_prev_streamdst_prev_stream)rrs rrStreamContext.__init__Hs $T40yy%%''xx ..00Dejj6O6OPT6U  ..00D 6;jj6O6OPT6U rcURnUbURS:Xag[RR S5UlUR R UR :waL[ UR 5 [RR UR 5UlSSS5 [RRU5 g!,(df  N.=fNr) rrr6rbrorrrr)rrs rrStreamContext.__enter__Ws[[  R $zz88>    & &**;*; ; ))*',zz'@'@ARAR'S$+ j)+*s >/C C#rrr.c0URnUbURS:XagURRUR:wa)[R R UR5 [R R UR5 gr)rrrrr6rbrr)rrrr.rs rrStreamContext.__exit__fsj[[  R     & &**;*; ; JJ ! !$"6"6 7 d223r)rrrrr) rWrXrYrZrStream__annotations__rrrrr[r rrrr:sB    v}   * 4S 4 4 4rrcD[RRXU5 g)zset stream specified by the stream id, device index and device type Args: stream_id (int): stream id in stream pool device_index (int): device index in topo device_type (int): enum device type N)r6r7_mtia_setStream) stream_id device_index device_types r_set_stream_by_idrts HHYkBrc[U5$)aWrap around the Context-manager StreamContext that selects a given stream. Arguments: stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: In eager mode stream is of type Stream class while in JIT it doesn't support torch.mtia.stream )rrs rrrs   rcv[5 [USS9nUc [5n[UnUR 5$)aCReturns the random number generator state of the specified MTIA device as a ByteTensor. Args: device (torch.device or int, optional): The device to return the RNG state of. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). .. warning:: This function eagerly initializes MTIA. Trl)r!r rjr get_state)rrdefault_generators r get_rng_staters<L FT 2C {*3/  & & ((rch[[55Vs/sHn[U5PM nnU$s snf)zRReturns a list of ByteTensor representing the random number states of all devices.)ranger_r)iresultss rget_rng_state_allrs/).|~)>?)>A}Q)>G? N@s/ new_statec"^^[5(dD[RR5 TR [R S9mSSS5 [ USS9mTc [5mUU4Sjn[U5 g!,(df  N8=f)a$Sets the random number generator state of the specified MTIA device. Args: new_state (torch.ByteTensor): The desired state device (torch.device or int, optional): The device to set the RNG state. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). ) memory_formatNTrlc:>[TnURT5 gr )r set_state)rrrs rcbset_rng_state..cbs.s3##I.r) r&r6r7_DisableFuncTorchclonecontiguous_formatr rjr4)rrrrs` @r set_rng_statersm    XX ' ' )"e6M6MNI* FT 2C {/rN* )s B B new_statescB[U5Hup[X!5 M g)zSets the random number generator state of all devices. Args: new_states (Iterable of torch.ByteTensor): The desired state for each device. N) enumerater)rrstates rset_rng_state_allrs j)e*rr)c<^[T5mU4Sjn[USS9 g)auSets the seed for generating random numbers for the current MTIA device. It's safe to call this function if MTIA is not available; in that case, it is silently ignored. Args: seed (int): The desired seed. .. warning:: If you are working with a multi-GPU model, this function is insufficient to get determinism. To seed all GPUs, use :func:`manual_seed_all`. cN>[5n[UnURT5 gr )rjr manual_seed)rrr)s rrmanual_seed..cbs$.s3%%d+rTr)Nintr4r)rs` rrrs t9D, rrc<^[T5mU4Sjn[USS9 g)zSets the seed for generating random numbers on all MTIA devices. It's safe to call this function if MTIA is not available; in that case, it is silently ignored. Args: seed (int): The desired seed. cn>[[55Hn[UnURT5 M gr )rr_r r)rrr)s rrmanual_seed_all..cbs-|~&A 21 5   ) )$ /'rTr(Nrrs` rmanual_seed_allrs t9D0 rD!rcSn[USS9$)adSets the seed for generating random numbers to a random number for the current MTIA device. It's safe to call this function if MTIA is not available; in that case, it is silently ignored. .. warning:: If you are working with a multi-GPU model, this function will only initialize the seed on one GPU. To initialize all GPUs, use :func:`seed_all`. cH[5n[UnUR5$r )rjr r))rrs rrseed..cbs$.s3 %%''rTrr4rs rr)r)s( bt $$rcSn[USS9$)zSets the seed for generating random numbers to a random number on all MTIA devices. It's safe to call this function if MTIA is not available; in that case, it is silently ignored. cSnSn[[55H8n[UnU(dUR5nSnM'UR U5 M: U$)NrFT)rr_r r)r) random_seedseededrrs rrseed_all..cbsT |~&A 21 5 /446 !--k: 'rTrrrs rr(r(s  b4 ((rcX[5 [5n[UR5$)zvReturns the current random seed of the current MTIA device. .. warning:: This function eagerly initializes MTIA. )r!rjr initial_seed)rs rrrs% L  C c " / / 11r)*)#r"r`r&rdr_rjrors memory_statsmax_memory_allocatedmemory_allocatedreset_peak_memory_statsrrryr|rrrrrrrrrrrrr)r(rr MTIAGraphgraphgraph_pool_handle)rNr )allpythonr)T)rb)Qr threadingr.collections.abcrtypingrr6rtorch._environmentrr torch._utilsr torch.typesr _utilsr Eventrr tupler7 Generatorrr$rlistrMlocalrCLockr*r,rBrrrrrr"r&r4boolr%r!rLrOrDr`rdr_rjrorsrydictr|rrrrrrrrrrrrrrrrrr)r(rmemory mtia_graph__all__r rrr s$ 1)%   68E%((,,c127 t (2t8 d3i '( ~~'%' 588+,,xx44HHH  588011"XX??HsHsH 2 K((;| I $d$ d22$2 +c+ << U6 UV U U6 UV UMNE 4ZE),EFIE E&+$sCx.+ 7S#s+T127 74 X&XE#s(OX' ,v , ?v ?$ ?X&XDcNX(7474tC!6D=!]!)&)f)$4< VV2 $v, 4 cd*"#"$""%c%")#)*2c2$ r