Ei!( %SSKJrJr SSKrSSKrSSKrSSKJ r J r SSK J r SSK JrJrJr SSKJr 0q\\\ S \ \\\\444\S 'S S /rS rS\S\\\44SjrS\\\4S\4SjrS\S\S\S-4SjrS$S\S\S\4SjjrSr Sr!S\4Sjr"S\4Sjr#S%S\4Sjjr$\4S\S\ 4Sjjr%\4S\S\ 4S jjr&\"S!\%5 \"S"\&5 \"S#\"5 g!\ar\"S5\eSrCff=f)&)urlparse urlunparsezEurllib cannot be found, urlparse from python2 is no longer supported.N)CallableIterator) timedelta) FileStoreStoreTCPStore)default_pg_timeout._rendezvous_handlersregister_rendezvous_handler rendezvouscHU[;a[SUS35eU[U'g)a Register a new rendezvous handler. Before we can run collective algorithms, participating processes need to find each other and exchange information to be able to communicate. We call this process rendezvous. The outcome of the rendezvous process is a triplet containing a shared key/value store, the rank of the process, and the total number of participating processes. If none of the bundled rendezvous methods apply to your execution environment you can opt to register your own rendezvous handler. Pick a unique name and use the URL scheme to identify it when calling the `rendezvous()` function. Args: scheme (str): URL scheme to identify your rendezvous handler. handler (function): Handler that is invoked when the `rendezvous()` function is called with a URL that uses the corresponding scheme. It must be a generator function that yields the triplet. zRendezvous handler for z:// already registeredN)r RuntimeError)schemehandlers Y/home/mande/repo/quber/.venv/lib/python3.13/site-packages/torch/distributed/rendezvous.pyrrs.2%%4VH!_query_to_dict..<sP1OZZ__1Os&rr )filterr)rrs r_query_to_dictr"9sLQekk#>N1OP PD QaP  s; query_dictc[RS:Xa3URS[RRSS55S:H$URS[RRSS55S:H$)Nwin32 use_libuv USE_LIBUV01)sysplatformgetosenviron)r#s r_get_use_libuv_from_query_dictr/@s[ ||w~~k2::>>+s+KLPSSS >>+rzz~~k3'G HC OOrurlrankworld_size_optc [U5nUceSnURS:XaR[[RR SU55n[[RR SU55nOUnUS:wd US:wdUc[ UR5nSU;dSU;a[SUS35eUS:wa[U5US'US:wdUc[U5US'URS RUR5VVs/sH upxUS U3PM snn5S 9n[U5nUR[;a[S URS 35e[UR"U40UD6$s snnf)NenvRANK WORLD_SIZEr1 world_sizez The url: z7 has node-specific arguments(rank, world_size) already.r r)rzNo rendezvous handler for z://)rrintr-r.r,r"rAssertionErrorstr_replacejoinitemsrr r) r0r1r2kwargsresultr8r#kvs r_rendezvous_helperrCIso c]F ==E !rzz~~fd34DRZZ^^L*EFJ#  rzZ2%)?#FLL1 Z <:#= C5 WX  2:!$TJv   ~5'*:J| $XXj6F6F6HI6Hda!AaSz6HIJK!   }}007 cJKK  .s =f ==Js E9r8c :[U[[45(d[S[ U5SU35e[U[ R 5(d[SU35e[U[ R 5(d[SU35e[XU40UD6$)Nz`url` must be a string. z: z`rank` must be an integer. z!`world_size` must be an integer. ) isinstancer;bytesrtypenumbersIntegralrC)r0r1r8r?s rrrhs cC< ( (5d3i[3%HII dG,, - -8?@@ j'"2"2 3 3>zlKLL c >v >>rcN[[URUS55un nU$N)nextrC init_method)backend_optionsr1store_s r_create_store_from_optionsrQus')/*E*EtTRSKE1a Lrc[SU-5$)Nz+Error initializing torch.distributed using ) ValueErrormsgs r_rendezvous_errorrVzs CcI JJrc+# Sn[U5nURn[RS:Xa^SSKnUR UR-nUR RU5nU(a[RRU5nU(dU"S5e[UR5nSU;aU"S5eSU;aU"S5e[US5n[US5n [XI5n XU 4v [S 5e7f) Nc[SU-5$)Nzfile:// rendezvous: rVrTs r_error(_file_rendezvous_handler.._errors !7#!=>>rr%rz path missingr1rank parameter missingr8world size parameter missingz3Unable to perform rerendezvous using file:// method)rpathr*r+urllib.requestnetlocrequest url2pathnamer-normpathr"rr9rr) r0r?rZr@r^urllib full_pathr#r1r8rOs r_file_rendezvous_handlerrf~s?c]F ;;D ||wMMFKK/ ~~**95 77##D)D ^$$ -J Z-..:%344 z&! "DZ -.J d 'E  ## L MMsDDcZ[RRSS5[S5:H$)NTORCHELASTIC_USE_AGENT_STORET)r-r.r,r;rr_torchelastic_use_agent_storerjs! ::>>8$ ?3t9 LLrc SUs=::aS:dO [SUS35e[5(a [UUUSUS9$US:Hn[UUUUUSUS9$) aG Smartly creates a c10d Store object on ``rank`` based on whether we need to reuse agent store. The TCPStore server is assumed to be hosted on ``hostname:port``. By default, the TCPStore server uses the asynchronous implementation ``LibUVStoreDaemon`` which utilizes libuv. If ``torchelastic_use_agent_store()`` is ``True``, then it is assumed that the agent leader (node rank 0) hosts the TCPStore server (for which the endpoint is specified by the given ``hostname:port``). Hence ALL ranks will create and return a TCPStore client (e.g. ``start_daemon=False``). If ``torchelastic_use_agent_store()`` is ``False``, then rank 0 will host the TCPStore (with multi-tenancy) and it is assumed that rank 0's hostname and port are correctly passed via ``hostname`` and ``port``. All non-zero ranks will create and return a TCPStore client. riz-port must have value from 0 to 65535 but was .F) host_nameportr8 is_mastertimeoutT)rmrnr8rorp multi_tenantr&)rSrjr )hostnamernr1r8rpr& start_daemons r_create_c10d_storertsx.  u HaPQQ$&&!   qy !"  rrpc+# Sn[U5nURcU"S5e[UR5nSU;aU"S5eSU;aU"S5e[ US5n[ US5n[ U5nUR c [S5e[UR URXgX5n XU4v [S5e7f) Nc[SU-5$)Nztcp:// rendezvous: rYrTs rrZ'_tcp_rendezvous_handler.._error !6!<==rzport number missingr1r\r8r]zhostname cannot be Nonez3Unable to perform re-rendezvous using tcp:// method) rrnr"rr9r/rrr:rtr) r0rpr?rZr@r#r1r8r&rOs r_tcp_rendezvous_handlerrys>c]F {{*++ -J Z-..:%344 z&! "DZ -.J.z:I 677 d E  ## L MMsCC c+^ ^ # Sm U 4Sjm S[S[4U 4Sjjn[U5n[UR5nSU;a[ US5nO[ U"S55nSU;a[ US5nO[ U"S 55nU"S 5n[ U"S 55n [ U5n [ XXgX5n XU4v [S 5e7f) Nc[SU-5$)Nzenv:// rendezvous: rYrTs rrZ'_env_rendezvous_handler.._errorrxrc>T"SUS35$)Nzenvironment variable z expected, but not setri)varrZs r _env_error+_env_rendezvous_handler.._env_errors-cU2HIJJrenv_varrcf>[RRUS5nU(dT"U5eU$rK)r-r.r,)renv_valrs r_get_env_or_raise2_env_rendezvous_handler.._get_env_or_raises***..$/W% %Nrr1r6r8r7 MASTER_ADDR MASTER_PORTz3Unable to perform re-rendezvous using env:// method)r;rr"rr9r/rtr)r0rpr?rr@r#r1r8 master_addr master_portr&rOrrZs @@r_env_rendezvous_handlerrs>K33c]F -J:f%&$V,-z!L12 *<89 #M2K' 67K.z:I $G E  ## L MMsC Ctcpr5file)r4r4)T)' urllib.parserr ImportErrorerHr-r*collections.abcrrdatetimertorch.distributedrr r constantsr r dictr;tupler9__annotations____all__rr"boolr/rCrrQrVrfrjrtryrrirrrs 1  .88)TVd3huUC_7M.N)N OOPU (, 7+@#$sCx.PtCH~P$P>C>s>C$J>> ?C ?s ?S ? KN#N@MtM :>-  - b$6N N NB$6-N -N -N`E#:;E#:;F$<=A  O    sCC2$ C--C2