"Ei xSSKrSSKrSSKJr SSKJr SSKrSSKJrJ r SSK J r J r J r /SQrS\ S\\ 4S jrS\ S \\S\\ 4S jrS \ S\4S jr\ R,4S \ S\S\S\ 4SjjrS \ S\4SjrSS \ S\S-S\ 4Sjjr\"S\S9S \ S\S\ 4Sj5rS \ S\4SjrS \ S\R:S\ 4Sjrg)N)Any) deprecated)_ShardingIterDataPipeSHARDING_PRIORITIES)DataPipe DataPipeGraph traverse_dps)apply_random_seedapply_shardingapply_shuffle_seedapply_shuffle_settingsget_all_graph_pipesgraphreturnc*[U[55$N)_get_all_graph_pipes_helperset)rs \/home/mande/repo/quber/.venv/lib/python3.13/site-packages/torch/utils/data/graph_settings.pyrrs &uce 44id_cachec/nUR5HKunupEX1;aMURU5 URU5 UR[ XQ55 MM U$r)itemsaddappendextendr)rrresultsdp_iddatapipe sub_graphs rrrs[!G(- $$    Ux 29GH )6 Nrrc[U[5=(d3 [US5=(a [R"UR 5$)Nr ) isinstancerhasattrinspectismethodr rs r_is_sharding_datapiper')s; h 5 6 *+ 6   X44 5rnum_of_instances instance_idcN^^^^[U5nSSUUUU4SjjjmT"U5 U$)z Apply dynamic sharding over the ``sharding_filter`` DataPipe that has a method ``apply_sharding``. RuntimeError will be raised when multiple ``sharding_filter`` are presented in the same branch. c\>UR5Hup#Sn[U5(asUb[SUSU35e[R"UR 5n[ UR5S:aUR TT5 OUR TTT S9 UnUcUnT"X45 M g)NzoSharding twice on a single pipeline is likely unintended and will cause data loss. Sharding already applied to z while trying to apply to )sharding_group)valuesr' RuntimeErrorr$ signaturer len parameters) r prev_applieddpr appliedsig_helperr)r(r-s rr7apply_sharding.._helper=s"\\^MBG$R((+&77CnD^_a^bd ''(9(9:s~~&*%%&6 D%%(+n&& I '',rr)rN)r )rr(r)r-rr7s ``` @rr r 0s'  "E((, EN Orc[US5=(aZ [US5=(aG [R"UR5=(a [R"UR5$)N set_shuffleset_seed)r#r$r%r:r;r&s r_is_shuffle_datapiper<XsT-( 0 Hj ) 0   X11 2 0   X.. / rshufflec.UcU$[U5n[U5nUVs/sHn[U5(dMUPM nnU(d/U(a([R"SSS9 UR 5nU/nUHnUR U5 M U$s snf)a) Traverse the graph of ``DataPipes`` to find and set shuffle attribute. Apply the method to each `DataPipe` that has APIs of ``set_shuffle`` and ``set_seed``. Args: datapipe: DataPipe that needs to set shuffle attribute shuffle: Shuffle option (default: ``None`` and no-op to the graph) z`shuffle=True` was set, but the datapipe does not contain a `Shuffler`. Adding one at the end. Be aware that the default buffer size might not be sufficient for your task.) stacklevel)r rr<warningswarnr=r:)rr=r all_pipespipe shufflersshufflers rr r as  "E#E*I"+J)$/CD/I)IJ   [ ##%  W% OKs BBz`apply_shuffle_seed` is deprecated since 1.12 and will be removed in the future releases. Please use `apply_random_seed` instead.)categoryrngc[X5$r)r )rrHs rr r s X ++rch[US5=(a [R"UR5$)Nr;)r#r$r%r;r&s r_is_random_datapiperKs% 8Z ( PW-=-=h>O>O-PPrc[U5n[U5n[5n/nUHQn[U5U;aM[ U5(dM&UR U5 UR [U55 MS UH[n[[R"S[RS9RUS9R55nURU5 M] U$)a Traverse the graph of ``DataPipes`` to find random ``DataPipe`` with an API of ``set_seed``. Then set the random seed based on the provided RNG to those ``DataPipe``. Args: datapipe: DataPipe that needs to set randomness rng: Random number generator to generate random seeds )dtype) generator)r rridrKrrinttorchemptyint64random_itemr;)rrHrrCcacherandom_datapipesrD random_seeds rr r s  "E#E*I EE d8u   t $ $  # #D ) IIbh  ! KK%++ . 6 6 6 E J J L  k" ! Orr)r$rAtypingrtyping_extensionsrrR(torch.utils.data.datapipes.iter.shardingrrtorch.utils.data.graphrrr __all__listrrrQrboolr'DEFAULTr r<r FutureWarningr rK Generatorr rMrrrdsI( IH 5}5h5   $'H  (^ H'.. %%%%  %P8Xt xD .  ,,,,  ,Q(QtQu8r