pyiI`SrSSKrSSKJr SSKJr \"S5rS\\S\S\\\4S jrg) z9Contains a utility to iterate by chunks over an iterator.N)Iterable)TypeVarTiterable chunk_sizereturnc# # [U[5(aUS::a [S5e[U5n[ U5n[ R"U4[ R"X!S- 55v M?![ a gf=f7f)aIterates over an iterator chunk by chunk. Taken from https://stackoverflow.com/a/8998040. See also https://github.com/huggingface/huggingface_hub/pull/920#discussion_r938793088. Args: iterable (`Iterable`): The iterable on which we want to iterate. chunk_size (`int`): Size of the chunks. Must be a strictly positive integer (e.g. >0). Example: ```python >>> from huggingface_hub.utils import chunk_iterable >>> for items in chunk_iterable(range(17), chunk_size=8): ... print(items) # [0, 1, 2, 3, 4, 5, 6, 7] # [8, 9, 10, 11, 12, 13, 14, 15] # [16] # smaller last chunk ``` Raises: [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If `chunk_size` <= 0. > [!WARNING] > The last chunk can be smaller than `chunk_size`. rz6`chunk_size` must be a strictly positive integer (>0).N) isinstanceint ValueErroriternext StopIteration itertoolschainislice)rriterator next_items _/home/mande/repo/quber/.venv/lib/python3.13/site-packages/huggingface_hub/utils/_chunk_utils.pychunk_iterablers}> j# & &*/QRRH~H  XIooylI,<,BBB) __doc__rcollections.abcrtypingrrr rrrsK@$ CL(XXa[(Xc(XhxPQ{>S(Xr