qyicSSKrSSKrSSKrSSKrSSKJr SSKJr SSKJ r SSK J r SSK J r SSKJ r SSKJrJrJrJrJrJrJr SS KJr S S KJr S S KJrJrJr \R<"\5r \"5(a%SSK!r!SSK"r!SSK#r!SSK$r!SSK%r!SSK&r!SS K#J'r' SSK(J)r) OSr!\"5(aSSK*J+r+ \,\-\.\4r/\0\1\.\2\\3"S5S4r4\Rj"S\Rl5r7\Rj"S\Rl5r8\Rj"S\Rl\Rr-5r:\Rj"S\Rl5r;"SS\<5r="SS\<5r>S\3S\-\.\.44Sjr?S\.S\-4Sjr@S\S\-4SjrAS \.S\B\.S-\-S-\.S-44S!jrCS\S\-4S"jrD\ \S#\.S-S\E\.4S$j55rFS%rG\ S&5rH\S'5rIS2S(\,\/S)\,\-\-S-S*\/S-S#\.S-S+\2S,\2S-\2S\.4S.jjrJS/rK"S0S15rLg)3N)Callable)contextmanager)deepcopy)datetime) lru_cache) isfunction)AnyLiteralUnionget_args get_originget_type_hints no_type_check)version)logging)is_jinja_availableis_torch_availableis_vision_available) Extension)ImmutableSandboxedEnvironment)Image.z(^(.*?)[\n\s]*(Args:|Returns:|Raises:|\Z)z0\n\s*Args:\n\s*(.*?)[\n\s]*(Returns:|Raises:|\Z)a1 (?:^|\n) # Match the start of the args block, or a newline \s*(\w+):\s* # Capture the argument name and strip spacing (.*?)\s* # Capture the argument description, which can span multiple lines, and strip trailing spacing (?=\n\s*\w+:|\Z) # Stop when you hit the next argument or the end of the block z*\n\s*Returns:\n\s*(.*?)[\n\s]*(Raises:|\Z)c\rSrSrSrSrg)TypeHintParsingExceptionHzJException raised for errors in parsing type hints to generate JSON schemasN__name__ __module__ __qualname____firstlineno____doc____static_attributes__rc/home/mande/repo/quber/.venv/lib/python3.13/site-packages/transformers/utils/chat_template_utils.pyrrHTr$rc\rSrSrSrSrg)DocstringParsingExceptionLzJException raised for errors in parsing docstrings to generate JSON schemasrNrrr$r%r(r(Lr&r$r( param_typereturnc [SS0[SS0[SS0[SS0[ S5SS0[ 00n[ 5(a SS0U['[5(aSSK nSS 0XR'URUSS 05$) Ntypeintegernumberstringbooleannullimageraudioobject) intfloatstrboolr-r rrrtorchTensorget)r* type_mappingr:s r%_get_json_schema_typer>Ps fi  ! fh  vy! T VV$ R L%w/ U&,g%6 \\"   J(: ;;r$hintc~[U5n[U5nUc [U5$U[ Ld([ [S5(aU[RLaUVs/sHo3[S5LdM[U5PM nn[U5S:XaUSnO<[SU55(a!S[UVs/sHofSPM sn50nOSU0n[S5U;aSUS 'U$U[La[U5S:a[[ ["[$[S54n/nUH]n [U 5U;a [ S 5e[[U 55R'S5n U cMEX;dMLUR)U 5 M_ [U5S:XaUR+5O [-U5[-U5S .$U[,LaU(dSS 0$S [US5S .$U[.LarU(dSS 0$[U5S:Xa([ S[#U5R1SS5S35eSU;a [ S5eS UVs/sHn[U5PM snS.$U[2La&SS0n [U5S:Xa[US5U S'U $[ SU5e![a [ SU5ef=fs snfs snfs snf)NzGCouldn't parse this type hint, likely due to a custom class or object: UnionTyperrc3`# UH$nSU;=(a [US[5v M& g7f)r-N) isinstancer8).0subtypes r% #_parse_type_hint..ts*`W_G7"Gz'&/3'GGW_s,.r-anyOfTnullablez?Only the valid python literals can be listed in typing.Literal.)r-enumarray)r-itemszThe type hint ztyping.a1 is a Tuple with a single element, which we do not automatically convert to JSON schema as it is rarely necessary. If this input can contain more than one element, we recommend using a list[] type instead, or if it really is a single element, remove the tuple[] wrapper and just pass the element directly..znConversion of '...' is not supported in Tuple type hints. Use list[] types for variable-length inputs instead.)r- prefixItemsr5additionalProperties)r r r>KeyErrorrr hasattrtypesrAr-_parse_type_hintlenallsortedr r6r7r8r9r<appendpoplisttuplereplacedict) r?originargstsubtypes return_dictrE LITERAL_TYPES args_typesargarg_typeouts r%rTrTbs  F D>D ~ (. . 5WUK88Vu=V15MA$t*9L'$Q'M x=A "1+K `W_` ` `!6(*S(w6?(*S#TUK#H-K : &*K # 7 s4y1}eS$T ;  CCy -./pqq,T#Y7;;FCH#(B!!(+ ),J1(tAw.GH H 5G$ $ t9>* T!2!29b!A BC--  $;*#   d0Sd1A!1Dd0STT 4x  t9>*:47*CC& ' "#lnr ssK *Y[_  N +T\1Ts# JJ00J07J5 J:J-funcc[U5n[R"U5n[USS5n[ [ UR 5S5nUS;a8UR UR[RR:XaUnOSn/nUR R5HupxXu:XaM UR[RR:Xa[SURSU35eUR[RR:XdMyURU5 M 0n UR5HupzXu:XaM [U 5X'M SU S.n U(aXkS'U $) Nr operation>clsselfz Argument z$ is missing a type hint in function r5)r- propertiesrequired)rinspect signaturegetattrnextiter parameters annotation ParameteremptyrLrnamedefaultrXrT) rh type_hintsrp func_namefirst_param_nameimplicit_arg_namern param_nameparamrmr*schemas r%"_convert_type_hints_to_json_schemarsT%J!!$'Ij+6ID!5!56=O+  !1 2 = =ARARAXAX X, H&11779  *    w0066 6*YuzzlBfgpfq+rs s ==G--33 3 OOJ ' :J","2"2"4  * !1*!= #5 j 9F%z Mr$ docstringc [RU5n[RU5n[RU5nU(aUR S5R 5OSnU(aUR S5R 5OSnU(aUR S5R 5OSnUbSR URS5Vs/sHowR 5(dMUPM sn5n[RU5nUV s0sH/oS[R"SSU SR 55_M1 n n O0n XJU4$s snfs sn f)z Parses a Google-style docstring to extract the function description, argument descriptions, and return description. Args: docstring (str): The docstring to parse. Returns: The function description, arguments, and return description. rN rz \s*\n+\s* ) description_researchargs_re returns_regroupstripjoinsplit args_split_refindallresub) rdescription_match args_match returns_match descriptiondocstring_argsreturnslinematchesmatch args_dicts r%parse_google_format_docstringrs)'--i8 *J%%i0M9J#))!,224tK4>Z%%a(..0DN0=m!!!$**,4G!^5I5I$5O#`5OTS]S]S_D5O#`a''7X_`X_u1XrvvlCq9IJJX_ `  7 ** $a`sE5E6Ec[R"U5n[USS5nU(d[SUS35eUR 5n[ U5up4n[ U5nUSRSS5=nbUbXWS'USR5HupX;a[SUS US 35eXHn [R"S U [RS 9n U (aq[R"U RS 55V s/sHoR 5PM sn U S'U RSU R!5R 5n XS'M X#US.n UbX}S'SU S.$s sn f)a This function generates a JSON schema for a given function, based on its docstring and type hints. This is mostly used for passing lists of tools to a chat template. The JSON schema contains the name and description of the function, as well as the names, types and descriptions for each of its arguments. `get_json_schema()` requires that the function has a docstring, and that each argument has a description in the docstring, in the standard Google docstring format shown below. It also requires that all user-facing arguments have valid Python type hints. When passing methods, implicit receiver arguments (`self` or `cls`) are ignored. Although it is not required, a `Returns` block can also be added, which will be included in the schema. This is optional because most chat templates ignore the return value of the function. Args: func: The function to generate a JSON schema for. Returns: A dictionary containing the JSON schema for the function. Examples: ```python >>> def multiply(x: float, y: float): >>> ''' >>> A function that multiplies two numbers >>> >>> Args: >>> x: The first number to multiply >>> y: The second number to multiply >>> ''' >>> return x * y >>> >>> print(get_json_schema(multiply)) { "name": "multiply", "description": "A function that multiplies two numbers", "parameters": { "type": "object", "properties": { "x": {"type": "number", "description": "The first number to multiply"}, "y": {"type": "number", "description": "The second number to multiply"} }, "required": ["x", "y"] } } ``` The general use for these schemas is that they are used to generate tool descriptions for chat templates that support them, like so: ```python >>> from transformers import AutoTokenizer >>> from transformers.utils import get_json_schema >>> >>> def multiply(x: float, y: float): >>> ''' >>> A function that multiplies two numbers >>> >>> Args: >>> x: The first number to multiply >>> y: The second number to multiply >>> return x * y >>> ''' >>> >>> multiply_schema = get_json_schema(multiply) >>> tokenizer = AutoTokenizer.from_pretrained("CohereForAI/c4ai-command-r-v01") >>> messages = [{"role": "user", "content": "What is 179 x 4571?"}] >>> formatted_chat = tokenizer.apply_chat_template( >>> messages, >>> tools=[multiply_schema], >>> chat_template="tool_use", >>> return_dict=True, >>> return_tensors="pt", >>> add_generation_prompt=True >>> ) >>> # The formatted chat can now be passed to model.generate() ``` Each argument description can also have an optional `(choices: ...)` block at the end, such as `(choices: ["tea", "coffee"])`, which will be parsed into an `enum` field in the schema. Note that this will only be parsed correctly if it is at the end of the line: ```python >>> def drink_beverage(beverage: str): >>> ''' >>> A function that drinks a beverage >>> >>> Args: >>> beverage: The beverage to drink (choices: ["tea", "coffee"]) >>> ''' >>> pass >>> >>> print(get_json_schema(drink_beverage)) ``` { 'name': 'drink_beverage', 'description': 'A function that drinks a beverage', 'parameters': { 'type': 'object', 'properties': { 'beverage': { 'type': 'string', 'enum': ['tea', 'coffee'], 'description': 'The beverage to drink' } }, 'required': ['beverage'] } } rrjz Cannot generate JSON schema for z because it has no docstring!rmr+Nrz< because the docstring has no description for the argument ''z\(choices:\s*(.*?)\)\s*$)flagsrrJ)rxrrtfunction)r-r)rogetdocrqr(rrrrYrLrr IGNORECASEjsonloadsrr0start)rhdocr{main_docparam_descriptions return_doc json_schemarbrerdesc enum_choicescoutputs r%get_json_schemars}X .. Cj+6I '*J9+Ur(stt ))+C/LS/Q,H*4T:K"<044XtDD Q  !)3 &"<0668   (+29+=yz}y~~A "&yy!DDFD $}9 TF&xF 33TsE* chat_templatecUc [5$[U5nURRU5n[[R R U55$)aOReturn the set of undeclared variables referenced by a chat template. Uses ``jinja2.meta.find_undeclared_variables`` so that callers can automatically distinguish template-level kwargs from processor kwargs without maintaining a manual allowlist. Needed only to support BC as we allowed all `kwargs` to be merged into one in the past ) frozenset_compile_jinja_template environmentparsejinja2metafind_undeclared_variables)rcompiledasts r%_get_template_variablesrsL{&}5H    $ $] 3C V[[::3? @@r$c /n/nURRXg5 UR"SUUUUS.UD6HnURU5 M SR U5n SSS5 X4$!,(df  W U4$=f)Nmessagestools documentsadd_generation_promptrMr)ractivate_trackergeneraterXr) compiled_templaterrrrtemplate_kwargsrendered_blocksgeneration_indicesblock rendered_chats r%_render_with_assistant_indicesrsO  & & 7 7 \&// "7    E  " "5 ) 0  ]  ,, ] \ , ,,s AA,, A=c[U5$N)_cached_compile_jinja_template)rs r%rrs )- 88r$c[5(d [S5e"SS[5n[R"[ R 5[R"S5:a[S[ R S35eSnSSjnS n[S S U[ RR/S 9nX5RS 'X%RS 'XERS'URU5$)Nzbapply_chat_template requires jinja2 to be installed. Please install it using `pip install jinja2`.cR^\rSrSrS1rS\4U4SjjrS\RRS\RR4Sjr \RS\RRS \RR S\4S j5rS\4S jr\S \\S \\4Sj5rSrU=r$)8_cached_compile_jinja_template..AssistantTrackeri generationrcr>[TU]U5 URURS9 SUlSUlg)N)r)super__init__extendr_rendered_blocks_generation_indices)rlr __class__s r%rA_cached_compile_jinja_template..AssistantTracker.__init__s7 G [ )   0E0E  F$(D !'+D $r$parserr+c[UR5RnURS/SS9n[R R URS5//U5RU5$)Nzname:endgenerationT) drop_needle_generation_support) rrstreamlinenoparse_statementsrnodes CallBlock call_method set_lineno)rlrrbodys r%r>_cached_compile_jinja_template..AssistantTracker.parsese&--(//F**,@+At*TD<<))$*:*:;P*QSUWY[_`kklrs sr$contextcallercU"5nUR5(aN[SRUR55nU[U5-nURR XE45 U$)NrM) is_activerUrrrrX)rlrrrv start_index end_indexs r%rL_cached_compile_jinja_template..AssistantTracker._generation_supportsYB~~!"''$*?*?"@A '#b'1 ((//0HIIr$cHURSL=(d URSL$r)rr)rls r%rB_cached_compile_jinja_template..AssistantTracker.is_actives$((4\8P8PX\8\ \r$rrc3# UR5(a [S5eXlX lSv SUlSUlg!SUlSUlf=f7f)Nz3AssistantTracker should not be reused before closed)r ValueErrorrr)rlrrs r%rI_cached_compile_jinja_template..AssistantTracker.activate_trackersU 0>>##$%Z[[(7%+=((,%+/()-%+/(sA0AAAA)rr)rrr r!tagsrrrrParserrrrpass_eval_context EvalContextruntimeMacror8rr9rrrZr6rr# __classcell__)rs@r%AssistantTrackerrs~ ,(E , t 4 4 t9O9O t  ! ! v||/G/G QWQ_Q_QeQe jm  "  ]t ]  0DI 0SWX[S\ 0  0r$rz3.1.0zLapply_chat_template requires jinja2>=3.1.0 to be installed. Your version is .c@[RRU5er)r exceptions TemplateErrormessages r%raise_exception7_cached_compile_jinja_template..raise_exceptions--g66r$c.[R"XX#US9$)N) ensure_asciiindent separators sort_keys)rdumps)xrrrrs r%tojson._cached_compile_jinja_template..tojsonszz!vhqrrr$cJ[R"5RU5$r)rnowstrftime)formats r% strftime_now4_cached_compile_jinja_template..strftime_nows||~&&v..r$T) trim_blocks lstrip_blocks extensionsr rr)FNNF) r ImportErrorrrrr __version__rext loopcontrolsfiltersglobals from_string)rrrr r jinja_envs r%rrs    p  (09(0T}}V''(7==+AAZ[a[m[mZnno p  7s /.:JFJJLcLc9dI#)h+:'((4n%   //r$ conversationsrrreturn_assistant_tokens_maskcontinue_final_messagerc 6U(a1[R"SU5(d[RS5 [ U5nUb/n UH{n [ U [ 5(aU RU 5 M+[U 5(d[R"U 5(aU R[U 55 Mr[S5e OSn Ub)UH#n [ U [ 5(aM[S5e /n /n SnUGHn[US5(a URnU(a[!U5nUSR#S5nUc [S 5e[ U[$[&45(a5[)U5HnS U;dM US nUS U-US ' O [S 5eUSSU-USS'U(a&[+SUUU UUS .UD6unnU RU5 OUR,"SUU UUS .UD6nU(aWR/5U;dUR/5U;a [S5eUR1UR/55nUUU[3U5-U:XaUSUnOUSUR55nU RU5 GM X4$)Nz\{\%-?\s*generation\s*-?\%\}zareturn_assistant_tokens_mask==True but chat template does not contain `{% generation %}` keyword.zTools should either be a JSON schema, or a callable function with type hints and a docstring suitable for auto-conversion to a schema.zADocuments should be a list of dicts with 'title' and 'text' keys!zCONTINUE_FINAL_MESSAGE_TAG rcontentzOcontinue_final_message is set but the final message has no content to continue!textz^continue_final_message is set but we could not find any text to continue in the final message!)rrrrrracontinue_final_message is set but the final message does not appear in the chat after applying the chat template! This can happen if the chat template deletes portions of the final message. Please verify the chat template and final message in your chat to ensure they are compatible.r)rrlogger warning_oncerrCr]rXrroismethodrr TypeErrorrRrrr<rZr[reversedrrenderrrindexrUrstrip)rrrrrr rkwargsr tool_schemastooldocumentrenderedall_generation_indicescontinue_final_message_tagchat final_message content_blockrrtag_locs r%render_jinja_templater8s$BII6UWd,e,e o 0 >  D$%%##D)D!!W%5%5d%;%;##OD$9: P  !Hh-- cdd"H!> 4 $ $==D !D>D HLL3M$ !rssMD%=99%-m% > @  &sv  ++r$cJ[U[5(dgSU;aSU;dgg)z^ Check that input is a valid message in a chat, namely a dict with "role" and "content" keys. Froler#T)rCr]rs r%is_valid_messager;Zs) gt $ $ g )w"6 r$c&\rSrSrSrS\4SjrSrg)ChatieaThis class is intended to just be used internally for pipelines and not exposed to users. We convert chats to this format because the rest of the pipeline code tends to assume that lists of messages are actually a batch of samples rather than messages in the same conversation.rcXUHn[U5(aM[S5e Xlg)NzQWhen passing chat dicts as input, each dict must have a 'role' and 'content' key.)r;rr)rlrrs r%r Chat.__init__js*G#G,, !tuu ! r$)rN)rrr r!r"r]rr#rr$r%r=r=esR!!r$r=)NNNFFF)MrorrrScollections.abcr contextlibrcopyrr functoolsrrtypingr r r r r rr packagingrrMr import_utilsrrr get_loggerrr%rjinja2.exceptions jinja2.ext jinja2.meta jinja2.nodesjinja2.runtimerjinja2.sandboxr PIL.ImagerrZr]r8ChatTyper6r7r9r- BASIC_TYPEScompileDOTALLrrVERBOSErr Exceptionrr(r>rTrr[rrrrrrrr8r;r=rr$r%rUs $%[[[UU   H %$< F S#X E3c4:s; GS **H")) T  II  ZZEryy Q UyUU Ue, x 4 'e,$e,: e, #' e, ! e, e, e,P ! !r$