j$ 0 %SrSSKrSSKrSSKJr \Vs0sHoR R 5U_M snr\\ \4\ S'0S\R_S\R_S\R_S\R_S \R_S \R_S \R_S \R_S \R_S\R_S\R_S\R_S\R_S\R _S\R _S\R"_S\R$_0S\R$_S\R$_S\R$_S\R$_S\R$_S\R$_S\R&_S\R&_S\R&_S\R(_S \R*_S!\R,_S"\R,_S#\R._S$\R._S%\R0_S&\R2_E\R2\R4\R4\R4S'.ErS(r\R&\R&\R&\R\R:\R<\R\R(S).r\R@"S*5r!\R@"S+5r"\R@"S,\RF5r$\R@"S-\RF\RJ-5r&\R@"S.\RF\RJ-5r'\R@"S/5r(\R@"S05r)S1r*\R\R@"S2\RJ54\R*\R@"S354\R\R@"S4\RJ54\RV\R@"S554\R \R@"S654\R$\R@"S7\RF\RJ-54\R\R@"S854\R\R@"S9544r,S:\ S-S;\4S<jr-SAS=\ S:\ S-S;\4S>jjr.S=\ S;\4S?jr/S=\ S;\04S@jr1gs snf)BaBest-effort detection of a code block's programming language. The blocks docling extracts are usually only a few lines. An explicit hint (a Markdown fence token, an HTML ``language-*`` class) is therefore trusted first, and content detection commits to a language only on a strong marker: downstream consumers treat ``code_language`` as authoritative, so a wrong guess is worse than ``UNKNOWN``. N)CodeLanguageLabel_LABEL_BY_VALUEpypython2python3golangjsjsxnodenodejststsxcppcxxcccscsharpymlmysqlpostgres postgresqlpsqlsqliteplsqltsqlshshellzshrbrsktktsobjcz objective-ctexvb)vbnethtmhtml5xhtml)z language-zlang-)bashrrr perlphppythonrubyz<^#![^\n]*?\b(bash|zsh|sh|node|perl|php|python|ruby)[0-9.]*\bz<\?php\bz8|<(head|body)[\s>]z^[ \t]*FROM\s+\S+z9^[ \t]*(RUN|CMD|COPY|ADD|ENTRYPOINT|WORKDIR|ENV|EXPOSE)\bz-\bstd::|\bcout\b|\btemplate\s*<|\bnamespace\bz,\bint\s+main\s*\(|\bprintf\s*\(|\bscanf\s*\(){[zQ^[ \t]*package\s+main\b|\bfunc\s+\(\w+\s+\*?\w+\)|\bfmt\.(Print|Println|Printf)\bzA\bfn\s+main\s*\(|\blet\s+mut\b|\bprintln!\s*\(|\bfn\s+\w+[^\n]*->ze^[ \t]*def\s+\w+\s*\([^\n]*\)\s*(->[^\n:]+)?:|^[ \t]*elif\b|\b__name__\b|^[ \t]*from\s+\S+\s+import\bzF\bimport\s+java\.|\bSystem\.out\.print|\bpublic\s+static\s+void\s+mainzM\busing\s+System\b|\bConsole\.(Write|WriteLine)\b|\bnamespace\s+[\w.]+\s*[{;]a^[ \t]*select\b(?:(?!\bfrom\b)[^\n])*(?:\n[ \t]*)?\bfrom\b(?:(?!\bwhere\b|\bjoin\b|\bgroup\s+by\b|\border\s+by\b|;)[^\n])*(?:\n[ \t]*)?(\bwhere\b|\bjoin\b|\bgroup\s+by\b|\border\s+by\b|;)|^[ \t]*insert\s+into\s+\w+\s*(\(|values\b|select\b)|^[ \t]*update\s+\w+\s+set\b[^\n]*?=|^[ \t]*delete\s+from\s+\w+\s*(\bwhere\b|;)|^[ \t]*create\s+(table|view|index|database)\s+(if\s+not\s+exists\s+)?\w+\s*(\(|as\b)|^[ \t]*alter\s+table\s+\w+\s+(add|drop|modify|alter|rename)\b|^[ \t]*drop\s+(table|view|index|database)\s+(if\s+exists\s+)?\w+\s*;za\b(readonly|public|private|protected)\s+\w+\s*:\s*\w+|:\s*(string|number|boolean)(\[\])?\s*[;,)=]zc\bconsole\.log\s*\(|\brequire\s*\(|\bmodule\.exports\b|\bdocument\.(getElementById|querySelector)\bhintreturncNU(d[R$UR5R5n[H)nUR U5(dMU[ U5Sn O [RU5nUbU$[RU[R5$)aResolve an explicit language token to a ``CodeLanguageLabel``. Args: hint: A language token carried by the source, such as a Markdown fence info string or an HTML ``language-``/``lang-`` class. Common aliases (``py``, ``golang``, ``c++``, ``yml``, ...) are recognized. Returns: The matching ``CodeLanguageLabel``, or ``CodeLanguageLabel.UNKNOWN`` if the hint is empty or not recognized. N) rUNKNOWNstriplower_HINT_PREFIXES startswithlenrget_ALIASES)r1tokenprefixlabels X/home/mande/repo/quber/.venv/lib/python3.13/site-packages/docling/utils/code_language.pynormalize_code_languager@s  ((( JJL   E    F # ##f+-(E !    &E  <<088 99textc[U5nU[RLaU$U(aUR5(d[R$[ U5$)aGDetect the programming language of a code block. An explicit ``hint`` is trusted over the content; otherwise the language is inferred from ``text`` using conservative, high-precision markers, and an ambiguous snippet stays ``CodeLanguageLabel.UNKNOWN`` rather than risk a wrong label. Args: text: The contents of the code block. hint: An optional language token to normalize first, as accepted by ``normalize_code_language``. Returns: The detected ``CodeLanguageLabel``, or ``CodeLanguageLabel.UNKNOWN`` when no language can be determined with confidence. )r@rr4r5_detect_from_content)rBr1r>s r?detect_code_languagerEsF" $D )E %--- tzz|| (((  %%rAc UR5n[RU5nU(a[UR S5$[ R U5(a[R$[R U5(a[R$[R U5(a*[R U5(a[R$SU;aT[R U5(a[R$[ R U5(a[R"$[$Hup4UR U5(dMUs $ ['U5(a[R($[R*$)Nz#include)lstrip _SHEBANG_REmatch_SHEBANG_INTERPRETERSgroup_PHP_REsearchrPHP_HTML_REHTML_DOCKERFILE_FROM_RE_DOCKERFILE_DIRECTIVE_RE DOCKERFILE_CPP_RE C_PLUS_PLUS_C_REC_CONTENT_RULES_looks_like_jsonJSONr4)rBheadshebangr>patterns r?rDrDs ;;=D%G$W]]1%566~~d $$$t %%%!!$'',D,K,KD,Q,Q +++T >>$  $00 0 <<  $&& &( >>$  L) %%%  $ $$rAcUR5nU(a US[;ag[R"U5 g![a gf=f)NrFT)r5 _JSON_PREFIXjsonloads ValueError)rBstrippeds r?rZrZsHzz|H x{,6 8  s> A  A )N)2__doc__raredocling_core.types.docrvaluer6rdictstr__annotations__PYTHONGO JAVASCRIPT TYPESCRIPTrVC_SHARPYAMLSQLBASHRUBYRUSTKOTLIN OBJECTIVECLATEX VISUALBASICrQr;r7PERLrOrKcompilerIrM IGNORECASErP MULTILINErRrSrUrWr`JAVArYr@rErDboolrZ)r>s0r?rs 4->1,=5KK,=1c,,-'   " "'   '''  '''  "" '    & & '    ' ' '   ( ('  **'   & &'   ' ''   ( ('   ( ('   ' ''   # #'  '''    ! !!' "  " "#' $!%%%' &#'''' (  ! !)' * ##+' ,  " "-' .  ! !/' 0  1' 2  # #3' 4  ! !5' 6  7' 8  9' :  " ";' <  # #=' >  ( (?' @$//A' B  " "C' D  ' 'E' F * *  ! !  # #  # #M' R(  " "   ! !  ( (  " "  &&  " " jjC  **[ ! ::?  jj!5r}}r||7ST::@MMBLL  **E F BC   ` LL   P      H LL   U  !!  ,    U MMBLL ( , $$  <  $$  = FR:#*:1B:6&s&#*&@Q&6%s%'8%<34]1s$R