5oj/SrSSKJr SSKrSSKJr SSKJrJrJ r J r J r J r SSK Jr SSKJrJr SSKJrJrJrJrJr S r\"1S k5r"S S \5r"S S\5r"SS\5r"SS\ 5r"SS\ 5rSSjr SSjr!SSjr"S Sjr#S!Sjr$S"Sjr%S#Sjr&S$Sjr'g)%a=Reconcile the values printed in a document's figures, with per-value provenance. The scan reads each figure into prose, so a chart's numbers reach the document with no per-value geometry and nothing checking them. This module gives every plotted value a second, independent read and a trace to the page: - The parse's positioned text cells are the fragment source. A born-digital page carries every printed chart value as a native cell with a box; a page docling read from its image carries the same cells from OCR, marked so. - A local reader looks at the page image with the figure's fragments and reports each printed value with the fragment ids that ground it. - A parser turns the scan's prose reading into the same value shape. - A deterministic tie matches the two within each page and assigns statuses from the cell-status registry: agreement grounded in a fragment is `reconciled` with the fragment's box; a positional disagreement is `value_misread`; a one-sided value is `value_unreconciled` with the direction in the note. Matching is value-first with label confirmation, consuming pairs so repeated values resolve by count. Values are compared in a normalized form; the stored value keeps the printed form. Boxes are normalized 0..1, top-left origin, the same frame every other figure box in this package uses. ) annotationsN)Path)DictListOptionalProtocolSequenceTuple)logger) BaseModelField)Box FigureRecord FigureValueFigureValueRunPageScang?>abyinoftoandperthecT\rSrSr%SrS\S'S\S'S\S'SrS \S 'S rS \S 'Srg) PageFragment,zHOne positioned text cell from the parse, in the page's normalized frame.stridtextrboxFboolfrom_ocr?float confidenceN) __name__ __module__ __qualname____firstlineno____doc____annotations__r#r&__static_attributes__r'7/home/mande/repo/quber/src/quber/core/figures/values.pyrr,s(R G I HHdJr/rcP\rSrSr%Sr\"SS9rS\S'\"SS9rS\S'S\S'S r g ) ParsedValue6zGOne labeled value read out of the scan's prose description of a figure.defaultrlabelseriesvaluer'N) r(r)r*r+r,r r7r-r8r.r'r/r0r2r26s(Qr"E3"#FC# Jr/r2c|\rSrSr%Sr\"SS9rS\S'\"SS9rS\S'\"SS9r S\S'S\S '\"\ S 9r S \S 'S r g) ReadValue>z9One printed value the local reader saw on the page image.r4r5r chart_titler7r8r9)default_factoryz List[str] fragment_idsr'N) r(r)r*r+r,r r=r-r7r8listr?r.r'r/r0r;r;>sFCR(K(r"E3"#FC# J#D9L)9r/r;c"\rSrSrSrSSjrSrg)ScanValueParserHz3Turns a figure's prose reading into labeled values.c # g7fNr')self figure_textspages r0parseScanValueParser.parseKsX[r'N)rGz Sequence[str]rHintreturnzList[ParsedValue])r(r)r*r+r,rIr.r'r/r0rBrBHs=[r/rBc2\rSrSrSrSSjrSrg)LocalValueReaderNzJReads a page image's figure values, citing the fragments that ground them.c # g7frEr')rF image_path fragmentsrHs r0readLocalValueReader.readQsrKr'N)rRrrSSequence[PageFragment]rHrLrMzList[ReadValue])r(r)r*r+r,rTr.r'r/r0rOrONs*T+AIL r/rOc[US5=(d Sn[US5=(d Sn/nUSn[URS/55HupV[URSS55R 5nU(dM7USuppUR [ S US U3UX- X- X- X- S .[URS S 55[URSS55S95 M U$)zThe parse's cells for one page, normalized to the 0..1 top-left frame. `cells_page` is one entry of the document's cells artifact: page_no, width, height, and cells each holding text, box in top-left PDF points, from_ocr, and confidence. widthr$heightpage_nocellsr r4r!pz.c)lefttoprightbottomr#Fr&)rr r!r#r&)r% enumerategetrstripappendrr") cells_pagerXrYrSrZicellr r]r^r_r`s r0page_fragmentsrhVs *W% & -#E :h' ( /CF$&I#GZ^^GR89488FB'(..0 #'; 5 wir!% L<"]$o  dhhz59: ,!<=  :& r/c v/nUHnURn[S[USUS5[USUS5- 5n[S[USUS5[USUS5- 5n[USUS- USUS- -S5nXV-U- [:dMUR U5 M U$)z0Fragments whose area sits mostly inside the box.gr_r]r`r^g& .>)r!maxmin SCOPE_OVERLAPrd)rSr!hitsfragfinter_winter_hareas r0fragments_in_boxrsws D HHc3qz3w<83qy#f+;VVWc3q{CM:S53u:=VVWAgJ6*q{QuX/EFM   % 6 KK   Kr/c.[U5R5RSS5RSS5nURSS5RSS5nURS5=(a UR S5nU(aUS S nURSS5RSS5R S 5R5nUS ;ag [ U5nU(a US:aU*nUS$![a UR5s$f=f)zDA value reduced to its comparable core: sign, digits, decimal point.$r4,u–-u—()%>r4rw--DASHrg) rrcreplace startswithendswithrstripr% ValueErrorlower)rawsnegativenumbers r0 norm_valuers C  b)11#r:A %%%eS1A||C 4QZZ_H aG #r""3+2237==?AOqFQJQZ wwys C77DDc [5nUH@nUR[R"S[ U5R 555 MB [ U[- 5$)Nz [a-z0-9/+.]+)setupdaterefindallrr frozenset STOP_WORDS)partswordsparts r0 label_wordsrsE EE RZZT1BCD UZ' ((r/c8URVs/sHo"U;dM XPM nn[UR5nUHDnURUR;d#US:wdM%U[UR5;dM@US4s $ U(aUSS4$SS4$s snf)a"The cited fragment printing the value, and whether any cited one does. Returns the first cited fragment whose text contains the value in either printed or normalized form. When citations exist but none contains the value, the first cited fragment anchors the position of the disagreement. r~TrNF)r?rr9r )rTfragments_by_idrfcitedtargetrns r0value_fragmentrs*.):): S):A?>R _ ):E S  #F :: "v'7FjQUQZQZF[<[: E!H% //4% // Ts BBcFUbUSUS-S- nUSUS-S- nSnUHnURnUb URcM!USUs=::a US::dM6O M:USUs=::a US::dMOO MSUSUS- USUS- -nUb XS:dMwXR4nM UbUS$U(abUVs1sH2ofR(dMX&R;dM&URiM4 n n[U 5S:Xa[ [ U 55$gs snf) uThe picture a value belongs to, or None when no figure claims it. A boxed value belongs to the figure whose box contains the value's center, the smallest such figure when they nest. An unboxed value belongs to the one figure whose scan text prints it, and to no figure when the value appears in several or in none — a wrong anchor misleads where an absent one just falls back to the page. Nr]r_r^r`rrz)r! picture_refr lennextiter) figuresr! raw_valuecxcybestfigfbrrholderss r0picture_for_valuers/ &kCL(A -%j3x=(A -6:CBzS__4&zR.2g;..2e93Rbl3R3R7 bj0R\BuI5MN<4q'> //2D  7N.5cgs?YZbZbMb?3??gc w<1 W & & ds?D D(Dc^UVs0sHoURU_M nn[U5m/nSU4SjjnUHn U"U SS9=(d U"U SS9n [X5upU (aU (aU bSupO.U (aU bSn SU R<S 3nOU (aS n S nOS n S nU b U ROSnUR [ U[XU R5U RU RU RU RU U[U R5US 9 5 M THTnUR [ U[USUR5URURURS SS95 MV U$s snf)zAMatch the two readings of one page's figures and assign statuses.c>[UR5n[URUR5nTHn[UR5U:waM[URUR5n[ X5-5nU(a U(dM[U(dU(aU(a U(dMyTR U5 Us $ grE)rr9rr7r8r"remove)rT require_labelr read_words candidatecandidate_wordsoverlap remainings r0 take_matchtie_page..take_matchsDJJ' T[[9 "I)//*f4))//9;K;KLO:78GW _G   Y ' #r/T)rFN) reconciledN value_misreadzthe page prints z2 where this value should appear - possible misreadvalue_unreconciledzKcorroborated by both readings, but not anchored to printed text on the pagezSone measurement, read from the page; uncontradicted, not independently corroborated) rHrr=r7r8r9statusnoter?r!zbone measurement, from the figure description; uncontradicted, not corroborated on the printed page)rHrr7r8r9rr)rTr;rr"rMzOptional[ParsedValue]) rr@rr r!rdrrr9r=r7r8r?)rHr scan_values local_valuesrSroroutrrTmatchedfragmentcontainsrrr!leftoverrs @r0tie_pagersu)22 1ttQw O2[!IC T6_*TY^:_+DB xH$8-LFD -$F%hmm%66hiD )F`D)FhD&2hll -gDJJG ,,jj{{jj!$"3"34  < -gtX^^Lnnnn+y   J}3sE?c d# [US9nUGHnUR(dMURnURU5n URU5n U bU c!URR SUS35 Ml[ U 5n URURV s/sHoRPM sn U5IShvN n URXU5IShvN nURR[XRXU 55 GM UR UR"S.n[R$"S['S U55U5 U$s sn fNN![aDnURR SUSU35 [R"SX5 SnAGMSnAff=f7f) zReconcile every scanned figure page's values. In: the run's page scans, the parse's cells keyed by page, a rendered image per scanned page, and the two readers. Out: one FigureValueRun with a FigureValue per value either reader produced. )documentNzpage z0: missing cells or render; figure values skippedz: figure-value read failed: zfigure values page {}: {})rflaggedzfigure values: {} pages -> {}c3J# UHoR(dMSv M g7f)rzN)r).0rs r0 %read_figure_values..8s4S1QQs# #)rrrHrberrorsrdrhrIr rT Exceptionr warningvaluesextendrrrinfosum)scans cells_pages page_imagesparserreaderrrunscanrHreimagerSrorrexccountss r0read_figure_valuesrsb ( +C|| yy __T* %   JJ  dV+[\ ] ":.   & dll-Klffl-KT RRK!'Ut!DDL (4{R[\]#$ NNs{{ CF KK/4S4S1SU[\ J.LRD  JJ  dV+GuM N NN6 B  saBF0EE 4 E?EEEEA8F0EE F-)8F(!F0(F--F0)redictrMList[PageFragment])rSrVr!rrMr)rrrMr)rrrMr)rTr;rzDict[str, PageFragment]rMz#Tuple[Optional[PageFragment], bool])rSequence[FigureRecord]r!z Optional[Box]rrrMz Optional[str]) rHrLrrrzSequence[ParsedValue]rzSequence[ReadValue]rSrVrMzList[FigureValue])rzSequence[PageScan]rzDict[int, dict]rzDict[int, Path]rrBrrOrrrMr)(r, __future__rrpathlibrtypingrrrrr r logurur pydanticr r quber.core.figures.modelsrrrrrrlrrrr2r;rBrOrhrsrrrrrrr'r/r0rs<0# BB%^^ I J 9): :\h\ xB &)0 0&=0(0"