jAnSrSSKJr SSKrSSKrSSKJr SSKJrJ r J r J r SSK J r JrJrJr SSKJr SSKJr SS KJr SS KJr SS KJrJrJr SS KJrJr SS K J!r! SSK"J#r# SSK$J%r%J&r&J'r'J(r( SSK)J*r*J+r+ SSK,J-r-J.r. SSK/J0r0 SSK1J2r2 Sr3Sr4S\3S4SSjjr5SSjr6S Sjr7S!Sjr8\9"\Rt\Rv\Rx\Rz45r>S"Sjr?S#Sjr@S$SjrAg)%u.Turn a table read off a page image into an extracted table. A page is nominated partly for its tables: `table_verdicts` in nominate.py counts the source PDF's text-layer words under each table's box against the cells the table holds, and a table with too few was read off the page image rather than out of a text layer. A table read off the image never reached the Set-of-Mark and Camelot engine either, because that engine extracts from a text layer and there was none. What stands in the document for such a table is the parse's own reading, with nothing having checked it since. The scan replaces that reading. It returns the table as a table — a grid with a box on every cell — so the grid goes straight into the same correction and grounding steps every other table in the document goes through, and what comes back is an `ExtractedTable` filled the way every other one is filled. Replacing rather than keeping both is deliberate. The parse's reading of these tables is not merely rougher, it is wrong in ways that change values: a currency symbol read as a letter, a thousands separator read as a decimal point. A wrong number carried beside a right one is how a wrong number survives. The parse's reading is not discarded on the way out, though. Before the grid reaches the correction step, every cell in it is checked against what the parse read in the same place, and any cell the two disagree on, or the parse has no cell for, is read off the printed page by an agent. The check is skipped when the scan gave the table no box, and `crosscheck_cells` passes the grid through unchecked when no reader is configured. The scan has its own failure mode — it returns a thousands separator as a decimal point — and the parse is a second opinion on it that costs nothing. Only the tables that nominated the page are replaced. A page can print a table with a text layer beside one without, and the first was read properly by the table engine; overriding it with a scan would discard a vetted extraction for no reason. A nominated table the scan returned nothing over is reported. ) annotationsN)Path)DictListOptionalTuple)DocItemDoclingDocument PictureItem TableItem) DocItemLabel)logger) CellReader)ExtractedTable)coverage_fractioncrop_region_pngtable_crop_box) TableAssemblyassemble_table)apply_content_regions)crosscheck_cells)NormBoxnorm_box point_boxprov_box)PageScan ScannedTable)FURNITURE_CLASSESpicture_classes) READ_BY_FIELD) render_pageg?Fc z^^^^^#^$^%# URVs0sHoRU_M snm#/n /n UGHn TRU RS5up[ X R5n[ U R5nU R HnT#RU5n[UXX5nUc$U RSU RSUS35 MHUUl URU5 U RU UUURUS545 M [U5n[X XX5HLunnURUl URU5 US- nU RU UURU45 MN U(dGMS[X XX5H.nURU5 US- nU RU USU45 M0 GM U (d/U 4$[R "SS 9m%[#U V VVVs1sHun nnnU RiM snnnn 5n[$R&"UUU%4S jU56IShvN n[)UUS S 9VVVVs0sH ununnnUU_M snnnnm$[$R&"UU#U$UU4S jU 56IShvN nSSS5 [)U WS S 9Huunnn n!n"U"R*UlM [$R,"[.[ U5[1T55IShvN [ U5U 4$s snfs snnnn fNs snnnnfN!,(df  N=fN;7f)u;Extract every nominated table the scans read, in page order. Each record in `scans` is given the reference of the parse table its grid replaced and the address of the table it produced, so a value traces back to the element that holds it. Returns the tables and one error per nominated table no returned table covered. With `orphans`, a returned grid over a region the document holds nothing for — no table, no picture, no figure, and no text the parse read there — is captured too, through the same checks, with the cell check asking an agent about every cell because there is no parse reading to check against. A map's legend is the standing example: the page prints the values, the parse's text layer has nothing, and the scan's grid is the only reading anywhere. The caller gives such a table a home by inserting it. g @g@Nzpage z: table zw was read off the page image and the scan returned no table over it; what stands in the document is the parse's readingzquber-scan-table-)prefixc 3># UH>n[R"[TUTR[ T5SUSS3- 5v M@ g7f)zpage-04dz.pngN)asyncio to_threadr!dpir).0pageassemblysourcetmps 8/home/mande/repo/quber/src/quber/core/figures/capture.py !capture_tables..sL!D!!+vtX\\4PS9Y^_cdg^hhlWmKmnn!sAA T)strictc 3># UHOupp4[UTRU5TURTRURS5UTT 5v MQ g7f)r$N)_capturegetr.) r-scanscannedrefordinalr/by_refimages page_dimsreaders r2r3r4s` 48/D3JJsO499%MM$))^<48sAA)tablesself_refr8r._page_ordinalslist table_refs _best_matchappend table_refremovelen_over_pictures picture_ref _orphan_gridstempfileTemporaryDirectorysortedr*gatherziptable_idr+rstr)&documentscansr0r?r/r@match_fractionorphanstworkerrorsr9widthheightordinals availabler; table_itemr:r<picture_s_r_opagesrenderedr.image_w_hrA_scan_ref_ordinaltabler=r>r1s& ```` @@@r2capture_tablesrnJs2&.__ 5_jj!m_ 5F:>4R   14<V MMM < S6Z@ ^   A @8NsxL;LEL; A#L;- L(:L,L(LL(L **L(L&L(A$L;=L9>L; L( L(( L62L;c# UupxURV V s/sHoV s/sHn [XU5PM sn PM! n n n [URXx5n [R"SUR [ UR5UR(a[ URS5OS5 URn U bO[R"[U[X5UR5IShvN n[XX>U5IShvN up[UUR UUUU U U [UR5SSS9 IShvN $s sn fs sn n fN^NKN7f)zJOne returned grid, checked against the parse, then corrected and grounded.z?Table capture: page {} reading a {}x{} table off the page imagerN image_tableF) r.r< page_imager?cells cell_boxesbbox som_regionkind ground_values)rsrboxrinfor.rJrrr*r+rrr,rrr)r:r`rqr?r<r/r@r\r]rowrxboxesrtrrcrop_reads r2r7r7s3MEGNGYGY ZGYs ;siF+s ;GYE Z W[[% 0D KKI  GMM!(GMM! A  MME && Z)Ex||  .g9TZ[[  \\ GKK(   !< Z \ sVE EE EB:E6E7E E 9EEE EEEEc.^^^^^ ^STR5Vs/sH ofcMUPM nnUUU4SjUR5Vs/sH nUcMUPM nn/n URGHn U R(a'U RSRTR :waM>[ U 5(a"[S[ U 555(aMp[U R[S5(aM[U TT5mTcM[UU4SjXx-55(aMUV ^ s/sH!m [U 4SjU 55(dMT PM# n n [XTTT5n U cGMU RX45 GM U $s snfs snfs sn f)aEach unclaimed grid paired with the picture it was printed over. A picture stands in for a table only where the parse filed the region as a picture and as nothing else. Four things disqualify it. Every class the parse gave it is page furniture (`FURNITURE_CLASSES`, a logo or an icon), so there is nothing inside it to read. A reader already read the region, and the picture's metadata records which under `READ_BY_FIELD`. Reading it again would state the same table twice. A parse table over the same region means the document already holds that table, read from a text layer by the table engine. The scan read it too, and that reading is ignored for the reason the module's own rule gives: a vetted extraction is not replaced by a scan of the same region. Adding it beside the table would state the same figures twice. A figure over the same region means the scan called it a picture, and the graft attaches that reading to the picture as a description. Taking it as a table as well would put one thing in the document twice again. c3L# UHn[UR5v M g7fNrrxr-charts r2r3!_over_pictures..M ux 22 "$Nc3># UHNnUR(dMURSRTR:XdM?[UTT5v MP g7frNprovpage_nor.rr-rmr]r9r\s r2r3rL (zz +#jjm33tyy@ +HUE6 * *(A%AArc32# UH o[;v M g7fr)r)r-cs r2r3rs+eLdq1B,BLdsc3>># UHn[UTT5v M g7fr_covers)r-otherrWtargets r2r3rsZCY%wufn55CYc30># UH upTULv M g7fr)r-_picprYs r2r3rs0Q5!5s)figuresrApicturesrrr.rallgetattrmetar ranyrFrG)rUr9r_r\r]rWrxr parse_tablespairsrarY remainingr:rs ` ``` ` @r2rKrKs]:N MaMssMGa !  C   57E$$||w||A66$))C  7 # #+eO\cLd+e(e(e  7<< 5 5 '5&1 >  Z7CYZ Z Z  )R 1S0Q50Q-QQ Rg%P   LL'+ ,#%$ L;b0Ss"FFF F 1FFcD[[X5[X55U:$)zIDo the two boxes overlap enough, either way round, to be the same region?)maxr)rxrrWs r2rrs!  -/@/M NR` ``c^^^^^STR5Vs/sH ofcMUPM nnUUU4SjUR5Vs/sH nUcMUPM nnUUU4SjUR5Vs/sH nUcMUPM n n/n URHn U R[ ;d(U R =(d SR5(dMAU R(a'U RSRTR:waM{[U TT5mTcMU RTSTS-S- TSTS-S- 45 M /n UHn U R(dM[U R5mTcM0[!UU4S jXx-U -55(aMR[!U4S jU 55(aMnU RU 5 M U $s snfs snfs snf) uEach unclaimed grid over a region the document holds nothing for. Nothing means nothing: no parse table (the table engine read a text layer there), no figure (the graft attaches that reading to a picture), no picture (the picture tier above homes those), and no content text the parse read inside the region. That last condition is the line between a map's legend — printed values the parse's text layer never captured, where the scan's grid is the only reading anywhere — and a stat panel, whose strings the parse does hold and whose binding is the block grouping's job. Inserting a grid over a region the parse read would state its content twice. c3L# UHn[UR5v M g7frrrs r2r3 _orphan_grids..;rrc3># UHNnUR(dMURSRTR:XdM?[UTT5v MP g7frrrs r2r3r>rrc3># UHNnUR(dMURSRTR:XdM?[UTT5v MP g7frr)r-rar]r9r\s r2r3rGsL ,|| - ' Q 7 7499 D -HWeV , ,,rr&rr%c3>># UHn[UTT5v M g7frr)r-rrxrWs r2r3r_sb@auwuc>22@arc3># UHDupTSUs=:*=(a TS:*Os =(a TSUs=:*=(a TS:*Os v MF g7f)rrr%rNr)r-cxcyrxs r2r3rasE\|VRs1v%%s1v%@#a&B*@*@#a&*@@|sA A)rrArtextslabel _SPINE_LABELStextstriprrr.rrGrrrrxr)rUr9r_r\r]rWrxrrr text_centersitemfoundr:s ` ```` r2rMrM's(N MaMssMGa !  C    #,,  C    L :: &tyyB.E.E.G.G yyDIIaL00DII= tUF+ ?   #a&3q6/Q!6Q#a&A8M N O!#E}} w{{# ;  b@VYa@ab b b  \|\ \ \  W LSbs"GGGG4G$?G$c URVs/sH@o"R(dMURSRU:XdM4URPMB nn[ U5VVs0sH upEXTS-_M snn$s snfs snnf)zJEach table's position among the tables its page prints, counting from one.rr%)rArrrB enumerate)rUr.rYrefsir;s r2rCrCgsf ( X166JaffQi>O>OSW>WJAJJD X%.t_ 5_61CQJ_ 55 Y 5sA;A;A;&BcUcg[XU5nUcgSnUnUHDn[UR5n U cM[[ X5[ XY55n X:dMBXpvMF U$)uThe returned table covering `item` best, or none past the threshold. `item` is whatever the parse holds over that region — a table it detected as one, or a picture it filed a table as. N)rrrxrr) rr:r\r]rWrbestbest_cov candidaterxcovs r2rFrFmss | d6 *F ~#'DH y}}% ; #C02CF2PQ ?&(  Kr)rUr rVzList[PageScan]r0rr?zDict[int, Tuple[float, float]]r/rr@Optional[CellReader]rWfloatrXboolreturnz&Tuple[List[ExtractedTable], List[str]])r:rr`zOptional[TableItem]rqrr?zTuple[float, float]r<intr/rr@rrr)rUr r9rr_List[ScannedTable]r\rr]rrWrrz&List[Tuple[PictureItem, ScannedTable]])rxrrrrWrrr)rUr r9rr_rr\rr]rrWrrr)rUr r.rrzDict[str, int]) rzOptional[DocItem]r:rr\rr]rrWrrzOptional[ScannedTable])B__doc__ __future__rr*rNpathlibrtypingrrrrdocling_core.types.doc.documentr r r r docling_core.types.doc.labelsr logururquber.agents.cell_readerrquber.core.extractors.baser5quber.core.extractors.camelot.correspondence.geometryrrr*quber.core.extractors.set_of_mark.assemblerr(quber.core.extractors.set_of_mark.extentrquber.core.figures.crosscheckrquber.core.figures.geometryrrrrquber.core.figures.modelsrrquber.core.figures.nominaterrquber.core.fusion.graftr quber.files.pdfr!MATCH_FRACTION CAPTURE_DPIrnr7rKr frozensetSECTION_HEADER PAGE_HEADER PAGE_FOOTERTITLErrMrCrFrrr2rs3"H#..\\6/5 UJ:NN<J1'  $(*b b b  b . b  b ! b b b ,b J+ +#++# +  +  + !++\:: :":  :  :  :,:za  ,":":L