ugj!$SrSSKJr SSKrSSKJr SSKJrJrJ r J r J r SSK J r SSKJrJr SrS r\R&"S 5r\R&"S \R*5rSS jrSS jrSSjrSSjrSSjr"SS\5rSSjrg)uRead a scanned page's tables back as grids. A scan returns a table as a table. The chunk carries an HTML grid with an id on every cell, and the response's grounding map carries, against each of those ids, the cell's box and its row, column and spans. Putting the two together gives a dense grid — one entry per row and column — with a box on every cell, which is the shape the rest of the table pipeline already works in. A table is not always its own chunk. Where a page prints a chart and a table as one composite, the scan returns one figure, and writes the table inside that figure's text as markdown between a pair of markers it emits itself. The values are complete and correctly separated there — on one page the scan read a bond issuance table's four credit-rating rows exactly, while the parse ran four ratings together into a single cell and left the next three blank. So the markers are read and the markdown between them is taken as a table. Nothing infers where the table is in the text; the scan labelled it. What such a table does not carry is geometry. The composite is grounded as one box covering the whole figure, with nothing per cell, so its cells arrive with no boxes. That costs nothing downstream: the structure correction reads the page image rather than the boxes, and a table with no reading to check against already puts every cell to the agent. Nothing here interprets the content. Spans are honoured as geometry: a cell that spans two columns is written once at its own position and the positions it covers are left blank, the same way a grid extracted from a text layer arrives. What the header block is, which cells merged, and what the title says are read later, off the table image, by the steps that read every other table. ) annotationsN) HTMLParser)AnyDictListOptionalTuple) markdown_rows)Box ScannedTable tableCelltablez#]*\bid=[\"']([^\"']+)[\"']z<::table::>(.*?)<::/table::>c NURS5=(d 0n[U5n/nURS5=(d /HnURS5S:waMURS5nURS5=(d Sn[U5n [URU/5U 5upUR [ UU U [ X5=(d) URS5=(d 0RS5UUS 95 M UR[XU55 U$) aEvery table in one page's raw response, as a dense grid with per-cell boxes. `page` is the 1-based source page the submission came from. The response numbers its own single page from zero, so the source page is carried in rather than read back out of it. groundingchunkstyperidmarkdownboxpagecells cell_boxesrchunk_idjob_id) get_cells_by_chunk _cell_text _dense_gridappendr _table_boxextend_composite_tables) responserrrcells_by_chunktableschunkrr text_by_idrboxess 5/home/mande/repo/quber/src/quber/core/figures/grid.pyscanned_tablesr,7s [)/RI$Y/N!#Fh'-2- 99V  ' 99T?99Z(.B) ">#5#5h#CZP   x3` +8N8TRT7Y7YZ_7`!   .$ MM#HF;< Mc ^/nURS5=(d /GHnURS5S:waM[RURS5=(d S5Hn[U5nU(dM[ SU55nUVs/sHoS/U[ U5- --PM n nUR [UU U V s/sH n S/U-PM sn URS5=(d 0RS 5URS 5US 95 M GM U$s snfs sn f) aThe tables the scan printed inside a figure's text rather than as chunks. The figure's own box stands as the table's box. It is the only geometry the scan grounded for the composite, and it is drawn around the chart and the table together, so the region is generous rather than wrong. rrfigurerrc38# UHn[U5v M g7fN)len).0rs r+ $_composite_tables..gs-1AsNrrrr)r_FIGURE_TABLE_REfindallr maxr2r!r ) r%rroutr(rrowswidthr4r_s r+r$r$Xs!Ch'-2- 99V  ( (00:1F1L"MH *D---E:>?$Q"Q00$E? JJ8=>1>;/52::5A"YYt_!   N.& J@ ?s D%D*c0nUR5Hrup#URS5[:waM URS5=(d 0nURS5nUcMPURU/5R X#45 Mt U$)zMThe grounding map's cell entries, grouped by the table chunk each belongs to.rpositionr)itemsr CELL_TYPE setdefaultr!)rby_chunkcell_identryr?rs r+rrvs}<>H#//+ 99V  ) 99Z(.B<< +   Hb)00'1AB, Or-c[RU5nUcgURURS55=(d 0nURS5[:XaURS5$S$)zEThe box around the table itself, from the id its opening tag carries.Nrr) _TABLE_ID_REsearchrgroup TABLE_TYPE)rrmatchrEs r+r"r"sY    )E } MM%++a. ) /RE$yy0J>599U HDHr-c l/nSnSnUHupVURS5=(d 0n[URSS55n[URSS55n [X8[URSS5=(d S5-5n[XI[URSS5=(d S5-5nURXURUS5URS 545 M [ U5V s/sHn [ U5V s/sHn SPM sn PM! n n [ U5V s/sHn [ U5V s/sHn S PM sn PM! n n UH:uppSUs=::aU:dMO MSU s=::aU:dM(O M,XUU 'XUU 'M< X4$s sn fs sn fs sn fs sn f) zOne row per row and one column per column, with a box beside every cell. A cell that spans is written at its own row and column; the positions it covers stay blank and carry no box of their own, so the grid never states the same value twice. rr?rowcolrowspanrGcolspanrrN)rintr9r!range)rr)placedr;columnsrDrEr?rNrOr=gridr*textrs r+r r s9;F DG99Z(.B(,,ua()(,,ua()4s8<< 1#=#BCCDgSi)C)Hq%IIJ s!NOP  38+ >+Qw (AR (+D >PUVZP['\P[1uW~(F~!~(FP[E'\%$ ?d??qC1'11!IcN!#JsO & ; ) >(F'\s0F' F" !F'7F1 F, F1"F',F1cX^\rSrSrSrS U4SjjrS SjrS SjrS SjrS Sjr Sr U=r $) _CellTextzCollects the text of every `td`/`th` carrying an id, keyed by that id. Markup inside a cell is dropped and its text kept, so a value typeset with an emphasis or a line break reads as the one string the page prints. cJ>[TU]SS9 0Ul/Ul/Ulg)NT)convert_charrefs)super__init__rW_open_parts)self __class__s r+r^_CellText.__init__s( $/$& *, !# r-cUS;aDUR5 URR[U5R S55 gUS:Xa.UR(aUR RS5 ggg)Ntdthrbr )_flushr_r!dictrr`)ratagattrss r+handle_starttag_CellText.handle_starttagsX ,  KKM JJ  d5kood3 4 D[TZZ KK  s #([r-c2US;aUR5 gg)Nre)rj)rarls r+ handle_endtag_CellText.handle_endtags ,  KKM r-c^UR(aURRU5 ggr1)r_r`r!)radatas r+ handle_data_CellText.handle_datas :: KK  t $ r-cUR(dgURR5nUbESRSRUR5R 55UR U'/Ulg)Nrir)r_popjoinr`splitrW)rarDs r+rj_CellText._flushsVzz **.."  !$"''$++*>*D*D*F!GDIIg  r-)r_r`rW)returnNone)rlstrrmzList[Tuple[str, Optional[str]]]r|r})rlr~r|r})rtr~r|r}) __name__ __module__ __qualname____firstlineno____doc__r^rnrqrurj__static_attributes__ __classcell__)rbs@r+rYrYs& $ $%r-rYcp[5nURU5 UR5 UR$)z:Each cell's printed text, keyed by the id its tag carries.)rYfeedcloserW)rparsers r+rrs( [F KK LLN ;;r-)r%Dict[str, Any]rrRrz Optional[str]r|zList[ScannedTable])rrr|z+Dict[str, List[Tuple[str, Dict[str, Any]]]])rr~rrr|z Optional[Box])rz List[Tuple[str, Dict[str, Any]]]r)Dict[str, str]r|z1Tuple[List[List[str]], List[List[Optional[Box]]]])rr~r|r)r __future__rre html.parserrtypingrrrrr 1quber.core.extractors.set_of_mark.merge_groundingr quber.core.figures.modelsr r rArKcompilerHDOTALLr7r,r$rr"r rYrr-r+rs># "33K7   zz@A ::=ryyIB< I +7<" "Jr-