j7SrSSKJr SSKrSSKrSSKrSSKJr SSKJ r J r J r J r J r JrJrJr SSKJr SSKJrJr SSKJr SS KJrJr SS KJrJr S rS rS r S r!Sr"S6Sjr#\4S7Sjjr$"SS\5r%"SS\5r&"SS\5r'S8Sjr(S9Sjr)\!\"4S:Sjjr*\\4S;Sjjr+SS?Sjjr/S@S jr0SAS!jr1S"r2SBS#jr3S$\4SCS%jjr4S"r5Sr6SDSES&jjr7S'r8S(r9SFS)jr:SGSHS*jjr;\<"1S+k5r=S,r>S-r?SIS.jr@\"S/S0\ 55rA"S1S25rB"S3S45rCSJSKS5jjrDg)Lu GridLocator — Set-of-Mark table flagging. The grid locator finds every table and its region for the default Set-of-Mark engine and for the dual engine. The camelot correspondence engine also calls it lazily, when a detector box has drifted off its table. The raw detector bbox drifts: a vision model asked for continuous coordinates emits a discretized, often evenly-spaced grid that walks off the actual tables on repetitive/stacked layouts (measured on stacked4 and real TMUS/Visa pages). This module sidesteps that failure mode. Instead of asking the model for coordinates, it overlays a *labeled* grid on the rasterized page (numbered rows, lettered columns) and asks which grid cells each table occupies. The model reports discrete row/column IDs — reading printed labels, which it does reliably — and the grid, being ours, maps each ID back to an exact coordinate. The coarse cell region is then tightened to the page's text layer for a precise box. This follows the Set-of-Mark / coordinate-scaffold line of visual prompting: - Yang, Zhang, Li, Zou, Li, Gao, "Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4V," arXiv:2310.11441 (2023): overlay labelled marks on the image so the model answers by reading the marks rather than predicting continuous coordinates. - Lei, Yang, et al., "Scaffolding Coordinates to Promote Vision-Language Coordination in Large Multi-Modal Models," arXiv:2402.12058 (2024): overlay a labelled coordinate grid as positional anchors the model reads. Overlaying a labelled row/column grid and reading back grid IDs in place of continuous coordinates is the direct application of that work here. The model is asked to bound the WHOLE table, not just its data grid: the title/caption, units line, multi-level column headers, the row-label stub column, the body and total rows, and any footnotes attached to the table. After the text-layer tighten, each box is grown by a small fixed margin so a downstream crop does not clip an edge, and two declash passes settle the seam between overlapping neighbours: a stacked pair gets a horizontal seam through the widest blank band near the model's row boundary, a side-by-side pair a vertical seam through a blank column in the overlap. Which pass a pair gets is the model's call, read off the grid column spans it reported. A side-by-side pair whose overlap holds no blank column keeps the overlap, so a shared column can land in both boxes. When tightening finds no text (an image-only region), the coarse grid region is kept; a region is never dropped. ) annotationsN)Path)AnyDictListOptionalProtocolSequenceTupleruntime_checkable)logger) BaseModelField)supports_sampling_temperature)LangSmithTracerusage_metadata_from)DEFAULT_LLM_MODEL get_settings$ g@g$@c([RSU$)z>     "B!|6<< 22rc\rSrSr%Sr\"SSS9rS\S'\"SS S 9rS \S '\"S S9r S\S'\"SS9r S\S'\"SS9r S\S'\"SS9r S\S'Sr g) LocatedTableguA table flagged by the grid locator, with a tightened region. `region` is normalized 0..1 with the page's top-left as origin (x1, y1, x2, y2) — the same frame as `DetectedTable.bbox`, so it drops straight into the correspondence/recovery geometry. `tightened` records whether the region was snapped to the text layer (False means the coarse grid cell was kept because no text was found there). z*1-based reading-order position on the pagege descriptionintordinalz*Visible caption or one-line column summarydefaultr,strtitlezBTightened region, normalized 0..1 top-left origin (x1, y1, x2, y2)r,!Tuple[float, float, float, float]regionz6Grid row span the model reported (start, end), 1-basedTuple[int, int] grid_rowsz0Grid column span as 0-based indices (start, end) grid_colszFTrue if snapped to the text layer; False if coarse cell kept (no text)bool tightenedN)__name__ __module__ __qualname____firstlineno____doc__rr.__annotations__r3r6r8r9r;__static_attributes__r<rrr'r'gsxA+WXGSXr/[\E3\05X1F -"'3k!lIl!&3e!fIf\Itrr'c\rSrSr%\"SSS9rS\S'\"SSS 9rS \S '\"S S 9rS\S'\"SS 9r S\S'\"SS 9r S \S'\"SS 9r S \S'Sr g)GridFlagr)z91-based reading order (top-to-bottom, then left-to-right)r*r-r.r/z/Visible caption, else a one-line column summaryr0r2r3z/Printed grid row number at the table's TOP edger4 row_startz2Printed grid row number at the table's BOTTOM edgerow_endz3Printed grid column LETTER at the table's LEFT edge col_startz4Printed grid column LETTER at the table's RIGHT edgecol_endr<N) r=r>r?r@rr.rBr3rGrHrIrJrCr<rrrErEsfA+fgGSgr/`aE3a'XYIsY%YZGSZ'\]Is]%[\GS\rrEc,\rSrSr%\"\S9rS\S'Srg)GridFlagResult)default_factoryzList[GridFlag]tablesr<N) r=r>r?r@rlistrOrBrCr<rrrLrLs"48FN8rrLc[U5SnSUSUSUSUS[R"[R 5SS9S 3 $) Nz$The page image has a grid overlaid: z+ numbered horizontal rows (1 at the top to z2 at the bottom, labeled on BOTH side margins) and z$ lettered columns (A at the left to u at the right, labeled on the top and bottom margins), with thin gridlines. WHAT COUNTS AS A TABLE: a block where values are arranged in a GRID — the same two or more columns line up vertically across multiple rows. These are tables. The following are NOT tables, even when they contain dollar amounts or numbers, and must never be flagged: a bulleted or numbered list; a single column of figures; a heading followed by prose sentences; a paragraph. If the numbers do not line up into repeating vertical columns, it is not a table. Find every TABLE on the page and report the grid region that bounds each one COMPLETELY. Bound the WHOLE table, including all of its parts: - TITLE / CAPTION: the table's heading line(s) and any units line directly above the columns (e.g. "Condensed Consolidated Statements of Income", "(In millions)", "(UNAUDITED)"). Include them in the region. - COLUMN HEADERS: every header row, including multi-level / spanning headers (a label like "Three Months Ended" that sits above several sub-columns, with the period and year rows beneath it). Include all header levels. - ROW LABELS (the stub column): the left-hand column of row names. The region's LEFT edge must include it — do not start at the first number. - BODY: every data row, including subtotal and total rows. Never cut a table off partway; blank lines inside a table do NOT end it. - FOOTNOTES: short notes tied to the table by a marker (e.g. "(1)", "(2)") sitting just below it. Include them inside that table's region. Footnotes are NEVER a table of their own — never report them as a separate table. Counting tables — judge by what you see, not by repeated text: - Two tables stacked vertically are separate ONLY when each has its own title/caption and its own column-header block. Report them separately. - Two tables printed SIDE BY SIDE, one to the left of the other in the same rows, are separate tables. Report each with its own column span. - One table may have section sub-headings inside it (e.g. "Cash flows from operating activities:", "Current assets:") and blank lines between sections. These do NOT start a new table — keep the whole thing as ONE region. - Repeated "$" signs or a repeated subtotal style inside one table do NOT make a new table. When unsure, prefer ONE region over splitting. Do NOT merge two genuinely separate tables, and do NOT split one table. Exclude page furniture (running header timestamp, page number, document URL) and free-standing prose paragraphs / lists that are not a table. For each table, in reading order (top-to-bottom, then left-to-right), report: - ordinal (1 = first) - title (its visible caption, else a one-line summary of its columns) - row_start: printed row number at the TOP of the title line (one row ABOVE the column headers when a title/caption is present) — include the title row - row_end: printed row number at the BOTTOM-most part (last total, or footnote) - col_start: printed column LETTER at the left edge, INCLUDING the row labels - col_end: printed column LETTER at the right edge (last data column) Read the printed labels off the grid — do not estimate coordinates. Return ONLY a JSON object conforming to this schema (no prose, no code fences): )indent )rjsondumpsrLmodel_json_schema)rowsrlasts r build_promptr[si  r "D%%)F+ v ?vF&7!nN , , .q9:;u; ;rc[SUS- U- 5n[SX- 5n[SX%- 5n[SUS-U- 5n XX4$)zCoarse grid cell span -> normalized 0..1 top-left box. Rows are 1-based and inclusive (a table on rows 4..6 spans the top of row 4 to the bottom of row 6). Columns are 0-based inclusive indices. r)?)maxmin) rGrH col_start_idx col_end_idxrYry0y1x0x1s rgrid_region_normrgsV S9q=D( )B S'. !B S-& 'B S;?d* +B B rcf[USUS5U-n[USUS5U-n[USUS5U-n [USUS5U-n UV s/sH(oU- U SU S-S- s=::a X-::dM"O M&U PM* n n U(a6U V s/sH(oU- U SU S-S- s=::a X-::dM"O M&U PM* n n OU n U (dg[SU 55n[SU 55n[S U 55n[S U 55nX- X- UU- UU- 4$s sn fs sn f) uSnap a coarse grid region to the page's text layer. The grid region's vertical span is reliable (rows separate stacked tables); within it, take the words and tight-box them. When the table is vertically alone (`shares_rows` False) the full horizontal extent of those words is used — recovering a label column the model clipped. When it shares its rows with a side-by-side neighbour, selection is confined to the flagged column range so neighbours do not merge. `words` are PyMuPDF word tuples (x0, y0, x1, y1, text, ...) in PDF points, top-left origin. Returns the tightened normalized box, or None when no word falls in the region (an image-only region — the caller keeps the coarse region rather than drop it). rrSr)@Nc3*# UH oSv M g7f)rNr<.0ws r !tighten_region.. CqdCc3*# UH oSv M g7f)r)Nr<rls rrorprqrrc3*# UH oSv M g7f)rSNr<rls rrorprqrrc3*# UH oSv M g7friNr<rls rrorprqrrr`r_) region_normwordspage_wpage_h shares_rowsy_padx_padrerfrcrdrnin_yseltx0ty0tx1ty1s rtighten_regionrsP. [^[^ ,v 5B [^[^ ,v 5B [^[^ ,v 5B [^[^ ,v 5B Pu!U qtad{c.A ORZ OA OAuD PR$Qu*1!0C"Qrz"Qq"Qq$R  C C C C C C C C L#,f cFl CC QRs$!D)>D)D)!D.:D.>D.c~SSKJnJnJn UR U5R S5nUR U5nURSS5n [U5n URU- n URU- n [US-5Hn X-nURSU4URU4/SSS9 X:dM/URS US -4[!U S-5S U S 9 URURS - US -4[!U S-5S U S 9 M [US-5HnnX-nURUS4UUR4/S SS9 X:dM/URUS-S 4XSU S 9 URUS-URS- 4XSU S 9 Mp UR#U5 g![a UR5n GNlf=f)z8Draw a labeled row/column grid on a rendered page image.r)Image ImageDraw ImageFontRGBz4/usr/share/fonts/truetype/dejavu/DejaVuSans-Bold.ttfr))Px)fillwidthrS)(r)rfont)rrri)nrN)PILrrropenconvertDrawtruetype Exception load_defaultrheightrrangelinetextr2save) image_pathout_pathrYrrrrimgdrawrr#rstepcsteprycixs r overlay_gridr s0/ **Z ( ( /C >># D(!!"XZ\]4 F JJ E II E 4!8_ I Aq6CIIq>*q I 8 IIq!a%j#a!e*=tI L IIsyy2~q1u-s1q5z TXI Y  D1Ho J Aq6Aszz?+-q I 9 IIq1uaj&*=tI L IIq1ucjj2o. UYI Z  HHX# (%%'(sFF<;F<c ^ /nUHm [U 4SjU55n[T RU5n[T RU5n X:aXp[ T R T R XXE5n [XX#U5n UR[T RT RU bU OU T R T R 4X4U SLS95 M U$)a"Turn the model's grid-ID flags into tightened LocatedTables. `shares_rows` for each flag is computed against the other flags: a flag whose grid-row span overlaps another's is treated as side-by-side and tightened within its columns; otherwise it snaps to the full word extent in its rows. c3># UHMoTL=(a> TRUR:=(d TRUR:(+v MO g7fN)rHrG)rmofs rro#flags_to_located..8sClfkabaZ\Q[[)@)[AKKRSR[R[D[$\\fksAAN)r.r3r6r8r9r;) anyr%rIrJrgrGrHrappendr'r.r3) flagsryrzr{rYrlocatedsharesc0c1coarsetightrs @rflags_to_locatedr's#%G lfkll !++t , !))T * 7!!++qyy"$MvffE  gg % 1uv;; 2(t+   $ Nrc DX1- X2- pT/nUHnURupp[S[X5U- 5[S[X5U- 5[S[X5U-5[S[X5U-54n URUR SU 0S95 M U$)aSGrow every region by a fixed margin on all sides, clamped to the page. A guidance box should over-include slightly rather than clip, so a plain symmetric pad covers residual sub-row edge misses without any content-dependent heuristic. Any overlap this creates between stacked tables is resolved by `declash_stacked`, which runs after it. r]r^r6update)r6r_r`r model_copy) rrzr{pad_ptspxpyouttrercrfrdr6s r pad_boxesrLs w/ C  S[2% & S[2% & S[2% & S[2% &   1<<&'9<:; Jrg?@c RUVs/sHAocUSUS-S- s=::aU::dMO M!XSUS-S- s=::aU::dM;O M?UPMC nnURSS9 /nUHnUSUS-S- n U(aWXSS - U::aIUSn [U S US5U S '[U S US5U S 'XS 'U S RU5 MoURXSUSU/S .5 M UH*n SR S[ U S SS955U S'M, U$s snf)aGroup page words into printed text rows within a window. Words whose centers fall outside the window [x0, x1] x [y_lo, y_hi] are discarded. The rest, taken top to bottom by vertical center, join the current row when their center is within `tol` points of the last word added to it. Otherwise they start a new row. Each returned row carries its top edge, bottom edge and left-to-right joined text. Rows come back ordered top to bottom. `words` are PyMuPDF word tuples (x0, y0, x1, y1, text, ...) in PDF points, top-left origin. r)rirjrrScUSUS-S- $)Nr)rirjr<rns r#cluster_text_rows..~sAaD1Q4K3.rkeyrRcentertopbottomry)rrrry c3*# UH oSv M g7f)Nr<rls rro$cluster_text_rows..sV-Ut-Urrc US$Nrr<rs rrrs PQRSPTrr)sortr`r_rjoinsorted) ryrerfy_loy_hitolrnrrYrrows rcluster_text_rowsrksU$ ge!qt s':BdB1B1rPQdUVWXUYk]`M`GfdfGf1Gf1eC gHH.H/!#D A$1+$ F"Xh//36r(CSZ1.CJH qt4CM"M L   " KK6A$!A$RSQTU VhhVVCLn-UVVF  K hsD$D$D$D$D$c[XX#U5n[U5S:agSupg[XUSSSS9H%upU SUS- n X:dMXSU S-S - pvM' U$) uMidpoint of the widest blank band between consecutive text rows in the window [y_lo, y_hi] (PDF points), or None when fewer than two rows fall in it. Two stacked tables are separated by a blank band wider than the spacing between rows inside either table, so the widest gap in a window centred on their boundary is the seam — independent of whether the rows on each side are totals, titles, headers or plain data. rSN)gNr)Fstrictrrrj)rlenzip) ryrerfrrrYbest_gapseamr lowergaps rwidest_gap_seamrsu U$ 7D 4y1}NHDqr(59 ElU8_, > ?U5\#AS"Hd: Krcp[USUS5U-n[USUS5U-n[USUS5U-nUVs/sHKnXXSUS-S- s=:a US- :dM O M$US- USUS-S- s=::a US-::dMEO MIUPMM n n[[SU 5US9U5$s snf) asPull the upper box's bottom up to its own last line of text above the lower box's top. `declash_stacked` uses this when `widest_gap_seam` finds no band near the model's row boundary, or finds one outside the two boxes' combined vertical span. Returns the new upper-box bottom in PDF points (top-origin); never reaches below the lower box's top, so the boxes still tile. r)rirrSrj?c3*# UH oSv M g7frvr<rls rro fallback_seam..s)&QaD&rr)r1rw) upper_region lower_topryrzr{u_topux0ux1rninsides r fallback_seamrs  Qa 1F :E l1o|A /& 8C l1o|A /& 8CA aD1Q4K3& 8S 8 8 =@3Y1Q4RSTURV;Z]J]=jadgjaj=j =j   s)&)9=y II sB3'B3+B3 B3B3rc[U5[U5p2[U5[U5pT[X55[X$5- S-n[X2- XT- 5S-nUS:aXg- $S$)zFraction of the narrower grid-column span shared by the two spans. Spans are the locator's 0-based inclusive (start, end) column indices. r)rr]rw)aba0a1b0b1sharednarrowers rcol_span_overlap_fractionrsb VSV VSV [3r; & *F27BG$q(H & 6 33rrjc n^[[[T55U4SjS9n[[T55Vs0sHowTUR_M nnX5- n [ XfSSSS9GHupXXpTU R TU R p[ X5[:aM?[U SU S5n[U SU S5U-n[U SU S5U-n[U SU S5nUUU- ::aMTU RSU- TU RSS- U- -S - U-n[U SU S U SU S 5U-S - n[U SU S U SU S 5U-S -n[UUUU[U -- U[U --5nUb:UU-Us=:a UU-:a'O O$UU- nU SUU S U4X'U SUU S U4X'GMl[U UXU5nU SUU S UU- 4X'GM [[T55Vs/sHnTURS X0S 9PM sn$s snfs snf) uSet the seam between two stacked boxes to the blank band between the two tables, so neither box trades a row with its neighbour. When an upper box's bottom runs into the next box's top — grid quantization, padding, or an upward tighten can pull one box over a row belonging to the other — take the model's row-span boundary between the two tables as a coarse anchor, find the widest word-free band within about a grid row of it, and snap both the upper box's bottom and the lower box's top to its midpoint. Each table keeps every one of its own rows, whatever they are. When no gap is found in the window, fall back to pulling the upper box's bottom up to its own last line of text. Only cleans the seam; it never merges two boxes or splits one. Only pairs the locator placed in the same column band get a seam: whether two tables are stacked is the locator's call, read off the grid column spans it reported. A pair whose spans share less than `STACKED_MIN_COL_OVERLAP` of the narrower span is side-by-side, and a seam through it would cut real rows from both tables. Such pairs pass through untouched. `words` are PyMuPDF word tuples (x0, y0, x1, y1, text, ...) in PDF points, top-left origin — the same frame `tighten_region` uses. c\>[TURSTURS5$)Nr)rir`r6irs rr!declash_stacked...c'!*:K:KA:NPWXYPZPaPabcPd6errr)NFrrirrjrSr6r)rrrr6rr9rSTACKED_MIN_COL_OVERLAPr`r_r8rSEAM_WINDOW_ROWSrr)rryrzr{ min_gap_ptsrYorderrregionsrow_hr rrurlcols_ucols_l u_top_normu_bottoml_top l_bottom_normboundarywx0wx1r seam_norm new_bottoms` rdeclash_stackedrs> 5W&,e fE-23w<-@A-@'!*###-@GA MEE9U; B 1175>3K3K $V 47N N A1& r!ube$v-BqE2a5!F*BqE2a5) u{* * U^ % %a (4 /75>3K3KA3NQR3RVZ2Z Z^a adj j "Q%A1r!u-6<"Q%A1r!u-6< 3X(85(@@(M]`eMeBe    V 3d S]V=S Sv I eZA BGN eY1}EGN&r5%HJ eZA V8KLGN5<6KPPST[P\J] ^J]QGAJ ! !(GJ)? ! @J] ^^;B: _s H- H2c [XX#U5n[U5S:a/$Sn[X!- U- 5S-nS/U-n UHon U SHcn [S[U SU- U- 55n [ US- [U SU- U- 55n [ XS-5HnX==S- ss'M Me Mq [ [U5-n/nSnX:a~XU:aUS- nMUnUS-U:a(U US-U::aUS- nUS-U:aU US-U::aMUU- S-U-U:a!URXU--UUS-U--45 US-nX:aM~U$)aEvery ink-free vertical band at least `min_width_pts` wide in the window [x0, x1] x [y_lo, y_hi] (PDF points), as (left edge, right edge) pairs in left-to-right order; empty when the window holds fewer than two text rows. A band is measured per printed text row: each row's words are projected onto x, and a band counts as blank when at most `SEAM_MAX_CROSSING_ROWS` of the rows have ink in it. An introductory sentence printed across the whole page crosses the seam between two tables, and every row of both tables respects it; a gap between two columns inside one table is blank in the same way, which is why the caller, not this function, decides which band is the seam. rSrr)rry)rrr-r_r`rSEAM_MAX_CROSSING_ROWSr)ryrerfrr min_width_ptsrYstepncoveragerrnrrrallowedbandsjs rblank_column_bandsr&)s( U$ 7D 4y1} D RW !AsQwHWAAsAaD2I-./AAE3!r T123A1!e_ q % %s4y0G')E A % ; FA  !eaiHQUOw6 FA!eaiHQUOw6 EAI  . LL"4x-q1un)<= > E % LrgV@g333333?c[XU[-X#5nUVs/sH"oUS(dM[USSS9SSPM$ nn[U5S:ag[ SU55nU[U5- [ :$s snf) aWhether the column of text just right of `band_right` reads as a row-label column: on most rows its first word starts with a letter. A financial table's first column names its rows; its other columns hold figures. So of the blank bands inside two side-by-side boxes' overlap, the one followed by a column of words is the seam between the tables, and one followed by a column of figures is a gap inside the left table. ryc US$rr<rs rr%stub_column_follows..lsqtrrrrrSFc3X# UH oSSR5(dMSv M" g7f)Nr))isalpha)rmrs rro&stub_column_follows..os56arU]]_6s* *)rSTUB_LOOKAHEAD_PTSrrsumSTUB_MIN_ALPHA_FRACTION)ry band_rightrrrYrfirstsalphas rstub_column_followsr3`s U =O0OQU \DDH WDqgJ:fQwZ^4Q7:DF W 6{Q 565 5E 3v; "9 99 Xs A;A;c D^^[[T55Vs0sHoUTUR_M nn[[[T55U4SjS9n[ XwSSSS9GHnupXhXip[ TUR TU R 5[:aM=[U SU S5U-n [U SU S5U-n XU- ::aMq[[U SU S 5[U SU S 55U-n[[U SU S 5[U SU S 55U-nX::aM[X[- U [-X5n[U SU S5U-n[U SU S5U-nUVVs/sH#unnUUU-S - s=:aU:dMO MUU4PM% nnnU(d[R"S U U 5 GMoTUR SS-[- TU R S[- -S - U-mUVs/sHn[UUSX5(dMUPM nn[U=(d UU4S jS9nUSUS-S - nUU- n[U SU S5[U SU S 5U[U SU S 54Xh'U[U SU S 5[U SU S5[U SU S 54Xi'GMq [[T55Vs/sHnTUR!S Xe0S9PM sn$s snfs snnfs snfs snf)aSet the seam between two side-by-side boxes to the blank column between the two tables, so neither box trades a column with its neighbour. The counterpart of `declash_stacked` for pairs the locator placed in different column bands of the same rows. The grid columns are coarse, so a left table's span and a right table's span usually share an edge column; the tighten then admits words from the neighbour's stub column into both boxes, and Camelot reads that column into both tables. Search the two boxes' overlap for blank columns and snap the left box's right edge and the right box's left edge to the midpoint of one. A blank column that a row-label column follows is preferred. When none qualifies, the blank column nearest the model's coarse column boundary is used, and it can be a gap inside the left table. When the overlap holds no blank column at all, the pair passes through untouched: a wrong seam would cut a real column, and the overlap is at worst a duplicated one. Only pairs whose regions overlap vertically and whose column spans share less than `STACKED_MIN_COL_OVERLAP` of the narrower span are considered; stacked pairs are `declash_stacked`'s business. c\>[TURSTURS5$)NrrSrrs rr&declash_side_by_side..rrrr)NFrrrSrirjzWdeclash_side_by_side: no blank column in the overlap x={:.0f}-{:.0f}pt; pair left as isc8>[USUS-S- T- 5$)Nrr)rj)abs)bdrs rrr6s bebems5JX5U1Vrr6r)rrr6rrrr9r r_r`r&SEAM_OVERLAP_PAD_PTSr debug DEFAULT_COLSr3r)rryrzr{r rr r rrleftrightl_x1r_x0rrr$l_x0r_x1rrbandstubrrrs` @rdeclash_side_by_siderEssd6.33w<-@A-@'!*###-@GA 5W&,e fEE9U3j'*e $WQZ%9%971:;O;O PTk k 47DG$v-58U1X&/ +% % 3tAwQ(#eAha*ABVK3tAwQ(#eAha*ABVK < # ..7K0KT 47DG$v-58U1X&/(-Ofb"bC1N$1N1N"bO LLi  aj""1%)\ 9GAJrr^c^[USS5n[U[5(a U[;ag[ U5R R 5m[U4SjS55$)uTrue for failures that a short backoff is likely to clear (rate limit, overload, timeout) — as opposed to a malformed request or auth error, which will fail identically on retry. status_codeNTc3.># UH nUT;v M g7frr<)rmtokennames rro)is_transient_llm_error..s  E   s) ratelimitoverloadtimeout apiconnectioninternalserverserviceunavailable)getattr isinstancer-TRANSIENT_LLM_STATUStyper=rr)excstatusrRs @ris_transient_llm_errorr`s_S- .F&#6-A#A 9   # # %D      rc\rSrSrSSjrSrg) GridLocatoric # g7frr<)self page_imagesourcepages rlocateGridLocator.locates]`sr<Nrerrfrrgr-returnList[LocatedTable])r=r>r?r@rhrCr<rrrbrbs`rrbct\rSrSrSrSrSSS\\\S4S SjjrS Sjr S Sjr SS jr S r g)PydanticAIGridLocatorizGridLocator backed by pydantic-ai with an Anthropic vision model. Mirrors `PydanticAITableDetector`: same auth resolution (`ANTHROPIC_AUTH_TOKEN` preferred over `ANTHROPIC_API_KEY`), greedy decoding for run-to-run stability of the discrete grid IDs. r]NcjSSKJn SSKJn SSKJn SSKJn [5Rn U=(d, U R=(d U R=(d [nUb[U5(dSnU=(d U Rn U=(d U RnU (aSSKJn U"X5nO U(aU "US9nU "UUS9nO [%S 5eXl XPlX`lXplUcSOU "US 9n[-XV5UlU"U[0UR.US 9Ul[5S S 9Ulg)Nr)Agent)AnthropicModel)AnthropicProvider) ModelSettings)make_oauth_anthropic_model)api_key)providerzuPydanticAIGridLocator: neither ANTHROPIC_AUTH_TOKEN nor ANTHROPIC_API_KEY is set. Provide one via env or constructor.) temperature) output_type system_promptmodel_settingszquber-grid-locator)run_name) pydantic_airqpydantic_ai.models.anthropicrrpydantic_ai.providers.anthropicrspydantic_ai.settingsrtrllmgrid_locator_modelmodelrranthropic_auth_tokenanthropic_api_keyquber.agents._oauth_gateru RuntimeErrorrYrdpir[rzrLagentrtracer)rdr auth_tokenrvrxrYrrrqrrrsrt llm_settings resolved_auth resolved_keyru anth_modelrwr{s r__init__PydanticAIGridLocator.__init__s &?E6#~)) c88cLH'AJP     !,!4-T_:`)$5 &,,)   &/CD rc>SSURS.SSSS.SS S./S./0$) NmessagessystemrolecontentuserrFlag the tables using the grid.)r]rimagez[gridded page image attached])rz)rds r trace_inputs"PydanticAIGridLocator.trace_inputssA !d.@.@A"!'1RS!(2QR    rc6# SSKnSSKJn SSKJn [ R "SS9n[U5S- nUR[[U5XRUR5IShvN U"UR5SS9n UR5n URRS XR S 9IShvN n UR#X5IShvN n S U R$R'5S ./[)U R$R*5[-U R.5S .U lSSS5IShvN URU[U5U5IShvN upnSSS5 [3W R$R*WW WURUR5n[5UX[65n[9UXXRS9n[;UXU5nU$GNsGN$GNN!,IShvN (df  N=fN!,(df  N=f7f)Nr) BinaryContent) page_wordsz quber-grid-)prefixz gridded.pngz image/png)data media_type grid_locate)r assistantr)r table_countusage_metadata)rY)asyncior}rquber.agents.completenessrtempfileTemporaryDirectoryr to_threadrrYr read_bytesrrllm_runrrun_locator_with_retryoutputmodel_dump_jsonrrOrusageoutputsrr BOX_PAD_PTSrrE)rdrerfrgrrrtmpgriddedrinputsrunresultrzr{ryrs rrhPydanticAIGridLocator.locate+s-8  ( ( >#3i-/G##L$z2BGYYX\XaXab b b!w'9'9'; TE&&(F{{**=& *SSWZ#::5GG*5&--B_B_Ba!b c#&v}}';';#<&9&,,&G TS+2*;*;JV VZ*[$[ !FE?#6==#7#7PTPYPY[_[d[deGV[A!'5&yyQ&wvF cTGTSSS%\? >s%HAH.G!/AHG$HG,G'AG,5 HG*#H$H%H,A5H!H$H'G,*H,H 2G53 H ?H HHc # SSKn[S[S-5H)nURR SU/5IShvN s $ gN ![ anU[:Xd[ U5(d[R"SUU[U5 e[SUS- --n[R"SUU[UU5 URU5IShvN SnAMSnAff=f7f)aRun the grid-locate call, retrying transient LLM failures with exponential backoff. A page that still fails after the retry budget is raised, never swallowed: returning no flags would silently drop every table on the page with no record in the output -- on a financial document an undetected page is a liability, not an acceptable omission. TODO: offer a graceful-degradation mode that records a failed-page marker and continues with a non-zero exit, instead of aborting the whole run. Failing hard for now. rNr)rzegrid_locate: LLM call failed page={} attempt={}/{}; aborting (refusing to silently drop the page): {}rSzKgrid_locate: transient LLM error page={} attempt={}/{}; retrying in {}s: {}) rrGRID_LOCATE_MAX_ATTEMPTSrrrr`r errorGRID_LOCATE_BACKOFF_BASE_Swarningsleep)rdrrgrattemptr^delays rr,PydanticAIGridLocator.run_locator_with_retryGs Q 81 <=G +!ZZ^^-NPU,VWWW>W +66>TUX>Y>YLLC0 2Q7Q;5GGa, mmE***) +sKC# A AA C#A  C A;CCCC#C  C#)rrrrrYrzr)r Optional[str]rrrvrrxOptional[float]rYr-rr-rr-rkNone)rkzDict[str, Any]rj)rrrgr-rkr) r=r>r?r@rADEFAULT_TEMPERATURE DEFAULT_ROWSr<rrrhrrCr<rrrnrns $$(!%':  1E1E"1E 1E % 1E  1E1E1E 1Ef  8$+rrnc0\rSrSrSrSSSjjrS SjrSrg) MockGridLocatorinz(Returns canned LocatedTables. For tests.Nc$U=(d /Ulgrr)rdrs rrMockGridLocator.__init__qs }" rc<# XU4n[UR5$7fr)rPr)rdrerfrg_s rrhMockGridLocator.locatets  &DLL!!srr)rzOptional[List[LocatedTable]]rkrrj)r=r>r?r@rArrhrCr<rrrrns2%"rrcU=(d [5RRnUS:Xa [5$US:Xa [ 5$[ SU<S35e)Napimockz$Unknown QUBER_GRID_LOCATOR_BACKEND: z. Expected api|mock.)rrgrid_locator_backendrnr ValueError)backendselecteds rget_grid_locatorrysRA,.,,AAH5$&&6  ;HrsX,\# ZZZ%>N:   ) +7 392]y]9Y9=F    14 CF NQ Y\ & *%$'D2'D $'D 'D  'D  'D  'D 'D1'DV3?L $,/FI <" " $" "  "  "  ""J #-2