joSSKrSSKrSSKJr SSKJrJrJr SSKJ r SSK J r J r SSK Jr SSKJrJrJr \R&"\5r"SS 5r"S S 5r"S S 5rg)N) defaultdict) BoundingBox DocItemLabelSize)TextCell)ClusterPage)BaseLayoutPostprocessorOptions)BoundingBoxSpatialIndexhas_positive_areaordered_bounding_boxcH\rSrSrSrSrSrSrS\\ \ \ 44Sjr Sr g ) UnionFindz:Efficient Union-Find data structure for grouping elements.ctUVs0sHo"U_M snUl[RUS5Ulgs snf)Nr)parentdictfromkeysrank)selfelementselems _/home/mande/repo/quber/.venv/lib/python3.13/site-packages/docling/utils/layout_postprocessor.py__init__UnionFind.__init__s1.67hdTzh7 MM(A. 8s 5cURUU:wa+URURU5URU'URU$N)rfind)rxs rrUnionFind.finds> ;;q>Q !YYt{{1~6DKKN{{1~cXURU5URU5pCX4:XagURUURU:aX0RU'gURUURU:aX@RU'gX0RU'URU==S- ss'g)N)rrr)rryroot_xroot_ys runionUnionFind.union"s1tyy|    99V tyy0 0"(KK  YYv 6!2 2"(KK "(KK  IIf  " r!returnc[[5nURH%nXRU5R U5 M' U$)z%Returns groups as {root: [elements]}.)rlistrrappend)rgroupsrs r get_groupsUnionFind.get_groups/s8T"KKD 99T? # * *4 0  r!)rrN) __name__ __module__ __qualname____firstlineno____doc__rrr'rintr+r.__static_attributes__r!rrrs-D/ #Dd3i0r!rc ~\rSrSrSrS\\4SjrS\4SjrS\4Sjr S\ S \ \ 4S jr S \ S \ S \S\S \4 SjrSrg)SpatialClusterIndex7z8Efficient spatial indexing for clusters using an R-tree.clusterscd[5Ul0UlUHnURU5 M gr)r spatial_indexclusters_by_id add_cluster)rr;clusters rrSpatialClusterIndex.__init__:s-4624G   W % r!r@cURRURUR5 XRUR'gr)r=insertidbboxr>rr@s rr?SpatialClusterIndex.add_clusterAs2 !!'**gll;*1GJJ'r!cURRURUR5 URUR gr)r=deleterDrEr>rFs rremove_cluster"SpatialClusterIndex.remove_clusterEs2 !!'**gll;    +r!rEr)cJ[URRU55$)aMFind cluster IDs whose bbox intersects ``bbox``. Every relation ``check_overlap`` accepts -- IoU or either containment ratio above a positive threshold -- requires a positive intersection area, so the R-tree query is already a superset of the pairs that can survive. Widening it further only adds candidates that are then rejected. )setr= intersection)rrEs rfind_candidates#SpatialClusterIndex.find_candidatesIs 4%%224899r!bbox1bbox2overlap_thresholdcontainment_thresholdc [U5n[U5n[U5(a[U5(dgURU5nURU5nURU5nXS:=(d Xd:=(d Xt:$)z)Check if two bboxes overlap sufficiently.F)r r intersection_over_unionintersection_over_self)rrQrRrSrTiou containment1 containment2s r check_overlap!SpatialClusterIndex.check_overlapTs%U+$U+ ''/@/G/G++E233E: 33E:   # 43 43 r!)r>r=N)r0r1r2r3r4r+rrr?rJrrMr5rOfloatboolr[r6r7r!rr9r97syB&g&272,g, :K :CH :   !  %    r!r9c \rSrSrSrSSS.SSS.SSS.S .r\R\R1r \R\R1r \ R\ 5r\R\R15r0\R"S _\R$S _\R&S _\R(S _\R*S _\R,S _\RS _\R.S _\RS _\R0S _\R2S _\R4S _\R6S _\R8S _\RS _\RS _\RS _r\R2\R.0rS \S \ \!S\"SS4Sjr#S\ \!4Sjr$S\ \!4Sjr%S\ \!4Sjr&S\!S\ \!SS4Sjr'\(S5S\ \!S\ \!S\)S\)S\*\+4 Sjj5r,S\ \!4Sjr-S\!S\!S \.S\/4S!jr0S"\ \!S \.S\!4S#jr1S6S \ \!S$\2S%\)S&\)S\ \!4 S'jjr3S \ \!S(\)S)\)S\!4S*jr4S+\ \5S\ \54S,jr6S7S \ \!S-\)S\ \!4S.jjr7S \ \!S\ \54S/jr8S \ \!S\ \!4S0jr9S+\ \5S\ \54S1jr:S8S \ \!S2\2S\ \!4S3jjr;S4r > @ $ > > @  00 0}} 0 00}} 4 44 !)) HH* 0  ,,! ,!M0IA,!  ,,  ! !D$9$9 9-  ||00) $ 0 0 ? $--E"&"2"25;;"?EK.*yy$$07;zz %%425djj/A2E %%/? ! s@LayoutPostprocessor._process_regular_clusters..s?->tt->r)defaultr#)rDrorE confidencerkre)rqrCONFIDENCE_THRESHOLDSroLABEL_REMAPPINGrir_assign_cells_to_clusterskeep_empty_clustersrkrFORMULA_find_unassigned_cellscreate_orphan_clustersmaxrn enumerater,rTEXTto_bounding_boxextendrrange_adjust_cluster_bboxes_remove_overlapping_clusters) rrxr;r@ unassignednext_idorphan_clustersicellconf prev_count_s rr}-LayoutPostprocessor._process_regular_clusterss** *||t99!''BB *   G}} 4 44 $ 4 4W]] C  ||00055h?H<<33$,#+}} 9M9M(M#+44X>JdllAA?T->->?KaO"$(4GA??D#**&{"."3"3!%!5!5!7'+#'&  50]Q& qAS]*  XJ228?LayoutPostprocessor._process_special_clusters..`*!++-"---! +r!keycfURR5UR*UR4$rrrs rrrwrr!)rrrrrormwidthheightrrtrErrrCONTAINER_TYPES_handle_cross_type_overlapsrqrW_set_cluster_childrenminrDrget)rrxrr page_arear@picture_clusterstable_clusterscontainer_clustersnested_clustersrerparent_by_child_idrrparentsrnested_regular_idsparent_by_regular_idnested_childrendirect_childrens rr~-LayoutPostprocessor._process_special_clusterss** *||t99!''BB *  ~~)))NN((4>>+@+@@ q= 0 /GMM\%9%99 ))+i7$> /  ( '!77l6J6J+JA'   << i &6U%5DDTDT9T!%5U::>9U( '!77d6J6J+JA'  ">>    ;;  -0B B  , +}} 4 44 +  $4 #3}}HXHX7XG#3  , +}} 4 44 +  );&G $444G<<66w||DsJ4   & &w 9 ' $E"4!3I::44Y^^DsJ!3  w06yy"88,%$%4 $35>>JJ>JO   "**Exx--"4!3I::44Y^^DsJ!3  w28$UXX.#+&,I-,E%))%((3y||C,  $444G'++GJJ79<<G4   & &y/O2S T, 03EEEk   V      " s+RR ARR!R R "RR!RR6"RR(R  R R%7R%-R*R*/-R/ R/(R4/-R: R:"-R?R?)-SSr@rc U(dgURUSS9UlURUR;ay[ [ SUR55[ SUR55[ SUR55[ SUR55S9UlURR(dfURURVVs/sHo3RHoDPM M snn5Ul URUR5Ul g/Ul gs snnf)NrDr{c3L# UHoRRv M g7fr)rElrrs rr.A0@ujjll0@"$c3L# UHoRRv M g7fr)rEtrs rrrrrc3L# UHoRRv M g7fr)rErrs rrrrrc3L# UHoRRv M g7fr)rEbrs rrrrrrrrr) rrrorrrrrErir_deduplicate_cellsrkr)rr@rrrs rr)LayoutPostprocessor._set_cluster_childrens ..xd.C ==D00 0&A0@0@AAA0@0@AAA0@0@AAA0@0@AA GL||00 33#*#3#3L#3%  #3LGM!,,W]];GMGM Ms&D: loserswinners iou_thresholdconf_tolerancec [5nUHrnUHinURRUR5U::aM.URUR- U:dMMUR UR 5 Mp Mt U$)aElect a winner for near-identical (loser, winner) label pairs. For each pair whose bboxes are near-identical (``IoU > iou_threshold``) AND whose confidences are within ``conf_tolerance`` of each other, the loser label is dropped so the winner label survives. Nothing else -- containment, area, downstream behaviour -- is considered. Pairs outside this envelope (low IoU, or a clearly more confident loser) are left alone for other passes to handle. )rMrErVraddrD)rrrrto_droploserwinners r_resolve_coincident_pairs-LayoutPostprocessor._resolve_coincident_pairssp" EE!::55fkkBmS$$v'8'88NJKK) "r!cUVs/sH$o"R[R:XdM"UPM& nnUVs/sH$o"R[R:XdM"UPM& nnUVs/sH$o"R[R:XdM"UPM& nnUVs/sH o"RUR ;dMUPM" nn[ 5nXpRX45-nXpRXSU-5-nX4-U-Vs/sHo"RU;dMUPM nnXpRXh5-nUVs/sHo"RU;dMUPM sn$s snfs snfs snfs snfs snfs snf)aElect a winner for cross-type label pairs at near-identical bboxes. The layout model can emit the same grounded region under several labels. When two labels sit at near-identical bboxes with similar confidence, this step picks the label carrying the richer downstream semantic. Anything outside that envelope is out of scope here. | pair | loser | winner | |-------------------------------------|-----------|------------------------| | TABLE vs DOCUMENT_INDEX | TABLE | DOCUMENT_INDEX | | PICTURE vs TABLE / DOC_INDEX | PICTURE | TABLE / DOCUMENT_INDEX | | FORM / KVR vs TABLE / DOC / PICTURE | container | structured element | ) rorTABLEDOCUMENT_INDEXrtrrMrrD) rrrrxtables doc_indicespictures containersclusters_to_removesurviving_structureds rr/LayoutPostprocessor._handle_cross_type_overlapssi.O-LR>R3RA/S!1U!1AWW@T@T5Ta!1 U'*u<> $$y';';;  !12 2#344r!group_clusterscfSnUHnSnUH%nXd:XaM URXFU5(aM#Sn O U(dM9UcUnM@URR5URR5:dMxURUR- US::dMUnM U(aU$US$)zLSelect best cluster from a group of overlapping clusters based on all rules.NTFrcr)rrErr)rrr current_bestr should_selectrs r_select_best_cluster_from_group3LayoutPostprocessor._select_best_cluster_from_groups  'I M'%229VLL$)M (}'#,L"++- 0A0A0F0F0HH(33i6J6JJ!"234(1 +(. ,|B1BBr! cluster_typerSrTcXU(d/$US:Xa UROUS:Xa URO URnUVs0sHofRU_M nn[ UR 55nUR Un UHn URU R5n XR 5-n U RU R5 U HPn URU RX|RUU5(dM4URU RU 5 MR M /n UR5R5Hn[U5S:XaU RX~S5 M*UVs/sHoUPM nnUR!UU 5nUH0n U U:wdM UR"R%U R"5 M2 UR'UR"5UlUR)UR"5UlU RU5 M U $s snfs snf)Nrerfr#r)rsrurwrDrkeysOVERLAP_PARAMSrOrEdiscardr[r'r.valuesrr,rrkrrr)rr;rrSrTr=rxvalid_clustersufrr@ candidatesother_idresultgroupcidrbests rr0LayoutPostprocessor._remove_overlapping_clusters'sIy(   y(#### ,448a$$'84 ~**, -$$\2G&66w||DJ --/ /J   wzz *& ..LL",11%)  HHWZZ2'  ]]_++-E5zQ n1X67=BCUcS1UNC77OD*d?JJ%%gmm4*00.!N ii//133 02c3h# UH(oRR5Rv M* g7fr)r"rrr6s rrr7r8r9c3h# UH(oRR5Rv M* g7fr)r"rrr6s rrr7r8r9c3h# UH(oRR5Rv M* g7fr)r"rrr6s rrr7r8r9r) rkrrrrorrrErrrr)rr;r@ cells_bboxs rr*LayoutPostprocessor._adjust_cluster_bboxessG==$N NNN NNN NNN NN J}} 2 22*',,..*,,7',,..*,,7',,..*,,7',,..*,,7    * ) ,r!c[USS9$)z(Sort cells by their source/parser index.cUR$rr)rxs rr1LayoutPostprocessor._sort_cells..s177r!rr#)rrks rrLayoutPostprocessor._sort_cellsse!233r!r|clUS:Xa [USS9$US:Xa [USS9$US:Xa [USS9$U$)z5Sort clusters for deterministic layout-stage storage.rDcUR(a[SUR55O[RURR URR 4$)Nc38# UHoRv M g7frrAr6s rrGLayoutPostprocessor._sort_clusters....sA=4JJ=r)rkrsysmaxsizerErrr@s rr4LayoutPostprocessor._sort_clusters..sA#==A7==AA [[LLNNLLNN%r!rtblrcZURRURR4$r)rErrrKs rrrLw||~~w||~~.Nr!lrtbcZURRURR4$r)rErrrKs rrrLrOr!rC)rr;r|s rr"LayoutPostprocessor._sort_clusterss_ 4<  V^N V^N Or!) rnrkrirhrmrurqrsrrrw)rg?)rr)rdr)=r0r1r2r3r4r rFORMKEY_VALUE_REGIONrrrrr'rvrtrpCAPTIONFOOTNOTErr PAGE_FOOTER PAGE_HEADERSECTION_HEADERrTITLErCHECKBOX_SELECTEDCHECKBOX_UNSELECTEDrrr r+rr rrr}r~r staticmethodr]rMr5rrrr^rrstrrrrrrrrrrr6r7r!rr`r`lsQU'*TB&)SA&)SAN %%O ##K$))+6M!'')=)=(>?Mcs c     #    #  c ##T C 3 D 4 && (($ 4 %%t!" ##T#, L77O   w- 0    6%T']%N84=8tvF4=vFpWW RV, # # W g  S 4!OtG}!OF" ")0":>" "HCW CC  CJ$''* 7w-77! 7 % 7 g 7r=w-== =  =<X4>=@)W )49) g)V tG} h tG}g44h4DN4 48W -0 gr!r`)loggingrI collectionsrdocling_core.types.docrrrdocling_core.types.doc.pagerdocling.datamodel.base_modelsrr "docling.datamodel.pipeline_optionsr docling.datamodel.spatialr r r getLoggerr0_logrr9r`r7r!rrhs] #BB07M "B2 2 jH H r!