j//SrSSKrSSKrSSKrSSKJr SSKJr SSKJ r SSK J r J r SSK JrJrJrJrJr SSKJr SS KJr SS KJrJrJrJrJr SS KJr SS KJ r SS K!J"r" \RF"\$5r%Sr&\RN"S5r(\)"SS15r*\ \+\,\4r-"SS\"5r."SS5r/"SS5r0"SS\5r1S\S\2\2\+S\4Sjr3g)a3Backend for mainframe EBCDIC data files. EBCDIC files carry no self-describing structure: the byte stream is a sequence of fixed-width records whose fields are only meaningful together with the COBOL copybook that produced them. The copybook is therefore supplied as an `EbcdicLayout` through `EbcdicBackendOptions`, and this backend turns each record schema into one table of the resulting `DoclingDocument`. Decoding is pure Python: character data goes through the standard library EBCDIC codecs, and the COBOL numeric usages are unpacked from their nibbles. N)Decimal)BytesIO)Path)CallableUnion) DocItemLabelDoclingDocumentDocumentOrigin TableCell TableData)override)DeclarativeDocumentBackend)EbcdicBackendOptions EbcdicFieldEbcdicFieldType EbcdicLayoutEbcdicRecordLayout) InputFormat) InputDocument)DocumentLoadErrorzapplication/x-ebcdicz[\x00-\x1f\x7f-\x9f] c\rSrSrSrSrg)EbcdicDecodeError<z8A field could not be decoded with the configured layout.N)__name__ __module__ __qualname____firstlineno____doc____static_attributes__r[/home/mande/repo/quber/.venv/lib/python3.13/site-packages/docling/backend/ebcdic_backend.pyrr<sBr#rc\rSrSrSrS\S\SS4SjrS\S \ S\ 4S jr S\S\4S jr \ S\S \S\4S j5r\ S\S\4Sj5r\ S\S\4Sj5rSrg) _FieldDecoder@z/Decode single EBCDIC fields into Python values.encodingstrip_control_charactersreturnNc ^[R"U5TlUTl[ RTR[ RU4Sj[ RU4Sj[ RTR[ RTR0Tlg![an[ SU<S35UeSnAff=f)NzUnknown EBCDIC codec .c$>TRUSS9$)NTsigned_binarydataselfs r$(_FieldDecoder.__init__..Ks$,,tD,2Qr#c$>TRUSS9$)NFr.r0r2s r$r5r6Ls4<<U+>S  T#&;H>Cr3fieldc URUR"U5n[U[5(a6UR(a%[U5RUR*5$U$![[[[ 4aIn[ SUR<SURRSUR5<S35UeSnAff=f)z9Decode the bytes of one field as described by its layout.zCannot decode field z of type z from r,N)rEtypeArithmeticErrorr; UnicodeError ValueErrorrnamevaluehex isinstanceintscalerscaleb)r4r3rIrPrFs r$decode_FieldDecoder.decodeSs NN5::.t4E eS ! !ekk5>((%++6 6  lJG #&uzznIejj>N>N=OP ~Q(  sA..CAC  CcURU5up#UR(a[RSU5nUR 5$)N)r:r<_CONTROL_CHARACTERSsubstrip)r4r3text_s r$r>_FieldDecoder._string`s;##D)  ) )&**2t4Dzz|r#r/c,[RUSUS9$)Nbig) byteorderr/)rS from_bytes)r3r/s r$r1_FieldDecoder._binaryfs~~deF~CCr#cUR5n[USS=(d S5n[USS5[;aU*$U$)z@Unpack COMP-3: two digits per byte, sign in the trailing nibble.N0)rQrS_NEGATIVE_SIGNS)r3nibblesdigitss r$rB_FieldDecoder._packed_decimaljsC((*WSb\(S)gbk2./AwMvMr#cUVs/sHoS-PM nn[SU55(a[UR5S35e[SR SU555nUSS- [ ;aU*$U$s snf)z:Unpack a signed display numeric: one digit per low nibble.c3*# UH oS:v M g7f) Nr.0nibbles r$ /_FieldDecoder._zoned_decimal..us0fzsz holds a non-decimal digitrYc38# UHn[U5v M g7fN)strrqs r$rtruws?wVS[[wsrf)anyrNrQrSjoinri)r3byterjrks r$rD_FieldDecoder._zoned_decimalqs~,0044$;40 00 0 0 |+EFG GRWW?w??@r(a-?:wFF 1sA>)r:rEr<)rrrr r!rxboolrGbytesr _DecodedValuerVr> staticmethodrSr1rBrDr"rr#r$r&r&@s9    5   Ec DeDTDcDDNeNNN GUGsGGr#r&c \rSrSrSrS\S\SS4SjrS\S \ \ S4S\ \ \ \ \ 44S jrS\S \ S \ S\\\ \ 44S jr\S\S \ S\ S \ S\ S\4 Sj5rS\S\S\ \ 4SjrSrg) _RecordParser{z1Split an EBCDIC byte stream into decoded records.layoutdecoderr*NcXlX lgrw)_layout_decoder)r4rrs r$rG_RecordParser.__init__~s   r#r3 max_recordscURRVs0sHo3R/_M nn[U5URR- nURR nSnXe:aUbXr:axUR XU5up8nURXXUR5n XCRRURX955 Xh- nUS- nXe:a UcMqXr:aMx[RSU5 U$s snf)zEReturn the decoded rows of every record schema, keyed by schema name.rzDecoded %d EBCDIC records) rrecordsrOlen footer_size header_size _read_prefix_takeappend_decode_record_logdebug) r4r3rrecordrowsendoffsetcountsizebodys r$parse_RecordParser.parses +/,,*>*>, *>KKO*> , $i$,,222))l 3u7J#'#4#4T3#G F&::dDv{{CD   $ $T%8%8%F G NF QJE l 3u7J .6 , sDrrcURnSnSnUR=nbYURXURX7R5n[ UR RX55nX'R- nUR=nbYURXURX7R5n[UR RX55nX'R- nURU5n U c[SU<S35eUc U RO XTR- n U S:a[SUSURS35eXU4$)z?Consume the record prefix and resolve the schema and body size.Nz%No record layout matches record type r,rzRecord length z is shorter than the z-byte record prefix.) rrecord_length_fieldrrrOrSrrVrecord_type_fieldrxselectr prefix_size) r4r3rrrlength record_typerIchunkrrs r$r_RecordParser._read_prefixs<#'(, // /E <JJtUZZjjIE--e;#7 aH %nv{{&;M;M2M !8# (=%%&&:< V##r#rrOc NX-U:a[SU<SX1- SUS35eXX-$)NzInput ends inside z: z of z bytes left.)r)r3rrrrOs r$r_RecordParser._takesB =3 #$THBs|nDlS V]++r#rrc /nSnURHsnX$XER-nXER- nUR[RLdM@UR [ URRXe555 Mu U$)Nr) fieldsrrKrSKIPrrxrrV)r4rrvaluesrrIrs r$r_RecordParser._decode_recordsp]]E&::"56E jj Fzz!5!55 c$--"6"6u"DEF #  r#)rr)rrrr r!rr&rGrrrSdictrxlistrtuplerrrrrr"rr#r$rr{s; | m  (-c4i(8 c4S ?" #*$$#&$-0$ !3+ ,$>,E,3,c,,3,5,,%7ucr#rc ^\rSrSr%Sr\\S'\\S'\\S'\ SS\ S\ \ \ 4S\ \S4S S4U4S jjj5rS \4S jr\ S \4S j5r\\ S \4S j55r\\ S \\4Sj55r\ S \4Sj5rSrU=r$)EbcdicDocumentBackenda8Declarative backend converting EBCDIC data files to `DoclingDocument`. The layout is mandatory and comes from `EbcdicBackendOptions`, either inline as an `EbcdicLayout` or as a JSON file. Each record schema becomes one table whose header row holds the field names; `skip` fields are consumed but never emitted. optionscontentrNin_docpath_or_streamr*cD>Uc [5n[TU] XU5 UR5Ul[ U[ 5(aUR5OUR5Ul g![[4an[SURS35UeSnAff=f)Nz;Could not initialize the EBCDIC backend for file with hash r,)rsuperrG_resolve_layoutrrRrgetvalue read_bytesrOSErrorrNr document_hash)r4rrrrF __class__s r$rGEbcdicDocumentBackend.__init__s ?*,G 9**,   ng66'')#..0 L $ #M%%&a)  s:A00BBBcURRbURR$URRc [S5e[R "URRR 55$![[4a)n[SURRS35UeSnAff=f)NznThe EBCDIC backend needs a layout: set either EbcdicBackendOptions.layout or EbcdicBackendOptions.layout_file.z!Could not read the EBCDIC layout r,) rr layout_filerrmodel_validate_jsonrrrN)r4rFs r$r%EbcdicDocumentBackend._resolve_layouts <<   *<<&& & << # # +#S  33 ((335 $ #3DLL4L4L3MQO  s7B C$B==Cc,[UR5$rw)r~r)r4s r$is_validEbcdicDocumentBackend.is_validsDLL!!r#cg)NFrclss r$supports_pagination)EbcdicDocumentBackend.supports_paginationsr#c$[R1$rw)rEBCDICrs r$supported_formats'EbcdicDocumentBackend.supported_formats s""##r#cUR5(d[SURS35e[URR =(d S[ URS9n[URR=(d SUS9nURR(a2UR[RURRS9 [URR URR"5n[%URU5R'UR(URR*5nURR,HynXER (dM[/URR,5S:aUR1UR S 9 UR3[5XTUR 5S 9 M{ U$) z7Parse the EBCDIC data into one table per record schema.zCannot convert doc with z$ because the backend failed to init.zfile.ebc)filenamemimetype binary_hashfile)rOorigin)labelr]r)r])r3)rrrr rrO _MIME_TYPEr stemr descriptionadd_textrTEXTr&rr(r)rrrrrr add_heading add_table _build_table)r4rdocrrrs r$convertEbcdicDocumentBackend.convertsf}}#*4+=+=*>?**   YY^^1z**  499>>#;VFK ;; " " LL|00t{{7N7NL O LL ! !4<<#H#H T[['288 LL$,,22 kk))F $4;;&&'!+V[[1 MM|F4EFM G * r#)rrrw)rrrr r!r__annotations__rrr rrrrrGrr~r classmethodrsetrrr rr" __classcell__)rs@r$rrs"! N  6: gtm,+T12   2""$"" D $#k"2$$r#rrrr*c URVs/sH-o"R[RLdM!URPM/ nn[ [ U5S-[ U5/S9n[U/UQ5HIupV[U5H5upxURR[UUUS-UUS-US:HS95 M7 MK U$s snf)zDLay the decoded records out as a table with a field-name header row.r)num_rowsnum_cols table_cellsr)r]start_row_offset_idxend_row_offset_idxstart_col_offset_idxend_col_offset_idx column_header) rrKrrrOr r enumeraterrr ) rrrIheadertablerow_idxrowcol_idxrPs r$rr2s!'  -u?CWCW1W    s4y1}s6{PR SE!6/D/2 'nNG    $ $)0'.{)0'.{")Q,  -3 L!s CC)4r!r8loggingredecimalriorpathlibrtypingrrdocling_core.types.docrr r r r typing_extensionsr docling.backend.abstract_backendr!docling.datamodel.backend_optionsrrrrrdocling.datamodel.base_modelsrdocling.datamodel.documentrdocling.exceptionsr getLoggerrrrcompilerZ frozensetrirxrSrrr&rrrrrr#r$r s  "'G640" # jj!89S#J'c3'( C)C8G8GvKK\f6fR+4S ?yr#