]jVSrSSKJr SSKrSSKrSSKrSSKrSSKrSSKrSSK r SSK J r SSK J r SSKJrJr \ \ R"rS SjrS SjrSS jrSS jrSS jrg)z"Better tokenizing for coverage.py.) annotationsN)Iterable)env)TLineNoTSourceTokenLinesc ## SnSnSnUGHeupEupgupn X(:wGa U(GaURS5(aSn URS5(aSn OU[R:XaAURS5(a(URS5RU5(aSn O8Sn O5[R R (aU[R:XaSn U (aA[URS 5S 5S - n [R"S SXl4XlS -4U5v U nU[R[R4;aUn[R"XEXg4X4U 5v UnGMh g7f)a.Return all physical tokens, even line continuations. tokenize.generate_tokens() doesn't return a token for the backslash that continues lines. This wrapper provides those tokens so that we can re-create a faithful representation of the original source. Returns the same values as generate_tokens() Nz\ T\Fz \  i)endswithtokenSTRINGrstripr PYBEHAVIORfstring_syntaxFSTRING_MIDDLElensplittokenize TokenInfoNEWLINENL) toks last_line last_lineno last_ttextttypettextslinenoscolelinenoecolltextinject_backslashccols P/home/mande/repo/quber/.venv/lib/python3.13/site-packages/coverage/phystokens.py _phys_tokensr+s`!IKJAE=ow  !Y//77 $( &&t,,',$ell*!**622%,,W5>>zJJ,0(,1(^^22u@T@T7T',$#yt4R89A=D",,  (+! I ))8;;7 7J  QVWW mBFsE4E6c[5n[R"[R"U55GH?n[ U[R 5(aUUR UR5 URH(nUR URR5 M* Mx[RS:a<[ U[R5(aUR UR5 M[RS:dM[ U[R[R45(dGMUR(dGM$UR UR5 GMB U$)zCHelper for finding lines with soft keywords, like match/case lines.) )r-)setastwalkparse isinstanceMatchaddlinenocasespatternsys version_info TypeAliasImport ImportFromis_lazy)sourcesoft_key_linesnodecases r*find_soft_key_linesrD]s#&5N6*+ dCII & &   t{{ + ""4<<#6#67#    (Zcmm-L-L   t{{ +    (Zszz3>>>Z-[-[|||""4;;/, c## [R[R[R[R 1n/nSnUR S5RSS5n[U5n[U5n[U5GHupgupupn Sn [R"SU5GHn U S:Xa Uv /nSnSnGOnU S:XaSnGOdXa;aSnGO[[RR(aDU[R :Xa0U RS S 5RS S 5n U [#U 5-n U (aX:aUR%S SX- -45 Sn [R&R)US5R+5SSnU[R,:Xay[.R0"U5(aSnO[[.R2"U5(a@[#U5S:XaSnO [#U5S:XaUSSS :XaSnOSnU(aX;aSnUR%X45 SnSn GM W(dGMU nGM U(aUv gg7f)aGenerate a series of lines, one for each line in `source`. Each line is a list of pairs, each pair is a token:: [('key', 'def'), ('ws', ' '), ('nam', 'hello'), ('op', '('), ... ] Each pair has a token class, and the token text. If you concatenate all the token texts, and then join them with newlines, you should have your original `source` back, with two differences: trailing white space is not preserved, and a final line with no newline is indistinguishable from a final line with a newline. rz r Tz( )Fr {z{{}z}}ws xxNr-keyr)rINDENTDEDENTrrr expandtabsreplacegenerate_tokensrDr+rerrrrrrappendtok_namegetlowerNAMEkeyword iskeyword issoftkeyword)r@ ws_tokenslinecoltokgenrAr!r"sliner$_r& mark_startpartmark_end tok_classis_start_of_lines r*source_token_linesrgqs  u||U]]HKKHI"$D C   q ! ) )&$ 7F V $F(0N5A&5I1muYa HHVU+Dt|   # >>00Ue>R>R5R<<T2::3ED#d)+D$*KKsdj'9 :;!&J$--11%>DDFrJ EJJ&((//$)  ..u55t9>/3,!$i1n$q'!*2D/3,/4,+0G(-I Y-.DE,F 8CM6JP   s H;IIcn[R"U5Rn[R"U5$)zA helper around `tokenize.generate_tokens`. Originally this was used to cache the results, but it didn't seem to make reporting go faster, and caused issues with using too much memory. )ioStringIOreadlinerrR)textrks r*rRrRs){{4 ))H  # #H --rEc|[URS55Rn[R"U5S$)zDetermine the encoding for `source`, according to PEP 263. `source` is a byte string: the text of the program. Returns a string, the name of the encoding. Tr)iter splitlines__next__rdetect_encoding)r@rks r*source_encodingrrs5F%%d+,55H  # #H -a 00rE)r TokenInfosreturnrs)r@strrtz set[TLineNo])r@rurtr)rlrurtrs)r@bytesrtru)__doc__ __future__rr1rirYrSr:rrcollections.abcrcoveragercoverage.typesrrrrsr+rDrgrRrrrEr*r}sX)"  $5 h(( ) CL(BJ. 1rE