0jVdZddlmZddlZddlZddlZddlZddlZddlZddl Z ddl m Z ddl m Z ddlmZmZe e jZdd ZddZddZddZddZdS)z"Better tokenizing for coverage.py.) annotationsN)Iterable)env)TLineNoTSourceTokenLinestoks TokenInfosreturnc #Kd}d}d}|D]H\}}\}}\}} } ||kr|r|drd} |drd} nv|tjkrC|dr+|d|rd} n&d} n#tjjr|tjkrd} | rLt| d d d z } tj d d|| f|| d zf|V| }|tj tj fvr|}tj ||||f|| f| V|}JdS)aBReturn all physical tokens, even line continuations. tokenize.generate_tokens() doesn't return a token for the backslash that continues lines. This wrapper provides those tokens so that we can re-create a faithful representation of the original source. Returns the same values as generate_tokens() Nz\ T\Fz \  i)endswithtokenSTRINGrstripr PYBEHAVIORfstring_syntaxFSTRING_MIDDLElensplittokenize TokenInfoNEWLINENL) r last_line last_lineno last_ttextttypettextslinenoscolelinenoecolltextinject_backslashccols R/home/lighthouse/health/venv/lib64/python3.11/site-packages/coverage/phystokens.py _phys_tokensr-s!IKJAE66=uow ' ! !/ Y//77/  $( &&t,,-',$$el**!**6221%,,W55>>zJJ1,0((,1((^2-u@T7T7T',$# yt44R899A=D", $ $(+! I )8;7 7 7J $QVWWWWW m66sourcestr set[TLineNo]cht}tjtj|D]}t |tjrD||j|jD]!}||j j"`tj dkr5t |tj r||jtj dkrGt |tj tjfr!|jr||j|S)zCHelper for finding lines with soft keywords, like match/case lines.) )r3)setastwalkparse isinstanceMatchaddlinenocasespatternsys version_info TypeAliasImport ImportFromis_lazy)r/soft_key_linesnodecases r,find_soft_key_linesrI]s#&55N6**++ 0 0 dCI & & 0   t{ + + +  8 8""4<#67777 8   ( (Zcm-L-L (   t{ + + + +   ( (Zsz3>>Z-[-[ (| 0""4;/// r.rc#Ktjtjtjtjh}g}d}|ddd}t|}t|}t|D]\}}\}} \} } } d} tj d|D]} | dkr |Vg}d}d}nl| dkrd}nb||vrd}nZtjjrL|tjkr<| d d d d } | t#| z} | r%| |kr|d d| |z zfd} tj|ddd}|tjkrst/j|rd}n\t/j|rHt#|dkrd}n*t#|dkr|ddd krd}nd}|r||vrd}||| fd}d} |r| }|r|VdSdS)aGenerate a series of lines, one for each line in `source`. Each line is a list of pairs, each pair is a token:: [('key', 'def'), ('ws', ' '), ('nam', 'hello'), ('op', '('), ... ] Each pair has a token class, and the token text. If you concatenate all the token texts, and then join them with newlines, you should have your original `source` back, with two differences: trailing white space is not preserved, and a final line with no newline is indistinguishable from a final line with a newline. rz rTz( )Fr {z{{}z}}ws xxNr3keyr)rINDENTDEDENTrrr expandtabsreplacegenerate_tokensrIr-rerrrrrrappendtok_namegetlowerNAMEkeyword iskeyword issoftkeyword)r/ ws_tokenslinecoltokgenrFr#r$sliner&_r( mark_startpartmark_end tok_classis_start_of_lines r,source_token_linesrkqs u|U]HKHI"$D C   q ! ! ) )&$ 7 7F V $ $F(00N5A&5I5I&&1umudYa HVU++" " Dt||   )## >0,Ue>R5R5R<<T22::3EED#d))+D'$**KKsdSj'9 :;;;!&J$-11%>>DDFFrrJ EJ&&(// .$)  .u55 .t99>>/3,,!$ii1nn$q'!*2D2D/3,,/4,+.0G0G(-I Y-...DD  C  r.textc\tj|j}tj|S)zA helper around `tokenize.generate_tokens`. Originally this was used to cache the results, but it didn't seem to make reporting go faster, and caused issues with using too much memory. )ioStringIOreadlinerrV)rlrps r,rVrVs'{4  )H  #H - --r.bytesct|dj}tj|dS)zDetermine the encoding for `source`, according to PEP 263. `source` is a byte string: the text of the program. Returns a string, the name of the encoding. Tr)iter splitlines__next__rdetect_encoding)r/rps r,source_encodingrws8F%%d++,,5H  #H - -a 00r.)rr r r )r/r0r r1)r/r0r r)rlr0r r )r/rqr r0)__doc__ __future__rr7rnr]rWr@rrcollections.abcrcoveragercoverage.typesrrrr r-rIrkrVrwr.r,r~s)(""""""  $$$$$$55555555 h( ) CCCCL(BBBBJ.... 1 1 1 1 1 1r.