a lcC@sddlZddlZddlZddlZddlZddlZddlmZddlmZm Z m Z ddl m Z m Z mZmZmZmZmZmZmZmZmZddlmZerddlmZGddde ZeeefZejdd kreeeeeefeeefefZ nej Z d d Z!Gd d d e"d dZ#ejdkr(ej$Z%nGdddZ%dKddZ&dLddZ'ejdkr`ddZ(nddZ(ddZ)ddZ*ddZ+d d!eej,DZ-d"d#Z.d$d!eej,DZ/d%d!eej,Dhd&BZ0d'd(Z1d)d*Z2d+d,Z3d-d.Z4d/d0Z5d1d2Z6e7Z8d3d4Z9d5d6Z:d7d8Z;Gd9d:d:e7Zd?Z>d@dAZ?ejdd dBkrddCl@mAZAeAddDdEdFZBdGdHZCndIdFZBdJdHZCdS)MN)ABCMeta)ModuleexprAST) CallableDictIterableIteratorListOptionalTupleUnioncastAny TYPE_CHECKING) iteritems)NodeNGc@seZdZdZdZdZdS) EnhancedASTNr)__name__ __module__ __qualname__Z first_tokenZ last_tokenlinenorrJ/var/www/html/django/DPS/env/lib/python3.9/site-packages/asttokens/util.pyr srcCsdtj|t|dfS)zRReturns a human-friendly representation of a token with the given type and string.z%s:%su)tokentok_namereprlstrip)tok_typestringrrr token_repr.sr"c@seZdZdZddZdS)Tokena TokenInfo is an 8-tuple containing the same 5 fields as the tokens produced by the tokenize module, and 3 additional ones useful for this module: - [0] .type Token type (see token.py) - [1] .string Token (a string) - [2] .start Starting (row, column) indices of the token (a 2-tuple of ints) - [3] .end Ending (row, column) indices of the token (a 2-tuple of ints) - [4] .line Original line (string) - [5] .index Index of the token in the list of tokens that it belongs to. - [6] .startpos Starting character offset into the input text. - [7] .endpos Ending character offset into the input text. cCst|j|jSN)r"typer!selfrrr__str__Csz Token.__str__N)rrr__doc__r(rrrrr#5s r#z0type string start end line index startpos endpos)c@seZdZeZdS) AstConstantN)rrrobjectvaluerrrrr,Ksr,cCs|j|ko|dup|j|kS)zVReturns true if token is of the given type and, if a string is given, has that string.N)r%r!rr Ztok_strrrr match_tokenOsr0cCs>t|||s:tdt||t||jd|jddfdS)z Verifies that the given token is of the expected type. If tok_str is given, the token string is verified too. If the token doesn't match, raises an informative ValueError. z+Expected token %s, got %s on line %s col %srN)r0 ValueErrorr"strstartr/rrr expect_tokenUs  r5)r*cCs|tjtjtjfvSzW These are considered non-coding tokens, as they don't affect the syntax tree. )rNLCOMMENTENCODING token_typerrris_non_coding_tokencsr=cCs |tjkSr7)rN_TOKENSr;rrrr=jscCs tttgtft|jS)z; Generates standard library tokens for the given code. )tokenizegenerate_tokensrrr3ioStringIOreadline)textrrrr@rsr@cCst|drtStS)z Returns a function which yields all direct children of a AST node, skipping children that are singleton nodes. The function depends on whether ``node`` is from ``ast`` or from the ``astroid`` module. get_children)hasattriter_children_astroiditer_children_astnoderrriter_children_func}srKcCst|r gS|Sr$) is_joined_strrErIrrrrGsrGc Cs<h|]4\}}t|trt|tjtjtjtjtjfr|qSr) isinstancer% issubclassast expr_contextboolopoperatorunaryopcmpop.0ncrrr srYccslt|r dSt|tjrHt|j|jD]\}}|dur<|V|Vq&dSt|D]}|jt vrR|VqRdSr$) rLrMrOrzipkeysvaluesiter_child_nodes __class__ SINGLETONS)rJkeyr.childrrrrHs  rHcCs*h|]"\}}t|trt|tjr|qSr)rMr%rNrOstmtrUrrrrYs cCs*h|]"\}}t|trt|tjr|qSr)rMr%rNrOrrUrrrrYs >ZDelNameZConstZDelAttrZ AssignNameZ AssignAttrcCs |jjtvS)z+Returns whether node is an expression node.)r^rexpr_class_namesrIrrris_exprsrdcCs |jjtvS)z)Returns whether node is a statement node.)r^rstmt_class_namesrIrrris_stmtsrfcCs |jjdkS)z&Returns whether node is a module node.rr^rrIrrr is_modulesrhcCs |jjdkS)zFReturns whether node is a JoinedStr node, used to represent f-strings. JoinedStrrgrIrrrrLsrLcCs |jjdkS)z2Returns whether node is a starred expression node.StarredrgrIrrr is_starredsrkcCs0|jjdvp.|jjdko.tttttj|jS)z?Returns whether node represents a slice, e.g. `1:2` in `x[1:2]`)SliceExtSlicer ) r^ranymapis_slicerrOr eltsrIrrrrps  rpcCs|s dd}t|}t}d}|dtfg}|r|\}}} | tur||vsPJ|||||\} } |||| ft|} ||D]} || | | tfqq*|||tt t | }q*|S)a5 Scans the tree under the node depth-first using an explicit stack. It avoids implicit recursion via the function call stack to avoid hitting 'maximum recursion depth exceeded' error. It calls ``previsit()`` and ``postvisit()`` as follows: * ``previsit(node, par_value)`` - should return ``(par_value, value)`` ``par_value`` is as returned from ``previsit()`` of the parent. * ``postvisit(node, par_value, value)`` - should return ``value`` ``par_value`` is as returned from ``previsit()`` of the parent, and ``value`` is as returned from ``previsit()`` of this node itself. The return ``value`` is ignored except the one for the root node, which is returned from the overall ``visit_tree()`` call. For the initial node, ``par_value`` is None. ``postvisit`` may be None. cSsdSr$r)rJpvaluer.rrrzvisit_tree..N) rKset _PREVISITpopaddappendleninsertrr r#)rJZprevisitZ postvisit iter_childrendoneretstackcurrentZ par_valuer.rrZ post_valueinsrWrrr visit_trees$    rccsdt|}t}|g}|r`|}||vs,J|||Vt|}||D]}|||qLqdS)a Recursively yield all descendant nodes in the tree starting at ``node`` (including ``node`` itself), using depth-first pre-order traversal (yieling parents before their children). This is similar to ``ast.walk()``, but with a different order, and it works for both ``ast`` and ``astroid`` trees. Also, as ``iter_children()``, it skips singleton nodes generated by ``ast``. N)rKrurwrxrzr{)rJr|r}rrrrXrrrwalk s    rcCsXd}g}t|D]*\}}}|||||||}q|||dd|S)ah Replaces multiple slices of text with new values. This is a convenience method for making code modifications of ranges e.g. as identified by ``ASTTokens.get_text_range(node)``. Replacements is an iterable of ``(start, end, new_text)`` tuples. For example, ``replace("this is a test", [(0, 4, "X"), (8, 9, "THE")])`` produces ``"X is THE test"``. rN)sortedryjoin)rDZ replacementsppartsr4endnew_textrrrreplace&s  rc@s eZdZdZddZddZdS) NodeMethodsz[ Helper to get `visit_{node_type}` methods given a node's class and cache the results. cCs i|_dSr$)_cacher&rrr__init__>szNodeMethods.__init__cCs:|j|}|s6d|j}t|||j}||j|<|S)z Using the lowercase name of the class as node_type, returns `obj.visit_{node_type}`, or `obj.visit_default` if the type-specific method is not found. visit_)rgetrlowergetattrZ visit_default)r'objclsmethodnamerrrrBs   zNodeMethods.getN)rrrr)rrrrrrr:srcCst|Sr$)iter)original_tokensrrrpatched_generate_tokensSsrccszg}|D]X}|jtjtjtjfvrB|r6|dj|jkrB||qt|D] }|VqJg}|Vqt|D] }|VqjdS)a Fixes tokens yielded by `tokenize.generate_tokens` to handle more non-ASCII characters in identifiers. Workaround for https://github.com/python/cpython/issues/68382. Should only be used when tokenizing a string that is known to be valid syntax, because it assumes that error tokens are not actually errors. Combines groups of consecutive NAME, NUMBER, and/or ERRORTOKEN tokens into a single NAME token. N) r%r?NAME ERRORTOKENNUMBERrr4rycombine_tokens)rgrouptokZcombined_tokenrrrrWs    cCsftdd|Dr(tdd|Ddkr,|Stjtjddd|D|dj|d j|djd gS) Ncss|]}|jtjkVqdSr$)r%r?rrVrrrr rrtz!combine_tokens..cSsh|] }|jqSr)linerrrrrYrrtz!combine_tokens..r1rcss|] }|jVqdSr$)r!)rVtrrrrwrtrr)r%r!r4rr) rnrzr? TokenInforrr4rr)rrrrrps(rcCs(ddt|D}|r$t|dS|S)zq If the given AST node contains multiple statements, return the last one. Otherwise, just return the node. cSs"g|]}t|tjtjfr|qSr)rMrOrb excepthandler)rVrarrr szlast_stmt..r)rOr] last_stmt)rJZ child_stmtsrrrrs  r)r*) lru_cache)maxsizecsbdt}ddt|D}dd|D}tt|t|k}tfdd|D}|o`|S)a The positions attached to nodes inside f-string FormattedValues have some bugs that were fixed in Python 3.9.7 in https://github.com/python/cpython/pull/27729. This checks for those bugs more concretely without relying on the Python version. Specifically this checks: - Values with a format spec or conversion - Repeated (i.e. identical-looking) expressions - Multiline f-strings implicitly concatenated. z( f"a {b}{b} c {d!r} e {f:g} h {i:{j}} k {l:{m:n}}" f"a {b}{b} c {d!r} e {f:g} h {i:{j}} k {l:{m:n}}" f"{x + y + z} {x} {y} {z} {z} {z!a} {z:z}" )cSsg|]}t|tjr|qSr)rMrONamerVrJrrrrrtz*fstring_positions_work..cSsg|]}|j|jfqSr)r col_offsetrrrrrrtc3s |]}t||jkVqdSr$)rOget_source_segmentidrsourcerrrsz)fstring_positions_work..)rOparserrzruall)treeZ name_nodesZname_positionsZpositions_are_uniqueZcorrect_source_segmentsrrrfstring_positions_works   rcCst|D]v}t|tjsq|jD]\}t|ddt|tjr ts^t|jD]}t|ddqL|j r t|j ddt |j q qdS)z Add a special attribute `_broken_positions` to nodes inside f-strings if the lineno/col_offset cannot be trusted. Z_broken_positionsTN) rrMrOrir\setattrFormattedValuerr. format_specannotate_fstring_nodes)rZ joinedstrpartrarrrrs     rcCsdS)NFrrrrrrscCsdSr$r)Z_treerrrrs)N)N)DrO collectionsrAsysrr?abcrrrrtypingrrrr r r r r rrrsixrZastroid.node_classesrrZAstNode version_infointr3rr" namedtupler#Constantr,r0r5r=r@rKrG__dict__r_rHrercrdrfrhrLrkrpr-rvrrrrrrr functoolsrrrrrrrst 4   $       ,