a Sic @sPdZddlmZddlmZddlmZddlmZGdddZ d d d Z dS) z SQL Lexer) TextIOBase)tokens) SQL_REGEX)consumec@seZdZdZedddZdS)Lexerz?Lexer Empty class. Leaving for backwards-compatibility Nccs t|tr|}t|trnZt|trf|r8||}qxz|d}Wqxtyb|d}Yqx0ntdt |t |}|D]\}}t D]f\}}|||}|sqn2t|t j r||fVnt|r||Vt|||dqqt j|fVqdS)a Return an iterable of (tokentype, value) pairs generated from `text`. If `unfiltered` is set to `True`, the filtering mechanism is bypassed even if filters are defined. Also preprocess the text, i.e. expand tabs and strip it if wanted and applies registered filters. Split ``text`` into (tokentype, text) pairs. ``stack`` is the initial stack (default: ``['root']``) zutf-8zunicode-escapez+Expected text or file-like object, got {!r}N) isinstancerreadstrbytesdecodeUnicodeDecodeError TypeErrorformattype enumeraterr _TokenTypegroupcallablerendError)textencodingiterableposcharZrexmatchactionmrJ/var/www/html/django/DPS/env/lib/python3.9/site-packages/sqlparse/lexer.py get_tokenss6         zLexer.get_tokens)N)__name__ __module__ __qualname____doc__ staticmethodr rrrrrsrNcCst||S)zTokenize sql. Tokenize *sql* using the :class:`Lexer` and return a 2-tuple stream of ``(token type, value)`` items. )rr )sqlrrrrtokenizeLsr')N) r$iorsqlparserZsqlparse.keywordsrsqlparse.utilsrrr'rrrrs     6