a lc.@sdZddlZddlmZmZddlmZmZmZm Z m Z m Z m Z m Z ddlmZddlmZmZddlmZddlmZdd lmZd d lmZmZerdd lmZgd ZGdddedZGdddeZ GdddeZ!Gdddee e"dfe"fZ#e#Z$GdddeZ%dS)z Adaptor classes for using Pygments lexers within prompt_toolkit. This includes syntax synchronization code, so that we don't have to start lexing at the beginning of a document, when displaying a very large text. N)ABCMetaabstractmethod) TYPE_CHECKINGCallableDict GeneratorIterableOptionalTupleType)Document) FilterOrBool to_filter)StyleAndTextTuples) split_linespygments_token_to_classname)Lexer SimpleLexer)r) PygmentsLexer SyntaxSync SyncFromStart RegexSyncc@s.eZdZdZeeeeeefdddZdS)ra Syntax synchroniser. This is a tool that finds a start position for the lexer. This is especially important when editing big documents; we don't want to start the highlighting by running the lexer from the beginning of the file. That is very slow when editing. documentlinenoreturncCsdS)a/ Return the position from where we can start lexing as a (row, column) tuple. :param document: `Document` instance that contains all the lines. :param lineno: The line that we want to highlight. (We need to return this line, or an earlier position.) NselfrrrrZ/var/www/html/django/DPS/env/lib/python3.9/site-packages/prompt_toolkit/lexers/pygments.pyget_sync_start_position/sz"SyntaxSync.get_sync_start_positionN) __name__ __module__ __qualname____doc__rr intr r"rrrr!r's  r) metaclassc@s*eZdZdZeeeeefdddZdS)rzB Always start the syntax highlighting from the beginning. rcCsdS)Nrrrrrrr!r"Bsz%SyncFromStart.get_sync_start_positionN)r#r$r%r&r r'r r"rrrr!r=s rc@sVeZdZdZdZdZeddddZee e e e fdd d Z e d dd d dZ dS)rzQ Synchronize by starting at a line that matches the given regex pattern. idN)patternrcCst||_dS)N)recompile_compiled_pattern)r r+rrr!__init__UszRegexSync.__init__rcCsf|j}|j}t|td||jdD]&}|||}|r$||fSq$||jkrZdS|dfSdS)zH Scan backwards, and find a possible position to start. r)rN)r.linesrangemax MAX_BACKWARDSmatchstartFROM_START_IF_NO_SYNC_POS_FOUND)r rrr+r1ir5rrr!r"Xs z!RegexSync.get_sync_start_positionPygmentsLexerCls) lexer_clsrcCs$ddddd}||jd}||S)zV Create a :class:`.RegexSync` instance for this Pygments lexer class. z^\s*(class|def)\s+z <[/a-zA-Z]z \bfunction\b)PythonzPython 3HTML JavaScript^)getname)clsr:patternsprrr!from_pygments_lexer_clsps z!RegexSync.from_pygments_lexer_cls)r#r$r%r&r4r7strr/r r'r r" classmethodrDrrrr!rHs rc@s(eZdZdZeedfedddZdS) _TokenCachez Cache that converts Pygments tokens into `prompt_toolkit` style objects. ``Token.A.B.C`` will be converted into: ``class:pygments,pygments.A,pygments.A.B,pygments.A.B.C`` .)keyrcCsdt|}|||<|S)Nzclass:r)r rHresultrrr! __missing__s z_TokenCache.__missing__N)r#r$r%r&r rErJrrrr!rGsrG.c@sheZdZdZdZdZdedeee dddd Z e de ed d d d Z eeegefdddZdS)ra Lexer that calls a pygments lexer. Example:: from pygments.lexers.html import HtmlLexer lexer = PygmentsLexer(HtmlLexer) Note: Don't forget to also load a Pygments compatible style. E.g.:: from prompt_toolkit.styles.from_pygments import style_from_pygments_cls from pygments.styles import get_style_by_name style = style_from_pygments_cls(get_style_by_name('monokai')) :param pygments_lexer_cls: A `Lexer` from Pygments. :param sync_from_start: Start lexing at the start of the document. This will always give the best results, but it will be slow for bigger documents. (When the last part of the document is display, then the whole document will be lexed by Pygments on every key stroke.) It is recommended to disable this for inputs that are expected to be more than 1,000 lines. :param syntax_sync: `SyntaxSync` object. 2r*TNr9)pygments_lexer_clssync_from_start syntax_syncrcCs4||_t||_|dddd|_|p,t||_dS)NF)stripnlstripallensurenl)rLrrMpygments_lexerrrDrN)r rLrMrNrrr!r/s zPygmentsLexer.__init__r)filenamerMrcCsPddlm}ddlm}z ||}Wn|y<tYS0||j|dSdS)z3 Create a `Lexer` from a filename. r)get_lexer_for_filename) ClassNotFound)rMN)Zpygments.lexersrTZ pygments.utilrUr __class__)rArSrMrTrUrRrrr! from_filenames     zPygmentsLexer.from_filename)rrcsttttfddf}iitdfdd tt|dfdd dtt|d fd d t|dfd d ttdfdd }|S)z Create a lexer function that takes a line number and returns the list of (style_str, text) tuples as the Pygments lexer returns for that line. NrcsrtSjSdS)z8The Syntax synchronisation object that we currently use.N)rMrrNr)r rr!get_syntax_syncsz3PygmentsLexer.lex_document..get_syntax_sync)r8rcs4D]&\}}||kr||jkr|SqdS)z@Return a generator close to line 'i', or None if none was found.N)itemsREUSE_GENERATOR_MAX_DISTANCE)r8 generatorr)line_generatorsr rr!find_closest_generators z:PygmentsLexer.lex_document..find_closest_generatorr) start_linenocolumnrc3sBttttfdfdd }ttt|EdHdS)z Create a generator that yields the lexed lines. Each iteration it yields a (line_number, [(style_str, text), ...]) tuple. rXc3sFdjdd}j|D]\}}}t||fVq(dS)N )joinr1rRget_tokens_unprocessed _token_cache)text_tv)r`rr r_rr!get_text_fragmentsszUPygmentsLexer.lex_document..create_line_generator..get_text_fragmentsN)rr rE enumeraterlist)r_r`ri)rr )r`r_r!create_line_generators$ z9PygmentsLexer.lex_document..create_line_generatorcs~|}|r|Std|j}|dkr2d}d}n|\}}|}|rT|S||}|rrt||d7}||<|S)z_ Find an already started generator that is close, or create a new one. rr)r3MIN_LINES_BACKWARDSr"next)r8r\rowr`)rlrr^rYr]r rr! get_generators" z1PygmentsLexer.lex_document..get_generatorcsvz |WStyp|}|D]F\}}||<||kr$||<|dvrZ|d=|YSq$Yn0gS)z*Return the tokens for a given line number.r)KeyError)r8r\numline)cacherpr]rr!get_line7s     z,PygmentsLexer.lex_document..get_line)r)rr r'rrr )r rZ LineGeneratorrur)rtrlrr^rprYr]r r! lex_documents'zPygmentsLexer.lex_document)TN)T)r#r$r%r&rmr[r r r rr/rFrErWr rr'rrvrrrr!rs$ r)&r&r,abcrrtypingrrrrrr r r Zprompt_toolkit.documentr Zprompt_toolkit.filtersr rZ"prompt_toolkit.formatted_text.baserZ#prompt_toolkit.formatted_text.utilsrZprompt_toolkit.styles.pygmentsrbaserrZpygments.lexerr9__all__rrrrErGrdrrrrr!s$(      <