a lcY @sdZddlZddlmZmZddlmZddlZddlmZm Z e dej Z e dej Z dd d Zd d ZdddZdddZdS)z Tools to open .py files as Unicode, using the encoding specified within the file, as per PEP 263. Much of the code is taken from the tokenize module in Python 3.2. N) TextIOWrapperBytesIO)Path)opendetect_encodingzcoding[:=]\s*([-\w.]+)z^\s*#.*coding[:=]\s*([-\w.]+)replaceTcCst|tr|St|tr"t|}n|}zt|j\}}WntyNd}Yn0|dt|||ddL}d|_ |rd t |WdS| WdSWdn1s0YdS)a#Converts a bytes string with python source code to unicode. Unicode strings are passed through unchanged. Byte strings are checked for the python source file encoding cookie to determine encoding. txt can be either a bytes buffer or a string containing the source code. asciirT)errorsline_bufferingrN) isinstancestrbytesrrreadline SyntaxErrorseekrmodejoinstrip_encoding_cookieread)txtr skip_encoding_cookiebufferencoding_textrP/var/www/html/django/DPS/env/lib/python3.9/site-packages/IPython/utils/openpy.pysource_to_unicodes      rccsft|}z4t|}t|s"|Vt|}t|s:|VWntyPYdS0|D] }|VqVdS)z{Generator to pull lines from a text-mode file, skipping the encoding cookie if it is found in the first two lines. N)iternextcookie_comment_rematch StopIteration)filelikeitfirstsecondlinerrrr+s    rcCsjt|}t|F}|r2dt|WdS|WdSWdn1s\0YdS)aRead a Python file, using the encoding declared inside the file. Parameters ---------- filename : str The path to the file to read. skip_encoding_cookie : bool If True (the default), and the encoding declaration is found in the first two lines, that line will be excluded from the output. Returns ------- A unicode string containing the contents of the file. r N)rrrrr)filenamerfilepathfrrr read_py_file=s  r-cCs.ddlm}||}t|}t|||S)aJRead a Python file from a URL, using the encoding declared inside the file. Parameters ---------- url : str The URL from which to fetch the file. errors : str How to handle decoding errors in the file. Options are the same as for bytes.decode(), but here 'replace' is the default. skip_encoding_cookie : bool If True (the default), and the encoding declaration is found in the first two lines, that line will be excluded from the output. Returns ------- A unicode string containing the contents of the file. r)urlopen)urllib.requestr.iorrr)urlr rr.responserrrr read_py_urlSs r3)rT)T)rT)__doc__r0rrpathlibrretokenizerrcompileUNICODE cookie_rer"rrr-r3rrrrs