Edit File: lexer.cpython-37.pyc
B �C] B � @ s\ d Z ddlZddlZddlmZ ddlmZ ddlmZ ddlmZ i Z G dd� de �Z dS ) zGprovides the Lexer class for parsing template strings into parse trees.� N)�compat)� exceptions)� parsetree)�adjust_whitespacec @ s� e Zd Zd$dd�Zedd� �Zd%dd�Zd d � Zd d � Zd d� Z e � d�Z dd� Z dd� Zdd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d!� Zd"d#� ZdS )&�LexerNFc C s� || _ || _t�| j�| _d| _d| _d| _d| _g | _ g | _ g | _ || _ || _ tjrd|rdt�d��|d krtg | _nt|d�s�|g| _n|| _d S )N� r z4Mako for Python 3 does not support disabling Unicode�__iter__)�text�filenamer Z TemplateNode�template�matched_lineno�matched_charpos�lineno�match_position�tag� control_line� ternary_stack�disable_unicode�encodingr Zpy3kr ZUnsupportedError� preprocessor�hasattr)�selfr r r Zinput_encodingr � r �;/opt/alt/python37/lib/python3.7/site-packages/mako/lexer.py�__init__ s( zLexer.__init__c C s | j | j| j| jd�S )N)�sourcer �posr )r r r r )r r r r �exception_kwargs6 s zLexer.exception_kwargsc C sX yt ||f }W n< tk rL |r2t�||�}n t�|�}|t ||f< Y nX | �|�S )z>compile the given regexp, cache the reg, and call match_reg().)� _regexp_cache�KeyError�re�compile� match_reg)r Zregexp�flags�regr r r �match? s z Lexer.matchc C s� | j }|�| j| j �}|r�|�� \}}||kr:|d | _ n|| _ | j| _t�d| j|| j � �}|d }x,|dkr�|| jk r�| j| dkr�|d8 }qjW || | _ | jt |�7 _|S )z�match the given regular expression object to the current text position. if a match occurs, update the current text and line position. r z\nr � ) r r% r �spanr r r �findall� textlengthr �len)r r$ �mpr% �start�end�linesZcpr r r r" M s " zLexer.match_regc G sR | j }d�|�}d}d}d}�x.| �d�}|r0q | �dtj�}|rDq | �d| �}|r�|rr|dks�|dks�|dks�| j|| j t|�d�� � |�d�fS |s�| �d| tj�}|�r0||�d��d�7 }||�d��d �8 }||�d��d �7 }||�d��d �8 }||�d��d �7 }||�d��d �8 }q t j dd�|� f| j ��q W d S )N�|r z#.*\nz+(\"\"\"|\'\'\'|\"|\')[^\\]*?(\\.[^\\]*?)*\1z(%s)r z(.*?)(?=\"|\'|#|%s)�{�}�(�)�[�]z Expected: %s�,) r �joinr% r �Sr r* �group�countr �SyntaxExceptionr ) r Z watch_nestingr �startposZtext_reZ brace_levelZ paren_levelZ bracket_levelr% r r r �parse_until_textk s@ zLexer.parse_until_textc O s� |� d| j� |� d| j� |� d| j� | j|d< |||�}t| j�r\| jd j�|� n| j j�|� | j r�| j d }|j�|� t |t j �r�|�|j�s�| jr�| jd r�| jd d j�|� t |t j�r�t| j�r�| jd |_| j�|� n�t |t j ��r�|j�r | j �� | j�� n�|j�rB| j �|� | j�g � nl| j �rp| j d �|j��rp| jd �|� n>| j �r�| j d �|j��s�tjd|j| j d jf f| j��d S )Nr r r r ���z1Keyword '%s' not a legal ternary for keyword '%s')� setdefaultr r r r r* r Znodes�appendr r � isinstancer � ControlLineZ is_ternary�keywordr �Tag�parent�isend�popZ is_primaryr r; r )r Znodecls�args�kwargs�nodeZ control_framer r r � append_node� sF zLexer.append_nodez #.*coding[:=]\s*([-\w.]+).*\r?\nc C s& t |tj�r6| j�|�}|r&|�d�p,|p,d}||fS |�tj�r�|t tj�d� }d}| j�|� dd��}|dk r�|�d�dkr�t � d|�d� |� dd�dd|��n,| j�|� dd��}|r�|�d�}n|p�d}|�r y|� |�}W n4 t k �r t � d| |� dd�dd|��Y nX ||fS ) z�given string/unicode or bytes/string, determine encoding from magic encoding comment, return body as unicode or raw if decode_raw=False r �asciiNzutf-8�ignorezHFound utf-8 BOM in file, with conflicting magic encoding comment of '%s'r z0Unicode decode operation of encoding '%s' failed)rA r Z text_type� _coding_rer% r9 � startswith�codecs�BOM_UTF8r* �decoder �CompileException�UnicodeDecodeError)r r Z decode_rawZknown_encodingr �mr Zparsed_encodingr r r �decode_raw_stream� s@ zLexer.decode_raw_streamc C s< | � | j| j | j| j�\| _| _x| jD ]}|| j�| _q*W | �| j� t| j�| _ xz| j | j krfP | � � rpP | � � rzqX| � � r�qX| �� r�qX| �� r�qX| �� r�qX| �� r�qX| �� r�qX| j | j kr�P t�d��qXW t| j�r�tjd| jd j f| j��t| j��r6t�d| jd j | j| jd j| jd j| j��| j S )Nzassertion failedzUnclosed tag: <%%%s>r> z"Unterminated control keyword: '%s') rV r r r r r r" rN r* r) r � match_end�match_expression�match_control_line� match_comment�match_tag_start� match_tag_end�match_python_block� match_textr rS r r; rC r r r r r )r Zpreprocr r r �parse� sR z Lexer.parsec C s� | � dtjtjB tjB �}|r�|�� \}}}|| _i }|rvx:t�d|�D ]*}|\}}} |p\| } | �dd�} | ||< qHW | � t j ||� |r�| j � � nR|dkr�| � dtj�}|s�tjd| j d j f| j��| � t j|�d �� | �� S d S d S d S ) Na+ \<% # opening tag ([\w\.\:]+) # keyword ((?:\s+\w+|\s*=\s*|".*?"|'.*?')*) # attrname, = \ # sign, string expression \s* # more whitespace (/)?> # closing z)\s*(\w+)\s*=\s*(?:'([^']*)'|\"([^\"]*)\")z r& r z(.*?)(?=\</%text>)zUnclosed tag: <%%%s>r> r TF)r% r �Ir8 �X�groupsrC r( �replacerK r rD r rG r r; r �Textr9 r\ ) r r% rC �attrrF Z attributesZatt�keyZval1Zval2r r r r r[ ) s6 zLexer.match_tag_startc C s� | � d�}|r~t| j�s4tjd|�d� f| j��n<| jd j|�d�krptjd|�d�| jd jf f| j��| j�� dS dS d S )Nz\</%[\t ]*(.+?)[\t ]*>z(Closing tag without opening tag: </%%%s>r r> z.Closing tag </%%%s> does not match tag: <%%%s>TF) r% r* r r r; r9 r rC rG )r r% r r r r\ X s zLexer.match_tag_endc C s0 | � dtj�}|r(|�� }|r"|S dS ndS d S )Nz\ZTF)r% r r8 r9 )r r% �stringr r r rW l s zLexer.match_endc C s@ | � dtjtjB �}|r8|�d�}|r4| �tj|� dS dS d S )Na� (.*?) # anything, followed by: ( (?<=\n)(?=[ \t]*(?=%|\#\#)) # an eval or line-based # comment preceded by a # consumed newline and whitespace | (?=\${) # an expression | (?=</?[%&]) # a substitution or block or call start or end # - don't consume | (\\\r?\n) # an escaped newline - throw away | \Z # end of string )r TF)r% r ra r8 r9 rK r rd )r r% r r r r r^ w s zLexer.match_textc C sd | � d�}|r\| j| j }}| �dd�\}}t|�d }| jtj||�d�dk||d� dS dS d S ) Nz<%(!)?Fz%>r& r �!)r r T) r% r r r= r rK r ZCoder9 )r r% �liner r r- r r r r] � s zLexer.match_python_blockc C s~ | � d�}|rv| j| j }}| �ddd�\}}|dkrH| �dd�\}}nd}|�dd�}| jtj||�� ||d � dS d S d S ) Nz\${Tz\|r1 r/ � z r& )r r F) r% r r r= rc rK r � Expression�strip)r r% ri r r r- Zescapesr r r rX � s zLexer.match_expressionc C s� | � dtj�}|r�|�d�}|�d�}|dkr�t� d|�}|sRtjd| f| j��|�dd�\}}|d k }|r�t| j�s�tjd||f f| j��n0| jd j |kr�tjd || jd j f f| j��| � t j |||� n| � t j |� d S d S d S ) NzB(?<=^)[\t ]*(%(?!%)|##)[\t ]*((?:(?:\\r?\n)|[^\r\n])*)(?:\r?\n|\Z)r � �%z(end)?(\w+)\s*(.*)zInvalid control line: '%s'z!No starting keyword '%s' for '%s'r> z'Keyword '%s' doesn't match keyword '%s'TF)r% r �Mr9 r r; r r* r rC rK r rB �Comment)r r% �operatorr �m2rF rC r r r rY � s: zLexer.match_control_linec C s2 | � dtj�}|r*| �tj|�d�� dS dS dS )z*matches the multiline version of a commentz<%doc>(.*?)</%doc>r TFN)r% r r8 rK r rp r9 )r r% r r r rZ � s zLexer.match_comment)NFNN)N)�__name__� __module__� __qualname__r �propertyr r% r" r= rK r r! rN rV r_ r[ r\ rW r^ r] rX rY rZ r r r r r s( (/ .7/ 'r ) �__doc__rP r �makor r r Z mako.pygenr r �objectr r r r r �<module> s