Edit File: driver.cpython-36.pyc
3 \� � @ s� d Z dZddgZddlZddlZddlZddlZddlZddlZddl m Z m Z m Z m Z mZ G dd� de�Zd d � Zddd�Zdd� Zdd� Zdd� Zedkr�ejee� �� dS )zZParser driver. This provides a high-level interface to parse a file into a syntax tree. z#Guido van Rossum <guido@python.org>�Driver� load_grammar� N� )�grammar�parse�token�tokenize�pgenc @ sH e Zd Zddd�Zddd�Zddd�Zdd d �Zdd d �Zdd d�ZdS )r Nc C s& || _ |d krtj� }|| _|| _d S )N)r �logging� getLogger�logger�convert)�selfr r r � r �,/usr/lib64/python3.6/lib2to3/pgen2/driver.py�__init__ s zDriver.__init__Fc C s� t j| j| j�}|j� d}d}d } } } } } d} �xR|D �]4} | \}}}} } |||fkr�||f|ks|t||f|f��|\} }|| k r�| d| | 7 } | }d}||k r�| | ||� 7 } |}|tjtjfkr�| |7 } | \}}|j d�r@|d7 }d}q@|t j k�rtj | }|�r,| j jdt j| || � |j||| |f��rT|�rR| j jd� P d} | \}}|j d�r@|d7 }d}q@W t jd||| |f��|jS ) z4Parse a series of tokens and return the syntax tree.r r N� � z%s %r (prefix=%r)zStop.zincomplete input)r ZParserr r Zsetup�AssertionErrorr �COMMENT�NL�endswithr �OPZopmapr �debug�tok_nameZaddtokenZ ParseErrorZrootnode)r �tokensr �p�lineno�column�type�value�start�endZ line_text�prefixZ quintupleZs_linenoZs_columnr r r � parse_tokens' sT zDriver.parse_tokensc C s t j|j�}| j||�S )z*Parse a stream and return the syntax tree.)r �generate_tokens�readliner$ )r �streamr r r r r �parse_stream_rawW s zDriver.parse_stream_rawc C s | j ||�S )z*Parse a stream and return the syntax tree.)r( )r r' r r r r � parse_stream\ s zDriver.parse_streamc C s* t j|d|�}z | j||�S |j� X dS )z(Parse a file and return the syntax tree.�rN)�codecs�openr) �close)r �filename�encodingr r' r r r � parse_file` s zDriver.parse_filec C s t jtj|�j�}| j||�S )z*Parse a string and return the syntax tree.)r r% �io�StringIOr& r$ )r �textr r r r r � parse_stringh s zDriver.parse_string)NN)F)F)F)NF)F) �__name__� __module__� __qualname__r r$ r( r) r0 r4 r r r r r s 0 c C s: t jj| �\}}|dkr d}|| djtttj�� d S )Nz.txtr �.z.pickle)�os�path�splitext�join�map�str�sys� version_info)�gt�head�tailr r r �_generate_pickle_namen s rD � Grammar.txtTFc C s� |dkrt j� }|dkr t| �n|}|s4t|| � r�|jd| � tj| �}|r�|jd|� y|j|� W q� tk r� } z|jd|� W Y dd}~X q�X nt j � }|j |� |S )z'Load the grammar (maybe from a pickle).Nz!Generating grammar tables from %sz Writing grammar tables to %szWriting failed: %s) r r rD �_newer�infor Zgenerate_grammar�dump�OSErrorr �Grammar�load)rA Zgp�save�forcer �g�er r r r u s c C s8 t jj| �sdS t jj|�s dS t jj| �t jj|�kS )z0Inquire whether file a was written since file b.FT)r9 r: �exists�getmtime)�a�br r r rF � s rF c C sF t jj|�rt|�S tt jj|��}tj| |�}tj � }|j |� |S )a� Normally, loads a pickled grammar by doing pkgutil.get_data(package, pickled_grammar) where *pickled_grammar* is computed from *grammar_source* by adding the Python version and using a ``.pickle`` extension. However, if *grammar_source* is an extant file, load_grammar(grammar_source) is called instead. This facilitates using a packaged grammar file when needed but preserves load_grammar's automatic regeneration behavior when possible. ) r9 r: �isfiler rD �basename�pkgutil�get_datar rJ �loads)�packageZgrammar_sourceZ pickled_name�datarN r r r �load_packaged_grammar� s r[ c G sF | st jdd� } tjtjt jdd� x| D ]}t|ddd� q,W dS )z�Main program, when run as a script: produce grammar pickle files. Calls load_grammar for each argument, a path to a grammar text file. r Nz %(message)s)�levelr' �formatT)rL rM )r? �argvr Z basicConfig�INFO�stdoutr )�argsrA r r r �main� s rb �__main__)rE NTFN)�__doc__� __author__�__all__r+ r1 r9 r rV r? r r r r r r �objectr rD r rF r[ rb r5 �exit�intr r r r �<module> s$ P