Edit File: test_io.cpython-37.pyc
B ��Fda. � @ s� d dl mZmZmZ d dlZd dlZd dlZd dlZd dlm Z d dl Z d dl Z d dl Z d dl mZ d dlmZ d dlZd dlmZ d dlmZmZ d dlmZmZmZmZ d dl m Z d d l m Z m Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z* G d d � d e�Z+ej,dd � \Z-Z.ej/d kZ0d+dd�Z1G dd� de2�Z3G dd� de3e �Z4G dd� de3e �Z5G dd� de �Z6G dd� de �Z7G dd� de �Z8G d d � d e �Z9G d d � d e �Z:d d!� Z;d"d#� Z<d$d%� Z=d&d'� Z>d(d)� Z?e@d*k�r�e � dS ),� )�division�absolute_import�print_functionN)�NamedTemporaryFile)�BytesIO)�datetime)�ConverterError�ConversionWarning)�asbytes�bytes�unicode�Path)� assert_equal) �TestCase�run_module_suite� assert_warns�assert_�assert_raises_regex� assert_raises�assert_allclose�assert_array_equal�temppath�dec�IS_PYPY�suppress_warningsc @ s* e Zd ZdZd dd�Zdd� Zdd� Zd S ) �TextIOz�Helper IO class. Writes encode strings to bytes if needed, reads return bytes. This makes it easier to emulate files opened in binary mode without needing to explicitly convert strings to bytes in setting up the test data. � c C s t �| t|�� d S )N)r �__init__r )�self�s� r ��/builddir/build/BUILDROOT/alt-python37-numpy-1.13.3-8.el8.x86_64/opt/alt/python37/lib64/python3.7/site-packages/numpy/lib/tests/test_io.pyr # s zTextIO.__init__c C s t �| t|�� d S )N)r �writer )r r r r r! r" & s z TextIO.writec C s t �| dd� |D �� d S )Nc S s g | ] }t |��qS r )r )�.0r r r r! � <listcomp>* s z%TextIO.writelines.<locals>.<listcomp>)r � writelines)r �linesr r r! r% ) s zTextIO.writelinesN)r )�__name__� __module__� __qualname__�__doc__r r" r% r r r r! r s r � l c C sH t jd dkr,tt�| �d�|�dd� � S tt�| |�dd� � S dS )zY This function is available in the datetime module only from Python >= 2.5. r � �latin1N)�sys� version_infor �time�strptime�decode)r �fmtr r r! r1 1 s r1 c @ sh e Zd Zdd� Zdd� Zdd� Zdd� Zd d � Zej j � e j d kd �d d� �Zdd� Ze jdd� �ZdS )� RoundtripTestc O s� |� di �}|� di �}|� dd�}|r:tdd�}|j}n t� }|}z`|} ||f| �|� |�� |�d� tjdkr�t|t�s�|� � t j |f|�} | | _ | | _ W dt|t�s�|� � d t� kr�t| t jjj�s�t�|j� X dS ) a� save_func : callable Function used to save arrays to file. file_on_disk : bool If true, store the file on disk, instead of in a string buffer. save_kwds : dict Parameters passed to `save_func`. load_kwds : dict Parameters passed to `numpy.load`. args : tuple of arrays Arrays stored to file. � save_kwds� load_kwds� file_on_diskF)�deleter �win32N� arr_reloaded)�getr �namer �flush�seekr. �platform� isinstance�close�np�load�arrr: �locals�lib�npyio�NpzFile�os�remove) r Z save_func�args�kwargsr5 r6 r7 � target_fileZ load_filerD r: r r r! � roundtrip> s. zRoundtripTest.roundtripc C s� | � |� | j |dd� | � t�|�� | j t�|�dd� |jd dkr~| � t�|�dd � � | j t�|�dd � dd� d S )NT)r7 r � )rN rB �asfortranarray�shape)r �ar r r! �check_roundtripsn s z RoundtripTest.check_roundtripsc C s� t �g t�}| �|� t �ddgddggt�}| �|� t �ddgddggt�}| �|� t jddgddggt jd �}| �|� t jddgddggt jd �}| �|� d S ) NrO r+ r, � y �? @y @ @y @ @y @ @)�dtype)rB �array�floatrS �int�csingle�cdouble)r rR r r r! � test_arrayx s zRoundtripTest.test_arrayc C s< t �g t�}| �|� t �ddgddggt�}| �|� d S )NrO r+ r, rT )rB rV �objectrS )r rR r r r! �test_array_object� s z RoundtripTest.test_array_objectc C s" t �ddddgt�}| �|� d S )NrO r+ r, rT )rB rV rX rN )r rR r r r! �test_1D� s zRoundtripTest.test_1Dr9 z Fail on Win32c C sX t �ddgddgg�}| j|dddid� t �ddgddgg�}| j|dddid� d S ) NrO g @rT g333333 @T� mmap_mode�r)r7 r6 )rB rV rN rP )r rR r r r! � test_mmap� s zRoundtripTest.test_mmapc C s$ t jddgddgd�}| �|� d S )N)rO r+ )r, rT )�x�i4)�yrc )rU )rB rV rS )r rR r r r! � test_record� s zRoundtripTest.test_recordc C sT dd� t d�D �}tjd|d�}tjdd�� t�dd t� | �|� W d Q R X d S ) Nc S s g | ]}d | d t f�qS )z%d�d )rW )r# �ir r r! r$ � s z1RoundtripTest.test_format_2_0.<locals>.<listcomp>i� i� )rU T)�record�alwaysr )�rangerB �ones�warnings�catch_warnings�filterwarnings� UserWarningrS )r �dtrR r r r! �test_format_2_0� s z RoundtripTest.test_format_2_0N)r' r( r) rN rS r[ r] r^ rB �testingr �knownfailureifr. r? ra re �slowrq r r r r! r4 = s 0 r4 c @ s e Zd Zdd� ZdS )� TestSaveLoadc O s\ t j| tjf|�|� t| jd | j� t| jd j| jj� t| jd jj | jjj � d S )Nr ) r4 rN rB �saver rD r: rU �flags�fnc)r rK rL r r r! rN � s zTestSaveLoad.roundtripN)r' r( r) rN r r r r! ru � s ru c @ s� e Zd Zdd� Zejj�e d�ejjj dd� ��Z dd� Z dd � Z d d � Z d d � Zdd� Zejj�ed�dd� �Zdd� ZdS )� TestSavezLoadc O s� t j| tjf|�|� zTxNt| j�D ]@\}}| jd| }t||� t|j|j� t|j j |j j � q$W W d | jj r�| jj � � t �| jj j� X d S )Nzarr_%d)r4 rN rB �savez� enumeraterD r: r rU rw rx �fidrA rI rJ r< )r rK rL �nrD Zreloadedr r r! rN � s zTestSavezLoad.roundtripz Works only with 64bit systemsc C s\ d}t j|t jd�}tddd��2}t j||d� ~t �|�}|d }|�� ~W d Q R X d S )Nl � )rU Znumpy_test_big_arrays_z.npz)�prefix�suffix)rR rR )rB �empty�uint8r rz rC rA )r �LrR �tmpZnpfiler r r! �test_big_arrays� s z TestSavezLoad.test_big_arraysc C s@ t �ddgddggt�}t �ddgddggt�}| �||� d S ) NrO r+ r, rT y �? @y @ @y @ �y @ (@)rB rV rW �complexrN )r rR �br r r! �test_multiple_arrays� s z"TestSavezLoad.test_multiple_arraysc C sz t �ddgddggt�}t �ddgddggt�}t� }t j|||d � |�d � t �|�}t||d � t||d � d S ) NrO r+ r, rT y �? @y @ @y @ �y @ (@)�file_a�file_br r� r� ) rB rV rW r� r rz r> rC r )r rR r� �c�lr r r! �test_named_arrays� s z TestSavezLoad.test_named_arraysc C s� t �ddgddggt�}t �ddgddggt�}t� }t j|||d � |�d � t �|�}tt t |j ��d d g� t||j j � t||j j � d S ) NrO r+ r, rT y �? @y @ @y @ �y @ (@)r� r� r r� r� )rB rV rW r� r rz r> rC r �sorted�dir�fr� r� )r rR r� r� r� r r r! � test_BagObj� s zTestSavezLoad.test_BagObjc s` dd� �g � � �fdd�t d�D �}x|D ] }|�� q*W x|D ] }|�� q@W � r\t� ��d S )Nc S sh t dd��T}tj�dd�}ytj||d� W n, tk rX } z| �|� W d d }~X Y nX W d Q R X d S )Nz.npz)r i� )rD )r rB �random�randnrz �OSError�append)Z error_listr� rD �errr r r! �writer� s z9TestSavezLoad.test_savez_filename_clashes.<locals>.writerc s g | ]}t j�� fd ��qS ))�targetrK )� threading�Thread)r# �j)�errorsr� r r! r$ � s z=TestSavezLoad.test_savez_filename_clashes.<locals>.<listcomp>r, )rj �start�join�AssertionError)r �threads�tr )r� r� r! �test_savez_filename_clashes� s z)TestSavezLoad.test_savez_filename_clashesc C s� t dd���}t|d��}tj|dd� W d Q R X t|dd��L}|�d� t|j � t�|�d t|j � |�d� t|j � W d Q R X W d Q R X d S ) Nz.npz)r �wbz LOVELY LOAD)�data�rbi' r r� )r �openrB rz r> r �closedrC )r r� �fpr r r! �test_not_closing_opened_fid� s z)TestSavezLoad.test_not_closing_opened_fidz context manager required on PyPyc C s� t dd���}tj|dd� t� �j}|�t� xXtdd�D ]J}yt�|�d W q8 tk r� } zd| }t |��W d d }~X Y q8X q8W W d Q R X W d Q R X d S ) Nz.npz)r z LOVELY LOAD)r� rO i r� z#Failed to load data from a file: %s) r rB rz r �filter�Warningrj rC � Exceptionr� )r r� �suprg �e�msgr r r! �test_closing_fid s z TestSavezLoad.test_closing_fidc C sR d}t d|d��8}tj|dd� t�|�}|jj}|�� t|j� W d Q R X d S )NZ&numpy_test_closing_zipfile_after_load_z.npz)r r~ z place holder)�lab) r rB rz rC �zipr� rA r r� )r r~ r� r� r� r r r! � test_closing_zipfile_after_load% s z-TestSavezLoad.test_closing_zipfile_after_loadN)r' r( r) rN rB rr r �skipif�IS_64BITrt r� r� r� r� r� r� r r� r� r r r r! ry � s ry c @ sT e Zd Zdd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dS )� TestSaveTxtc C s� t �ddgddggt�}d}t� }t j|||d� |�d� t|�� t|d | d d �t|d | d d �g� t �ddgddggt �}t� }t j||d d� |�d� t|�� d dg� d S )NrO r+ r, rT z%.18e)r3 r � � )rO r+ )r, rT z%ds 1 2 s 3 4 ) rB rV rW r �savetxtr> r � readlinesr rX )r rR r3 r� r r r! r[ 4 s zTestSaveTxt.test_arrayc C sR t �ddddgt�}t� }t j||dd� |�d� |�� }t|dd d d g� d S ) NrO r+ r, rT z%d)r3 r s 1 s 2 s 3 s 4 )rB rV rX r r� r> r� r )r rR r� r& r r r! r^ D s zTestSaveTxt.test_1Dc C sL t jddgddgd�}t� }t j||dd� |�d� t|�� d d g� d S ) N)rO r+ )r, rT )rb rc )rd rc )rU z%d)r3 r s 1 2 s 3 4 )rB rV r r� r> r r� )r rR r� r r r! re L s zTestSaveTxt.test_recordc C sN t �ddgddgg�}t� }t j||ddd� |�d� t|�� d d g� d S ) Ng �?g @g @g @�,z%d)� delimiterr3 r s 1,2 s 3,4 )rB rV r r� r> r r� )r rR r� r r r! �test_delimiterS s zTestSaveTxt.test_delimiterc C s� t �ddg�}t� }t j||ddgd� |�d� t|�� ddg� t� }t j||d d� |�d� |�� }t|d d g� t� }t j||d d d � |�d� |�� }t|d d g� t� }ttt j||dd� d S )N)rO r+ )r, rT z%02dz%3.1f)r3 r s 01 2.0 s 03 4.0 z %02d : %3.1fs 01 : 2.0 s 03 : 4.0 r� )r3 r� �c ) rB rV r r� r> r r� r � ValueError)r rR r� r& r r r! � test_formatZ s" zTestSaveTxt.test_formatc C s t � }tjddgtjd�}d}tj||d|d� |�d� t|�� td| d �� t � }tj||d|d � |�d� t|�� td | d �� t � }d }tj||d||d� |�d� t|�� t|| d d �� t � }d }tj||d||d� |�d� t|�� td| | d �� d S )N)rO r+ )r, rT )rU zTest header / footerz%1d)r3 �headerr z# z 1 2 3 4 )r3 �footerz 1 2 3 4 # r� z% )r3 r� �commentsz1 2 3 4 )r3 r� r� ) r rB rV rX r� r> r �readr )r r� rR �test_header_footerZ commentstrr r r! r� t s4 z TestSaveTxt.test_header_footerc C sD t � �4}t�ddg�}t�||� t�|�}t||� W d Q R X d S )N)rO r+ )r, rT )r rB rV r� �loadtxtr )r r< rR r� r r r! �test_file_roundtrip� s z TestSaveTxt.test_file_roundtripc C s� d}d}t j||ft jd�}t j}t j}|d| |d d �< t� }t j||dd� |�d� |�� }t |ddg� t� }t j||d| d� |�d� |�� }t |d d g� t� }t j||d g| d� |�d� |�� }t |d d g� d S ) Nr+ )rU y �?z %+.3e)r3 r s8 ( +3.142e+00+ +2.718e+00j) ( +3.142e+00+ +2.718e+00j) z %+.3e %+.3es1 +3.142e+00 +2.718e+00 +3.142e+00 +2.718e+00 z (%.3e%+.3ej)s. (3.142e+00+2.718e+00j) (3.142e+00+2.718e+00j) ) rB �zeros� complex128�pir� r r� r> r� r )r �ncols�nrowsrR �re�imr� r& r r r! �test_complex_arrays� s< z TestSaveTxt.test_complex_arraysc C sH G dd� dt �}|� }t�ddg�}t�||� t�|�}t||� d S )Nc @ s e Zd Zdd� ZdS )z4TestSaveTxt.test_custom_writer.<locals>.CustomWriterc S s | � |�d�� d S )N� )�extend�split)r �textr r r! r" � s z:TestSaveTxt.test_custom_writer.<locals>.CustomWriter.writeN)r' r( r) r" r r r r! � CustomWriter� s r� )rO r+ )r, rT )�listrB rV r� r� r )r r� �wrR r� r r r! �test_custom_writer� s z TestSaveTxt.test_custom_writerN) r' r( r) r[ r^ re r� r� r� r� r� r� r r r r! r� 3 s "&r� c @ s� e Zd Zdd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)d*� Zd+d,� Zd-d.� Zd/d0� Zd1d2� Zd3d4� Z d5d6� Z d7d8� Z d9d:� Z d;S )<� TestLoadTxtc C s� t � }|�d� |�d� tj|dtjfdtjfgd�}tjddgdd gd�}t||� t � }|�d � |�d� d d d �}tjddg|d�}tj||d�}t||� d S )Nz1 2 3 4r rb rd )rU )rO r+ )r, rT )rb rc )rd rc zM 64.0 75.0 F 25.0 60.0)�gender�age�weight)�S1rc �f4)�names�formats)�Mg P@g �R@)�Fg 9@g N@)r r" r> rB r� �int32rV r )r r� rb rR �dZ mydescriptorr� rd r r r! re � s zTestLoadTxt.test_recordc C s� t � }|�d� |�d� tj|tjd�}t�ddgddggt�}t||� |�d� tj|td�}t�ddgddggt�}t||� d S )Nz1 2 3 4r )rU rO r+ r, rT ) r r" r> rB r� rX rV r rW )r r� rb rR r r r! r[ � s zTestLoadTxt.test_arrayc C s� t � }|�d� |�d� tj|td�}t�ddddgt�}t||� t � }|�d� |�d� tj|td d �}t�ddddgt�}t||� d S ) Nz1 2 3 4 r )rU rO r+ r, rT z1,2,3,4 r� )rU r� )r r" r> rB r� rX rV r )r r� rb rR r r r! r^ � s zTestLoadTxt.test_1Dc C sX t � }|�d� |�d� tj|tdddd� id�}t�dd dd d gt�}t||� d S ) Nz 1,2,3,,5 r r� r, c S s t | pd�S )Ni���)rX )r r r r! �<lambda> � z*TestLoadTxt.test_missing.<locals>.<lambda>)rU r� � convertersrO r+ i���� )r r" r> rB r� rX rV r )r r� rb rR r r r! � test_missing s zTestLoadTxt.test_missingc C s\ t � }|�d� |�d� tj|tdddd� idd�}t�d d gd d ggt�}t||� d S ) Nz1,2,3,,5 6,7,8,9,10 r r� r, c S s t | pd�S )Ni���)rX )r r r r! r� r� z:TestLoadTxt.test_converters_with_usecols.<locals>.<lambda>)rO r, )rU r� r� �usecolsr+ i���� � )r r" r> rB r� rX rV r )r r� rb rR r r r! � test_converters_with_usecols s z(TestLoadTxt.test_converters_with_usecolsc C sN t � }|�d� |�d� tj|tddd�}t�dddd gt�}t||� d S ) Nz# comment 1,2,3,5 r r� �#)rU r� r� rO r+ r, r� )r r" r> rB r� rX rV r )r r� rb rR r r r! �test_comments_unicode s z!TestLoadTxt.test_comments_unicodec C sN t � }|�d� |�d� tj|tddd�}t�dddd gt�}t||� d S ) Nz# comment 1,2,3,5 r r� � #)rU r� r� rO r+ r, r� )r r" r> rB r� rX rV r )r r� rb rR r r r! �test_comments_byte s z TestLoadTxt.test_comments_bytec C s\ t � }|�d� |�d� tj|tddddgd�}t�dd d gd d d ggt�}t||� d S )Nz,# comment 1,2,3 @ comment2 4,5,6 // comment3r r� r� �@z//)rU r� r� rO r+ r, rT r� � )r r" r> rB r� rX rV r )r r� rb rR r r r! �test_comments_multiple% s z"TestLoadTxt.test_comments_multiplec C s~ t � }|�d� |�d� tj|tddd�}t�dddd gt�}t||� t � }|�d � |�d� tt tj|tddd� d S ) Nz/* comment 1,2,3,5 r r� z/*)rU r� r� rO r+ r, r� z*/ comment 1,2,3,5 ) r r" r> rB r� rX rV r r r� )r r� rb rR r r r! �test_comments_multi_chars. s z%TestLoadTxt.test_comments_multi_charsc C s� t � }|�d� |�d� tj|tddd�}t�ddddgt�}t||� t � }|�d � |�d� tj|tddd�}t�ddddgt�}t||� d S ) Nzcomment 1,2,3,5 r r� rO )rU r� �skiprowsr+ r, r� z# comment 1,2,3,5 )r r" r> rB r� rX rV r )r r� rb rR r r r! � test_skiprows> s zTestLoadTxt.test_skiprowsc C s� t �ddgddggt�}t� }t �||� |�d� t j|tdd�}t||d d �df � t �dddgdddggt�}t� }t �||� |�d� t j|td d�}t||d d �dd �f � |�d� t j|tt �ddg�d�}t||d d �dd �f � xhtt j t j t j t j t j t jt jt jg D ]>}|d�}|�d� t j|t|d�}t||d d �df � �q"W G d d � d t�}|� }|�d� t j|t|d�}t||d d �df � |�d� t j|t|fd�}t||d d �df � d }t|�}d dg} ddg} t j|dtt| | ��d�} t| d ddg� t| d ddg� |�d� d} ttdt| � t j|| d� ttdt| � t j|d| dgd� d S )NrO r+ r, rT r )rO )rU r� r� )rO r+ c @ s e Zd Zdd� ZdS )z*TestLoadTxt.test_usecols.<locals>.CrazyIntc S s dS )NrO r )r r r r! � __index__n s z4TestLoadTxt.test_usecols.<locals>.CrazyInt.__index__N)r' r( r) r� r r r r! �CrazyIntm s r� z<JOE 70.1 25.3 BOB 60.5 27.9 �stid�temp�S4�f8)r r+ )r� rU s JOEs BOBg�����L9@gfffff�;@g �?z^usecols must be.*%s)r� )rB rV rW r r� r> r� r rX �int8�int16r� �int64r� �uint16�uint32�uint64r\ r r� r� r r � TypeError�type) r rR r� rb �int_typeZto_readr� Z crazy_intr� r� �dtypesrD Z bogus_idxr r r! � test_usecolsO s^ zTestLoadTxt.test_usecolsc C sj t � }|�d� |�d� t�dtfddtfdtfgfg�}tj||dd�}t�d d g|�}t ||� d S ) Nz1,2,3.0 4,5,6.0 r rb rd r� r r� )rU r� )rO )r+ g @)rT )r� g @) r r" r> rB rU rX rW r� rV r )r r� rp rb rR r r r! �test_fancy_dtype� s "z TestLoadTxt.test_fancy_dtypec C sl t d�}t�ddtfdtfdtdfg�}tj||d�}tjdd d d d d gdddggfg|d�}t||� d S )Nzaaaa 1.0 8.0 1 2 3 4 5 6)r< r� rb rd �block)r+ r, )rU �aaaag �?g @rO r+ r, rT r� r� )r rB rU rW rX r� rV r )r r� rp rb rR r r r! �test_shaped_dtype� s z TestLoadTxt.test_shaped_dtypec C s� t d�}t�ddtfdtfdtdfg�}tj||d�}tjdd d d d d gdddggdddgdddgggfg|d�}t||� d S )Nz*aaaa 1.0 8.0 1 2 3 4 5 6 7 8 9 10 11 12)r< r� rb rd r )r+ r+ r, )rU r g �?g @rO r+ r, rT r� r� r� � r� � � � )r rB rU rW rX r� rV r )r r� rp rb rR r r r! �test_3d_shaped_dtype� s *z TestLoadTxt.test_3d_shaped_dtypec C sJ ddg}x<t tjfD ].}tjddg|d�}tj||d�}t||� qW d S )NZstr1Zstr2)rU )�strrB �bytes_rV r� r )r r� rp rR rb r r r! �test_str_dtype� s zTestLoadTxt.test_str_dtypec C sj t � �Z}|jdd� t� }t�|�}t|jd� tj|tjd�}t|jd� t|j tjk� W d Q R X d S )Nzloadtxt: Empty input file:)�message)r )rU ) r r� r rB r� r rQ r� r rU )r r� r� rb r r r! �test_empty_file� s zTestLoadTxt.test_empty_filec C sx t � }|�ddg� |�d� tj|dddd� id�}t|dd g� |�d� tj|dd d d� id�}t|d d g� d S )Nz1 21 z3 42 r )rO c S s t | d�S )N� )rX )r r r r! r� � r� z3TestLoadTxt.test_unused_converter.<locals>.<lambda>)r� r� � �* rO c S s t | d�S )Nr )rX )r r r r! r� � r� �! �B )r r% r> rB r� r )r r� r� r r r! �test_unused_converter� s z!TestLoadTxt.test_unused_converterc C st d}dt fdtjfg}dd� }d|i}tjt|�d||d�}tjdtd dd�fd td dd �fg|d �}t||� d S )Nz0 1; 2001-01-01 2; 2002-01-31 �idx�codec S s t | �� d�S )Nz%Y-%m-%d)r1 �strip)r r r r! r� � r� z4TestLoadTxt.test_dtype_with_object.<locals>.<lambda>rO �;)r� rU r� i� r+ i� � )rU )rX rB r\ r� r rV r r )r r� �ndtype�funcr� �test�controlr r r! �test_dtype_with_object� s z"TestLoadTxt.test_dtype_with_objectc C s@ d}t � }|�d| � |�d� tj|tjd�}t||� d S )N)l +&�| l -(�| z%s %sr )rU )r r" r> rB r� r r )r �tgtr� �resr r r! �test_uint64_type� s z TestLoadTxt.test_uint64_typec C s@ d}t � }|�d| � |�d� tj|tjd�}t||� d S )N)l�������� l ���� z%s %sr )rU )r r" r> rB r� r� r )r r% r� r& r r r! �test_int64_type� s zTestLoadTxt.test_int64_typec C s� t �ddd��t j�}t �|| f��t j�}d�ttj|��}t � }|� |� x>t jt jgD ].}|� d� t j ||d�}t ||d| d� q^W d S ) Ni����r r� r� r )rU z%s)�err_msg)rB �logspace�astype�float32�hstackrW r� �map�hexr r" r> r� r )r r% �inpr� rp r& r r r! �test_from_float_hex� s z TestLoadTxt.test_from_float_hexc C sP t dd�t dd�f}t� }|�d| � |�d� tj|tj d�}t||� d S )NrO ���z%s %sr )rU )r� r r" r> rB r� r )r r% r� r& r r r! �test_from_complex� s z TestLoadTxt.test_from_complexc C sV t � �0}t|d��}|�d� W d Q R X t�|�}W d Q R X t|ddgddgg� d S )Nr� z 1 21 3 42 rO r r, r )r r� r" rB r� r )r r< r� r� r r r! �test_universal_newline s z"TestLoadTxt.test_universal_newlinec C sV t � }|�d� |�d� ddd�}tj||dd�}t�dd d g�}t|d |� d S ) Nz 1 2 3 start 4 5 6 7 8 9.5 r )rb rd �z�comment)z<i4z<i4z<f4z|S8)r� r� � )rU r� s start s r� r6 )r r" r> rB r� rV r )r r� rp rb rR r r r! �test_empty_field_after_tab s z&TestLoadTxt.test_empty_field_after_tabc C s� t d�}ddd�}tj||dd�\}}}t|jjdk� t|jjdk� t|jjd k� t|t�d d g�� t|t�d d g�� t|t�ddg�� d S )NzM 21 72 F 35 58)rR r� r� )z|S1z<i4z<f4)r� r� T)rU �unpackz|S1z<i4z<f4� M� Fr �# g R@g M@)r rB r� r rU r r rV )r �txtrp rR r� r� r r r! �test_structure_unpack s z!TestLoadTxt.test_structure_unpackc C s� t � }|�d� |�d� tttj|dd� |�d� tttj|dd� |�d� tj|tddd�}t�dd dgd d d gg�}t ||� t � }|�d � |�d� tj|tdd d�}t |j dk� |�d� tj|tddd�}t |j dk� |�d� tj|tddd�}t |j dk� t � }|�d� |�d� tj|tdd d�}t |j dk� |�d� tj|tddd�}t |j dk� |�d� tj|tddd�}t |j dk� t � �H}|j dd� t � }t tj|d d�j dk� t tj|dd�j dk� W d Q R X d S )Nz 1,2,3 4,5,6r r, )�ndming �?r� rO )rU r� r? r+ rT r� r� z0,1,2)rO r, )r, z0 1 2)r, rO zloadtxt: Empty input file:)r )r rO )r )r r" r> r r� rB r� rX rV r r rQ r r� )r r� rb rR r� r� r� r� r r r! �test_ndmin_keyword sJ z TestLoadTxt.test_ndmin_keywordc C s( dd� }t �|� �}t|t �d�� d S )Nc s s xt d�D ]} d| V q W d S )Nr z%d)rj )rg r r r! �countK s z0TestLoadTxt.test_generator_source.<locals>.countr )rB r� r �arange)r rA r& r r r! �test_generator_sourceJ s z!TestLoadTxt.test_generator_sourcec C s. t � }|�d� |�d� ttdtj|� d S )Nz1 2 3 4 5 6 2 3r �3)r r" r> r r� rB r� )r r� r r r! � test_bad_lineR s zTestLoadTxt.test_bad_linec C sH t � }|�d� |�d� t�dtfddtfg�}tj|d|d d� d S )Nz100,foo,200 300,None,400r rb )rR �S10rd r� )r� rU r� )r r" r> rB rU rX r� )r r� rp r r r! �test_none_as_stringZ s z TestLoadTxt.test_none_as_stringN) r' r( r) re r[ r^ r� r� r� r� r� r� r� r r r r r r r r$ r' r( r1 r3 r4 r8 r> r@ rC rE rG r r r r! r� � s: E +r� c @ s$ e Zd Zdd� Zdd� Zdd� ZdS )� Testfromregexc C sX t � }|�d� |�d� dtjfdg}t�|d|�}tjdddg|d �}t||� d S ) Nz 1.312 foo 1.534 bar 4.444 quxr �num)�val�S3z([0-9.]+)\s+(...))gˡE���?�foo)g%��C��?�bar)g-����@�qux)rU )r r" r> rB �float64� fromregexrV r )r r� rp rb rR r r r! re e s zTestfromregex.test_recordc C sX t � }|�d� |�d� dtjfdg}t�|d|�}tjdddg|d �}t||� d S ) Nz1312 foo 1534 bar 4444 quxr rI )rJ rK z (\d+)\s+(...))i rL )i� rM )i\ rN )rU )r r" r> rB r� rP rV r )r r� rp rb rR r r r! � test_record_2p s zTestfromregex.test_record_2c C sV t � }|�d� |�d� dtjfg}t�|d|�}tjdddg|d�}t||� d S ) Nz1312 foo 1534 bar 4444 quxr rI z (\d+)\s+...)i )i� )i\ )rU )r r" r> rB rO rP rV r )r r� rp rb rR r r r! � test_record_3{ s zTestfromregex.test_record_3N)r' r( r) re rQ rR r r r r! rH c s rH c @ s e Zd Zdd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)d*� Zd+d,� Zd-d.� Zd/d0� Zd1d2� Zd3d4� Z d5d6� Z d7d8� Z d9d:� Z d;d<� Z d=d>� Z!d?d@� Z"dAdB� Z#dCdD� Z$dEdF� Z%dGdH� Z&dIdJ� Z'dKdL� Z(dMdN� Z)dOdP� Z*dQdR� Z+dSdT� Z,dUdV� Z-dWdX� Z.dYdZ� Z/d[d\� Z0d]d^� Z1d_d`� Z2dadb� Z3dcdd� Z4dedf� Z5dgdh� Z6didj� Z7dkdl� Z8dmdn� Z9dodp� Z:dqdr� Z;dsdt� Z<dudv� Z=dwdx� Z>dydz� Z?d{d|� Z@d}d~� ZAdd�� ZBd�d�� ZCd�d�� ZDd�S )�� TestFromTxtc C s� t d�}tj|dtjfdtjfgd�}tjddgddgd�}t||� t d �}d d d �}tjd dg|d�}tj||d�}t||� d S )Nz1 2 3 4rb rd )rU )rO r+ )r, rT )rb rc )rd rc zM 64.0 75.0 F 25.0 60.0)r� r� r� )r� rc r� )r� r� )r� g P@g �R@)r� g 9@g N@)r rB � ndfromtxtr� rV r )r r� r" r# � descriptorr r r! re � s zTestFromTxt.test_recordc C sz t d�}tjddgddggtd�}tj|td�}t||� |�d� tjddgddggtd�}tj|td�}t||� d S )Nz1 2 3 4rO r+ r, rT )rU r ) r rB rV rX rT r r> rW r� )r r� r# r" r r r! r[ � s zTestFromTxt.test_arrayc C sZ t �ddddgt�}td�}t j|td�}t||� td�}t j|tdd �}t||� d S ) NrO r+ r, rT z1 2 3 4 )rU z1,2,3,4 r� )rU r� )rB rV rX r rT r )r r# r� r" r r r! r^ � s zTestFromTxt.test_1Dc C s` t �ddddgt�}td�}t j|tddd�}t||� td �}t j|tddd�}t||� d S ) NrO r+ r, r� z# comment 1,2,3,5 r� r� )rU r� r� z1,2,3,5# comment )rB rV rX r rT r )r r# r� r" r r r! � test_comments� s zTestFromTxt.test_commentsc C st t �ddddgt�}ttdd�}td�}t j|fddi|��}t||� td �}t j|fd di|��}t||� d S ) NrO r+ r, r� r� )rU r� zcomment 1,2,3,5 � skip_headerz# comment 1,2,3,5 r� )rB rV rX �dictr rT r r� )r r# rL r� r" r r r! r� � s zTestFromTxt.test_skiprowsc C s� dd� t dd�D �}|�d� |�dd� t d�D �� d|d < td d d d d�}tjtd�|��f|�}tjdd� t d�D �dd� dD �d�}t ||� d S )Nc S s g | ] }d | �qS )z# %ir )r# rg r r r! r$ � s z0TestFromTxt.test_skip_footer.<locals>.<listcomp>rO r� zA, B, Cc S s g | ]}d |||f �qS )z %i,%3.1f,%03sr )r# rg r r r! r$ � s �3 z99,99r2 r� Tr� r )r� r� rW � skip_footerr� c S s" g | ]}d | d | d | f�qS )z%fr )r# rg r r r! r$ � s �) c S s g | ] }|t f�qS r )rW )r# �_r r r! r$ � s �ABC)rU ) rj r� r� rX rB � genfromtxtr r� rV r )r r� rL r" �ctrlr r r! �test_skip_footer� s z TestFromTxt.test_skip_footerc C s( t � ��}|�t� d}tttjt|�dd� tjt|�ddd�}t|t� ddgddgddgd d gg�� tjt|�d d�}t|t� ddgddgddgd d gg�� d }tjt|�ddd�}t|t� ddgddgd d gd d gg�� tjt|�d dd�}t|t� ddgddgd d gg�� W d Q R X d S ) Nz 1 1 2 2 3 3 4 4 5 6 7 rO )rZ F)rZ � invalid_raiseg �?g @g @g @r, z 1 1 2 3 3 4 4 5 6 6 7 7 g @) r r� r r r� rB r^ r r rV )r r� ZbasestrrR r r r! � test_skip_footer_with_invalid� s" (((z)TestFromTxt.test_skip_footer_with_invalidc C s| t d�}tj|d dd�}t�ddg�t�ddg�t�dd g�d �}t|d |d � t|d |d � t|d |d � d S )Nz)gender age weight M 64.0 75.0 F 25.0 60.0T)rU r� r: r; g P@g 9@g �R@g N@)r� r� r� r� r� r� )r rB rT rV r )r r� r" r# r r r! � test_header� s zTestFromTxt.test_headerc C s� t d�}tj|d d�}t�ddg�t�ddg�t�ddg�t�d d g�t�d d g�g}t|jjd ddddg� x&t|�D ]\}}t|d| |� qxW d S )Nz*A 64 75.0 3+4j True BCD 25 60.0 5+6j False)rU � As BCD�@ � g �R@g N@y @ @y @ @TF�f0�f1�f2�f3r� zf%i)r rB rT rV r rU r� r{ )r r� r" r# rg r_ r r r! �test_auto_dtype� s zTestFromTxt.test_auto_dtypec C sB t d�}tj|d d�}t�ddddgddd d gg�}t||� d S ) Nz1 2 3 4 5 6 7 8 )rU rO r+ r, rT r� r� r� r )r rB rT rV r )r r� r" r# r r r! �test_auto_dtype_uniform s z#TestFromTxt.test_auto_dtype_uniformc C sZ t d�}t�dtfddtfdtfgfg�}tj||dd�}tjdd g|d �}t||� d S ) Nz1,2,3.0 4,5,6.0 rb rd r� r r� )rU r� )rO )r+ g @)rT )r� g @)rU )r rB rU rX rW rT rV r )r r� � fancydtyper" r# r r r! r s "z TestFromTxt.test_fancy_dtypec C sN ddd�}t d�}d}tj|||d�}||d< tjdd g|d �}t||� d S ) N)�grR r� )r� rc r� )r� r� s M 64.0 75.0 F 25.0 60.0)r� r� r� )rU r� r� )r� g P@g �R@)r� g 9@g N@)rU )r rB rT rV r )r rU r� r� r" r# r r r! �test_names_overwrite s z TestFromTxt.test_names_overwritec C sj t d�}tj|dd d�}tjdddgddtfd tfgd �}t||� t d �}tj|dd d�}t||� d S ) NzN #gender age weight M 21 72.100000 F 35 58.330000 M 33 21.99 T)r� rU )r� r gfffffR@)r� r< g ףp=*M@)r� r g= ףp�5@)r� z|S1r� r� )rU sO # gender age weight M 21 72.100000 F 35 58.330000 M 33 21.99 )r rB r^ rV rX rW r )r r� r" r_ r r r! �test_commented_header! s z!TestFromTxt.test_commented_headerc C sD t d�}tj|ddd d�}tjdddtfdtfgd �}t||� d S ) NzA B C D aaaa 121 45 9.1)�A�C�DT)r� r� rU )r �- g333333"@)rq z|S4rr rs )rU )r rB rT rV rX rW r )r r� r" r# r r r! �test_autonames_and_usecols8 s z&TestFromTxt.test_autonames_and_usecolsc C sJ t d�}tj|tdddd� idd�}t�dd gd d ggt�}t||� d S ) Nz1,2,3,,5 6,7,8,9,10 r� r, c S s t | pd�S )Ni���)rX )r r r r! r� E r� z:TestFromTxt.test_converters_with_usecols.<locals>.<lambda>)rO r, )rU r� r� r� r+ i���r� r� )r rB rT rX rV r )r r� r" r# r r r! r� A s z(TestFromTxt.test_converters_with_usecolsc C sN t d�}tj|ddd ddd� id�}tjdd dtfd tfgd �}t||� d S ) NzA B C D aaaa 121 45 9.1)rq rr rs Trr c S s dt | � S )Nr+ )rX )r r r r! r� N r� zDTestFromTxt.test_converters_with_usecols_and_names.<locals>.<lambda>)r� r� rU r� )r �Z g333333"@)rq z|S4rs )rU )r rB rT rV rX rW r )r r� r" r# r r r! �&test_converters_with_usecols_and_namesJ s z2TestFromTxt.test_converters_with_usecols_and_namesc C sb ddd� i}t d�}tj|dd ddg|d�}tjtdd d �d fdtjfdtfgd �}t||� d S ) N�datec S s t | d�S )Nz%Y-%m-%d %H:%M:%SZ)r1 )r r r r! r� V r� z9TestFromTxt.test_converters_cornercases.<locals>.<lambda>z 2009-02-03 12:00:00Z, 72214.0r� r� )r� rU r� r� i� r+ r, g `��@)rU )r rB rT rV r �object_rW r )r � converterr� r" r# r r r! �test_converters_cornercasesS s z'TestFromTxt.test_converters_cornercasesc C s\ ddd� i}t d�}tj|dd ddg|d�}tjtdd d �d fd dtfgd �}t||� d S )Nrx c S s t �t| d��S )Nz%Y-%m-%d %H:%M:%SZ)rB � datetime64r1 )r r r r! r� a r� z:TestFromTxt.test_converters_cornercases2.<locals>.<lambda>z 2009-02-03 12:00:00Z, 72214.0r� r� )r� rU r� r� i� r+ r, g `��@)rx zdatetime64[us])rU )r rB rT rV r rW r )r rz r� r" r# r r r! � test_converters_cornercases2^ s z(TestFromTxt.test_converters_cornercases2c C sb t d�}tj|dddd� id�}t|ddg� |�d� tj|dd d d� id�}t|d d g� d S ) Nz 1 21 3 42 )rO r c S s t | d�S )Nr )rX )r r r r! r� m r� z3TestFromTxt.test_unused_converter.<locals>.<lambda>)r� r� r r rO c S s t | d�S )Nr )rX )r r r r! r� r r� r r )r rB rT r r> )r r� r" r r r! r i s z!TestFromTxt.test_unused_converterc C sB dd� }dd� }t d�}t||d�dd d�}tttj|f|� d S )Nc S s4 t d| �� kr| �� d p0d| �� kr.| �� p0d�S )N� rr2 g )rW �lowerr� r )rb r r r! r� v s z4TestFromTxt.test_invalid_converter.<locals>.<lambda>c S s4 t d| �� kr| �� d p0d| �� kr.| �� p0d�S )N� %r g )rW r r� r )rb r r r! r� x s zgD01N01,10/1/2003 ,1 %,R 75,400,600 L24U05,12/5/2003, 2 %,1,300, 150.5 D02N03,10/10/2004,R 1,,7,145.55)r+ r, r� )r� r� rU )r rX r r rB r^ )r Z strip_randZ strip_perr rL r r r! �test_invalid_converteru s z"TestFromTxt.test_invalid_converterc C sH t d�}dd� }tj|dd|id�}t�ddgd d gg�}t||� d S ) Nz q1,2 q3,4c S s t | dd � �S )NrO )rW )r r r r! r� � r� z;TestFromTxt.test_tricky_converter_bug1666.<locals>.<lambda>r� r )r� r� g �?g @g @g @)r rB r^ rV r )r r Zcnvr" r# r r r! � test_tricky_converter_bug1666� s z)TestFromTxt.test_tricky_converter_bug1666c C s~ d}t jt|�dtdtid�}t jdgddtfdtfgd �}t||� t jt|�dtdtid�}t �d d d g�}t||� d S ) Nz 2009; 23; 46r r )r� rU r� )Z2009g 7@�. )rg z|S4rh ri )rU g d�@g 7@r� )rB rT r rW r rV r )r �dstrr" r# r r r! �test_dtype_with_converters� s z&TestFromTxt.test_dtype_with_convertersc s� d}ddddd�� ddd d g}t t t � fd d �d �}tjt|�|dd |d�}tjjddddgddddgddddgg|d�}t||� ddd g}tjt|�|ddd |d�}tjjdddgdddgdddgg|d�}t||� d S )Nz!1,5,-1,1:1 2,8,-1,1:n 3,3,-2,m:n r rO r+ r, )z1:1z1:nzm:1zm:n)�e1rc )�e2rc )�e3�i2)r} �i1c s � | � � S )N)r2 )r` )�dmapr r! r� � r� zDTestFromTxt.test_dtype_with_converters_and_usecols.<locals>.<lambda>)r rO r+ r, r� )rU r� r� r� r� r2 r ���)rU )r rO r, )rU r� r� r� r� )rX rB � recfromcsvr �recrV r )r r� �dtyp�convr" r# r )r� r! �&test_dtype_with_converters_and_usecols� s . (z2TestFromTxt.test_dtype_with_converters_and_usecolsc C s� d}dt fdtjfg}dd� }d|i}tjt|�d||d�}tjdtd dd�fd td dd �fg|d �}t||� ddt fdtjfgfg}ytjt|�d||d�}W n tk r� Y nX d}t |��d S )Nz0 1; 2001-01-01 2; 2002-01-31 r r c S s t | �� d�S )Nz%Y-%m-%d)r1 r )r r r r! r� � r� z4TestFromTxt.test_dtype_with_object.<locals>.<lambda>rO r )r� rU r� i� r+ i� r )rU Znestz3Nested dtype involving objects should be supported.) rX rB r\ r^ r rV r r �NotImplementedErrorr� )r r� r r! r� r" r# �errmsgr r r! r$ � s$ z"TestFromTxt.test_dtype_with_objectc C sH t d�}tj|dd tddtid�}tjdgddtfgd �}t||� d S ) Nz skip,skip,2001-01-01,1.0,skipr� )r+ r, r+ )r� r� rU r� r� )z 2001-01-01g �?)r z|S10r )rU )r rB r^ rW r rV r )r r� r" r# r r r! �'test_userconverters_with_explicit_dtype� s z3TestFromTxt.test_userconverters_with_explicit_dtypec C sB t d�}t�|�}t�dddddgddd d d gg�}t||� d S ) Nz 1 2 3 4 5 6 7 8 9 10g �?g @g @g @g @g @g @g @g "@g $@)r rB rT rV r )r r� r" r# r r r! �test_spacedelimiter� s z TestFromTxt.test_spacedelimiterc C sF d}t jt|�dd�}t �dddgdddgd d dgg�}t||� d S ) Nz 1 2 3 4 5 67 890123 4r, )r� rO r+ rT r� �C iz �{ )rB r^ r rV r )r r� r" r# r r r! �test_integer_delimiter� s "z"TestFromTxt.test_integer_delimiterc C sF t d�}tj|tdddd� id�}t�dddd d gt�}t||� d S ) Nz 1,2,3,,5 r� r, c S s t | pd�S )Ni���)rX )r r r r! r� � r� z*TestFromTxt.test_missing.<locals>.<lambda>)rU r� r� rO r+ i���r� )r rB rT rX rV r )r r� r" r# r r r! r� � s zTestFromTxt.test_missingc C sj d}t jt|�ddd�}t �dt jdt jfdt jdfg�}t jd d d gtd �}t|j|� t|j|� d S ) Nz1 2 3 2 1 3r7 T)r� �usemask)rO r+ r, r+ rO r, )r r r )rO r rO )r rO r )rU ) rB r^ r rV �nan�boolr r� �mask)r r= r" Zctrl_dZctrl_mr r r! �test_missing_with_tabs� s " z"TestFromTxt.test_missing_with_tabsc C s� t �ddgddggt�}t� }t �||� |�d� t j|tdd�}t||d d �df � t �dddgdddggt�}t� }t �||� |�d� t j|td d�}t||d d �dd �f � |�d� t j|tt �ddg�d�}t||d d �dd �f � d S ) NrO r+ r, rT r )rO )rU r� r� )rO r+ )rB rV rW r r� r> rT r )r r# r� r" r r r! r � s zTestFromTxt.test_usecolsc C sB d}t jt|�ddd�}t jddgdd� d D �d �}t||� d S ) Nz 1 2 3 4 5 6za, b, cza, c)r� r� )rO r, )rT r� c S s g | ] }|t f�qS r )rW )r# r\ r r r! r$ s z3TestFromTxt.test_usecols_as_css.<locals>.<listcomp>�ac)rU )rB r^ r rV r )r r� r" r_ r r r! �test_usecols_as_css� s z TestFromTxt.test_usecols_as_cssc C sZ t d�}ddg}ddg}tj|dtt||��d�}t|d dd g� t|d d d g� d S ) NzJOE 70.1 25.3 BOB 60.5 27.9r� r� r� r� )r r+ )r� rU s JOEs BOBg�����L9@gfffff�;@)r rB rT r� r� r )r r� r� r r" r r r! �"test_usecols_with_structured_dtype s z.TestFromTxt.test_usecols_with_structured_dtypec C s* t jtd�dd�}t|t �ddg�� d S )Ns 1 2 3 4 5 6r )r� g �?g @)rB r^ r r rV )r r" r r r! �test_usecols_with_integer s z%TestFromTxt.test_usecols_with_integerc C sx t jddgdtfdtfgd�}d}tdd�}t jt|�fd d i|��}t||� t jt|�fd d i|��}t||� d S ) N)rO r, )rT r� rR r� )rU z 1 2 3 4 5 6za, b, c)r� r� )r r2 )rR r� )rB rV rW rX r^ r r )r r_ r� rL r" r r r! � test_usecols_with_named_columns s z+TestFromTxt.test_usecols_with_named_columnsc C sB t � �2}|jdd� t� }t�|�}t|t�g �� W d Q R X d S )Nz genfromtxt: Empty input file:)r )r r� r rB r^ r rV )r r� r� r" r r r! r s zTestFromTxt.test_empty_filec C sZ t d�}t�dtfddtfdtfgfg�}tj||dd�}tjdd g|d �}t||� d S ) Nz1,2,3.0 4,5,6.0 rb rd r� r r� )rU r� )rO )r+ g @)rT )r� g @)rU ) r rB rU rX rW � mafromtxt�marV r )r r� rm r" r# r r r! �test_fancy_dtype_alt% s "z TestFromTxt.test_fancy_dtype_altc C sl t d�}t�ddtfdtfdtdfg�}tj||d�}tjdd d d d d gdddggfg|d�}t||� d S )Nzaaaa 1.0 8.0 1 2 3 4 5 6)r< r� rb rd r )r+ r, )rU r g �?g @rO r+ r, rT r� r� )r rB rU rW rX rT rV r )r r� rp rb rR r r r! r - s z TestFromTxt.test_shaped_dtypec C s� t d�}tdddd�}tj|fdd i|��}tjddgd d gd tjfd tjfgd �}t||� t|j|j� |� d� tj|f|�}tjddgd d gd tj fd tj fgd �}t||� t|j|j� d S )Nz A,B 0,1 2,N/Ar� zN/AT)r� �missing_valuesr� rU )r rO )r+ r2 )FF)FTrq �B)r� rU r ) r rX rB r� r� rV rX r r� r> rW )r r� rL r" r# r r r! �test_withmissing6 s z TestFromTxt.test_withmissingc C s d}t d ddd�}dtfdtfdtfg}tjt|�fdd i|��}tjd d d d gddddg|d�}t ||� ||d< tjt|�fddddd�i|��}tjd d d d gddddg|d�}t ||� tjt|�fddddd�i|��}tjd d d d gddddg|d�}t ||� d S )Nz4A, B, C 0, 0., 0j 1, N/A, 1j -9, 2.2, N/A 3, -99, 3jr� T)rU r� r� rq r� rr r� zN/A)r g y )rO i���y �?)i����g������@y � 8��)r, i����y @)r r r )r rO r )r r rO )r� rU rU i����i����y � 8��)r rO r+ )rO r rO )r r� rr ) rX rX rW r� rB r� r r� rV r )r r� Z basekwargs�mdtyper" r# r r r! �test_user_missing_valuesH s4 z$TestFromTxt.test_user_missing_valuesc C sD t jddgdtfdtfgd�}d}tdtdd d d d �d d dd �d�}t jt|�f|�}t jddgdd� dD �d�}t||� t jt|�fddi|��}t jddgdd� dD �d�}t||� d}t jt|�dtdd d�}t �d d d d gd d d d!gg�}t||� t jt|�dtdd"d�}t �d d d"d gd d"d d!gg�}t||� d S )#N)r r, )rT i���rR r� )rU zN/A, 2, 3 4, ,???r� za,b,czN/Ar� z???)r r� r+ r i���)r� rU r� r� �filling_values)r r+ r, )rT r i���c S s g | ] }|t f�qS r )rX )r# r\ r r r! r$ r s z8TestFromTxt.test_user_filling_values.<locals>.<listcomp>�abcr� )r r2 c S s g | ] }|t f�qS r )rX )r# r\ r r r! r$ v s r� z1,2,*,4 5,*,7,8 �*)r� rU r� r� rO r+ rT r� r� r r2 )rB rV rX rX r^ r r )r r_ r� rL r" �data2r r r! �test_user_filling_valuesg s. z$TestFromTxt.test_user_filling_valuesc C s` t d�}tj|d dddd�}tjddgdd gd tjfd tjfgd �}t||� t|j|j� d S ) NzA,B 0,1.5 2,-999.00r� z-999.0T)rU r� r� r� )r g �?)r+ g �)FF)FTrq r� )r� rU ) r rB r� r� rV rX rW r r� )r r� r" r# r r r! �test_withmissing_float� s z"TestFromTxt.test_withmissing_floatc C sV t d�}tj|d ddd�}tjdddgdd d ggd dd gd dd ggd �}t||� d S ) Nz 1 2 3 4 5 6 z2,5T)rU r� r� rO r+ r, rT r� r� r )r� )r rB r^ r� rV r )r r� r" r# r r r! � test_with_masked_column_uniform� s .z+TestFromTxt.test_with_masked_column_uniformc C sR t d�}tj|d ddd�}tjddgddgdtfd tfd tfgd �}t||� d S ) NzTrue 2 3 False 5 6 z2,5T)rU r� r� )rO r+ r, )r r� r� )r rO r rg rh ri )r� rU )r rB r^ r� rV r� rX r )r r� r" r# r r r! � test_with_masked_column_various� s z+TestFromTxt.test_with_masked_column_variousc s� dgd }x t d�D ]}d|d| < qW |�dd� td�|���td d d d �� i }i f� �fd d � }tt||d� |d }tt|�d� t|t j ddd� dD �d�� �� d� t t t j�d d d� d S )Nz 1, 1, 1, 1, 1�2 r� z 2, 2, 2, 2 2r r z a, b, c, d, er� r� T)r� rU r� c s t j�fddi� ��| d< d S )Nra F�mtest)rB rT )�_ret)rL �mdatar r! r� � s z)TestFromTxt.test_invalid_raise.<locals>.f)r� r� rt c S s g | ] }|t f�qS r )rX )r# r\ r r r! r$ � s z2TestFromTxt.test_invalid_raise.<locals>.<listcomp>�abcde)rU )r� r� )rj �insertr r� rX r r r �lenrB rk r> r r� rT )r r� rg �retr� r� r )rL r� r! �test_invalid_raise� s z TestFromTxt.test_invalid_raisec s dgd }x t d�D ]}d|d| < qW |�dd� td�|���td d d d d �� i }i f� �fd d� }tt||d� |d }tt|�d� t|t j ddd� dD �d�� �� d� t j �fddi� ��}tt|�d� t j ddd� dD �d�}d|dd� t d�D �< t||� d S ) Nz 1, 1, 1, 1, 1r� r� z 2, 2, 2, 2 2r r z a, b, c, d, er� r� TF)r� rU r� ra c s t j�fddi� ��| d< d S )Nr� )r rT r� )rB rT )r� )rL r� r r! r� � s z6TestFromTxt.test_invalid_raise_with_usecols.<locals>.f)r� r� rt c S s g | ] }|t f�qS r )rX )r# r\ r r r! r$ � s z?TestFromTxt.test_invalid_raise_with_usecols.<locals>.<listcomp>Zae)rU r� )r rO c S s g | ] }|t f�qS r )rX )r# r\ r r r! r$ � s �ab)r+ r+ c S s g | ] }d | �qS )r r )r# r\ r r r! r$ � s ) rj r� r r� rX r r r r� rB rk r> rT )r r� rg r� r� r� r# r )rL r� r! � test_invalid_raise_with_usecols� s& z+TestFromTxt.test_invalid_raise_with_usecolsc C sR dgd }t d�|��}ddd� i}td|dd � d D �d �}tttj|f|� d S ) Nz1, 1, 1, 1, -1.1r� r� rT c S s d| S )Nz(%s)r )rb r r r! r� � r� z5TestFromTxt.test_inconsistent_dtype.<locals>.<lambda>r� c S s g | ] }|t f�qS r )rX )r# r\ r r r! r$ � s z7TestFromTxt.test_inconsistent_dtype.<locals>.<listcomp>r� )r� r� rU )r r� rX r r� rB r^ )r r� r� r� rL r r r! �test_inconsistent_dtype� s z#TestFromTxt.test_inconsistent_dtypec C sL d}t jt|�dd dd�}t jddgdtfdtfd tfgd �}t||� d S ) Nz0, 1, 2.3 4, 5, 6.7r� zf%02i)r� rU � defaultfmt)r rO gffffff@)rT r� g������@�f00�f01�f02)rU )rB rT r rV rX rW r )r r� r� r_ r r r! �test_default_field_format� s z%TestFromTxt.test_default_field_formatc C sF d}t jt|�dtdd�}t jdddgdd d ggtd �}t||� d S ) Nz0, 1, 2.3 4, 5, 6.7r� zf%02i)r� rU r� g g �?gffffff@g @g @g������@)rU )rB rT r rW rV r )r r� r� r_ r r r! �test_single_dtype_wo_names� s z&TestFromTxt.test_single_dtype_wo_namesc C sD d}t jt|�dtdd�}t jddgdd� d D �d �}t||� d S ) Nz0, 1, 2.3 4, 5, 6.7r� za, b, c)r� rU r� )g g �?gffffff@)g @g @g������@c S s g | ] }|t f�qS r )rW )r# r\ r r r! r$ � s zBTestFromTxt.test_single_dtype_w_explicit_names.<locals>.<listcomp>r� )rU )rB rT r rW rV r )r r� r� r_ r r r! �"test_single_dtype_w_explicit_names� s z.TestFromTxt.test_single_dtype_w_explicit_namesc C sD d}t jt|�dtdd�}t jddgdd� d D �d �}t||� d S ) Nza, b, c 0, 1, 2.3 4, 5, 6.7r� T)r� rU r� )g g �?gffffff@)g @g @g������@c S s g | ] }|t f�qS r )rW )r# r\ r r r! r$ � s zBTestFromTxt.test_single_dtype_w_implicit_names.<locals>.<listcomp>r� )rU )rB rT r rW rV r )r r� r� r_ r r r! �"test_single_dtype_w_implicit_names� s z.TestFromTxt.test_single_dtype_w_implicit_namesc C sR d}t jt|�dtttfdd�}t jddgdtfdtfd tfgd �}t||� d S ) Nz0, 1, 2.3 4, 5, 6.7r� zf_%02i)r� rU r� )r g �?gffffff@)rT g @g������@Zf_00Zf_01Zf_02)rU )rB rT r rX rW rV r )r r� r� r_ r r r! �test_easy_structured_dtype� s z&TestFromTxt.test_easy_structured_dtypec C s� d}t dd d�}tjt|�f|�}tjdgddtfdgd�}t||� tjt|�fd d i|��}tjd gd dtfd gd�}t||� d S )Nz01/01/2003 , 1.3, abcder� )r� rU )z 01/01/2003 g�������?z abcde)rg z|S12rh )ri z|S8)rU � autostripT)z 01/01/2003g�������?r� )rg z|S10)ri z|S5)rX rB rT r rV rW r )r r� rL r� r_ r r r! �test_autostrip s zTestFromTxt.test_autostripc C s� d}t jt|�ddd d�}dtfdtfdtfg}t jd|d �}t||� t jt|�ddd d d d �}d tfd tfdtfg}t jd|d �}t||� t jt|�ddd d d�}d tfdtfdtfg}t jd|d �}t||� d S )NzA.A, B (B), C:C 1, 2, 3.14r� T)r� r� rU �AA�B_B�CC)rO r+ g ��Q� @)rU r )r� r� rU � replace_space� deletecharszA.AzB (B)zC:C)r� r� rU r� zB_(B))rB r^ r rX rW rV r )r r= r" � ctrl_dtyper_ r r r! �test_replace_space s$ z TestFromTxt.test_replace_spacec C s� d}t jt|�ddtd�}dtfdtfdtfg}t jd|d �}t||� t jt|�ddtd d d �}d tfd tfdtfg}t jd|d �}t||� t jt|�ddtd d�}d tfdtfdtfg}t jd|d �}t||� d S )NzA.A, B (B), C:C 1, 2, 3r� T)r� r� rU r� r� r� )rO r+ r, )rU r )r� r� rU r� r� zA.AzB (B)zC:C)r� r� rU r� zB_(B))rB r^ r rX rV r )r r= r" r� r_ r r r! � test_replace_space_known_dtype- s$ z*TestFromTxt.test_replace_space_known_dtypec C s� d}t ddd�}tjddgdd� d D �d �}tjt|�fd d i|��}t||� tjddgd d� d D �d �}tjt|�f|�}d S ) NzA,,C 0,1,2 3,4,5r� T)r� r� )r rO r+ )r, rT r� c S s g | ] }|t f�qS r )rX )r# r\ r r r! r$ K s z5TestFromTxt.test_incomplete_names.<locals>.<listcomp>)rq rg rr )rU rU c S s g | ] }|t f�qS r )rW )r# r\ r r r! r$ P s )rX rB rV rT r r )r r� rL r_ r" r r r! �test_incomplete_namesE s z!TestFromTxt.test_incomplete_namesc C sP d}t jt|�tttfdd�}t jddgdtfdtfdtfgd�}t||� d S ) Nz 1 2 3 4 5 6rR )rU r� )rO r+ r, )rT r� r� rg rh )rU )rB r^ r rX rW rV r )r r� r" r_ r r r! �test_names_auto_completionS s z&TestFromTxt.test_names_auto_completionc C s� d}d}t jt|�tttfdddd�}t|jj|� t jt|�tttfdddd�}t|jj|� t jt|�tdddd�}t|jj|� d S )Nz'A,B,C,D,E 0,1,2,3,4 0,1,2,3,4 0,1,2,3,4)rq rr �Er� )r r+ rT T)rU r� r� r� )rB r^ r rX r rU r� )r r� Z ctrl_namesr" r r r! � test_names_with_usecols_bug1636\ s z+TestFromTxt.test_names_with_usecols_bug1636c C s� d}t ddd d�}tjddgdtfdtfd tfgd �}tjt|�f|�}t||� t d dd d�}tjddgdtfdtfd tfgd �}tjt|�f|�}t||� d S ) Nz- A B C 0 1 2.3 45 67 9.)r� r� rT T)r� r� rU )r rO gffffff@)rt r� g "@rq r� rr )rU r� )rX rB rV rX rW rT r r )r r� rL r_ r" r r r! �test_fixed_width_nameso s z"TestFromTxt.test_fixed_width_namesc C sX d}t dd dd�}tjdddgdddgd d dggtd �}tjt|�f|�}t||� d S ) Ns 1, 2, 3 1, , 5 0, 6, r� i���)r� rU r� rO r+ r, r� r r� )rU )rX rB rV rX rT r r )r r� rL r_ r" r r r! �test_filling_values~ s &z TestFromTxt.test_filling_valuesc C sL t jtd�d d dd�}t|d d� t jtd�d d dd�}t|d d� d S )Nz test1,testNonetherestofthedatar� )rU r� r� rO s testNonetherestofthedataz test1, testNonetherestofthedatas testNonetherestofthedata)rB r^ r r )r r" r r r! �test_comments_is_none� s z!TestFromTxt.test_comments_is_nonec C s� t d�}tdddd�}tj|f|�}tjddgdtjfd tjfgd �}| �t|tj�� t ||� t d �}tj|fd dd �|��}t jdd gddgdtjfd tjfgd�}t ||� t |j |j � t |j ddg� d S )Nz A,B 0,1 2,3r� zN/AT)r� r� r� )r rO )r+ r, rq r� )rU z A,B 0,1 2,N/A)rU r� )r+ r2 )FF)FT)r� rU r r+ ) r rX rB � recfromtxtrV rX � assertTruer@ �recarrayr r� r� rq )r r� rL r" r# r r r! �test_recfromtxt� s zTestFromTxt.test_recfromtxtc C s� t d�}tdddd�}tj|fdd i|��}tjddgdtjfd tjfgd �}| �t|tj�� t ||� t d �}tj|fd dd �|��}t jdd gddgdtjfd tjfgd�}t ||� t |j |j � t |j ddg� t d�}tj|dd�}tjddgdtjfdtjfgd �}| �t|tj�� t ||� t d�}dtjfdtj fg}tj|d|d�}tjddg|d �}| �t|tj�� t ||� d S )Nz A,B 0,1 2,3zN/AT)r� r� �case_sensitiverU )r rO )r+ r, rq r� )rU z A,B 0,1 2,N/A)rU r� )r+ r2 )FF)FT)r� rU r r+ )r� rR r� )r� rU )r rX rB r� rV rX r� r@ r� r r� r� rq rW )r r� rL r" r# rU r r r! �test_recfromcsv� s8 zTestFromTxt.test_recfromcsvc C s� d}t |�}tj|dd�}t�|�}t|ddgddgddgg� t|d d gd d gg� tttjt |�d d� d}tjt |�dd�}t�ddgddgg�}t||� tttjt |�ddd� tttjt |�dd� t� ��}|�t � tjt |�ddd�}t�ddgddgddgddgg�}t||� tjt |�ddd�}t�ddgddgddgddgg�}t||� W d Q R X d}t |�}tj|dddd�}tjdddgd d gd �}t||� tj|d |j d �}tjd d!gd d gd �}t||� d S )"Nz1 2 3 4 5 6 7 8 9 10 r, )�max_rowsrO r+ rT r� r� r� r r� r r z 1 1 2 2 0 3 3 4 4 5 6 7 g �?g @)rZ r� F)r� ra g @g @z"a b #c d 1 1 2 2 #0 3 3 4 4 5 5 T)rW r� r� )g �?g �?)g @g @)g @g @)r� z<f8)r� z<f8)rU )r� rU )g @g @)g @g @) r rB r^ r r r� rV r r� r rU )r r� r= �a1�a2r" r# r� r r r! � test_max_rows� s@ " " zTestFromTxt.test_max_rowsc C s� t �d��d�}tjd dkr$d}nd}x^|D ]V}d| d }t� �0}t|d ��}|�|� W d Q R X t �|�}W d Q R X t ||� q.W d S ) Nr� )r+ r, r r, )r� z )r� z � z0 1 2z3 4 5r� ) rB rB �reshaper. r/ r r� r" r^ r )r r% �linesep�sepr� r< r� r& r r r! �test_gft_using_filename� s z#TestFromTxt.test_gft_using_filenamec C s( dd� }t �|� �}t|t �d�� d S )Nc s s$ x t d�D ]} td| �V q W d S )Nr z%d)rj r )rg r r r! rA s z3TestFromTxt.test_gft_using_generator.<locals>.countr )rB r^ r rB )r rA r& r r r! �test_gft_using_generator s z$TestFromTxt.test_gft_using_generatorc C s� t d�}tj|d d�}t|jjdddg� t|jd tjk� t|jd tjk� t|jd tj k� t |d d� t|d d� t|d d� d S ) Nz%73786976294838206464 17179869184 1024)rU rg rh ri g Dl i ) r rB rT r rU r� r rW r� �integerr )r r� r" r r r! �test_auto_dtype_largeint s z$TestFromTxt.test_auto_dtype_largeintN)Er' r( r) re r[ r^ rV r� r` rb rc rk rl r ro rp ru r� rw r{ r} r r� r� r� r� r$ r� r� r� r� r� r r� r� r� r� r r� r r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r! rS � s� "6 rS c @ s e Zd Zejj�edkd�dd� �Zejj�edkd�dd� �Z ejj�edkd�dd� �Z ejj�edkd�d d � �Z ejj�edkd�d d � �Z ejj�edkd�d d� �Z ejj�edkd�dd� �Zejj�edkd�dd� �Zejj�edkd�dd� �ZdS )� TestPathUsageNzNo pathlib.Pathc C sX t dd��D}t|�}t�ddgddgg�}t�||� t�|�}t||� W d Q R X d S )Nz.txt)r g�������?r+ r, rT )r r rB rV r� r� r )r �pathrR rb r r r! � test_loadtxt1 s zTestPathUsage.test_loadtxtc C sZ t dd��F}t|�}t�ddgddggt�}t�||� t�|�}t||� W d Q R X d S )Nz.npy)r rO r+ r, rT )r r rB rV rX rv rC r )r r� rR r� r r r! �test_save_load: s z TestPathUsage.test_save_loadc C sT t dd��@}t|�}tj|dd� t�|��}t|d d� W d Q R X W d Q R X d S )Nz.npz)r z place holder)r� r� )r r rB rz rC r )r r� r� r r r! �test_savez_loadD s z TestPathUsage.test_savez_loadc C sP t dd��<}t|�}tj|dd� t�|�}t|d d� |�� W d Q R X d S )Nz.npz)r z place holder)r� r� )r r rB �savez_compressedrC r rA )r r� r� r r r! �test_savez_compressed_loadM s z(TestPathUsage.test_savez_compressed_loadc C sP t dd��<}t|�}t�ddg�}t�||� t�|�}t||� W d Q R X d S )Nz.txt)r )rO r+ )r, rT )r r rB rV r� r^ r )r r� rR r� r r r! �test_genfromtxtW s z TestPathUsage.test_genfromtxtc C st t dd��`}t|�}|�d��}|�d� W d Q R X tjddgddggtd �}tj|td �}t||� W d Q R X d S ) Nz.txt)r r� z1 2 3 4rO r+ r, rT )rU ) r r r� r" rB rV rX rT r )r r� r� r# r" r r r! �test_ndfromtxt` s z TestPathUsage.test_ndfromtxtc C sh t dd��T}t|�}|�d��}|�d� W d Q R X tj|dd�}t�ddg�}t||� W d Q R X d S ) Nz.txt)r r� z1,2,3.0 4,5,6.0 r� )r� )g �?g @g @)g @g @g @) r r r� r" rB r� r� rV r )r r� r� r" r# r r r! �test_mafromtxtl s z TestPathUsage.test_mafromtxtc C s� t dd���}t|�}|�d��}|�d� W d Q R X tdddd�}tj|f|�}tjd d gd tjfd tjfgd �}| � t |tj �� t ||� W d Q R X d S )Nz.txt)r r� z A,B 0,1 2,3r� zN/AT)r� r� r� )r rO )r+ r, rq r� )rU ) r r r� r" rX rB r� rV rX r� r@ r� r )r r� r� rL r" r# r r r! r� x s z TestPathUsage.test_recfromtxtc C s� t dd���}t|�}|�d��}|�d� W d Q R X tdddd�}tj|fdd i|��}tjd d gd tjfd tjfgd �}| � t |tj �� t ||� W d Q R X d S )Nz.txt)r r� z A,B 0,1 2,3zN/AT)r� r� r� rU )r rO )r+ r, rq r� )rU ) r r r� r" rX rB r� rV rX r� r@ r� r )r r� r� rL r" r# r r r! r� � s z TestPathUsage.test_recfromcsv)r' r( r) rB rr r r� r r� r� r� r� r� r� r� r� r� r r r r! r� / s r� c C s` t j�d�} t� }tj|dd�}t �|| � |�� |�d� tj|dd�}tt � |�| � d S )N)r� r� r� )�fileobj�moder r` ) rB r� r �gzip�GzipFilerv rA r> r rC )rR r r� r r r! �test_gzip_load� s r� c C s� t � } tj| dd�}|�d� |�� | �d� tdd��4}t|d��}|�| �� � W d Q R X t � |�}W d Q R X | �� t |dd d g� d S ) Nr� )r� r� s 1 2 3 r z.gz)r r� rO r+ r, ) r r� r� r" rA r> r r� r� rB r� r )r rn r< r� r& r r r! �test_gzip_loadtxt� s r� c C sX t � } tj| dd�}|�d� |�� | �d� tj| dd�}tt�|�dddg� d S ) Nr� )r� r� s 1 2 3 r r` rO r+ r, ) r r� r� r" rA r> r rB r� )r r� r r r! � test_gzip_loadtxt_from_string� s r� c C s� t � } t�d�}t�d�}tj| ||d� | �d� t�| �}td|k� td|k� td|�� k� td|�� k� x,|�� D ] \}}t|dk� t |j d� q�W tt |�� �dk� x|D ]}t|dk� q�W td|�� k� d S )N)r, r, )rb rd r rb rd r+ ) r rB r� rz r> rC r �keys�itemsr rQ r� )r rb rd r5 r� rR r r r! �test_npzfile_dict� s" r� c C sn t � } t�| dddg� | �d� tt�� � t�� z t�� t� | � t�� }W d t� � X t |d� d S )NrO r+ r, r ) r rB rz r> r �gc� isenabled�disable�collectrC �enabler )r� Zn_objects_in_cyclesr r r! �test_load_refcount� s r �__main__)N)A� __future__r r r r. r� rI r� �tempfiler r0 rl r� �ior r �numpyrB �numpy.mar� Znumpy.lib._iotoolsr r � numpy.compatr r r r Znumpy.ma.testutilsr Z numpy.testingr r r r r r r r r r r r r r/ ZMAJVERZMINVER�maxsizer� r1 r\ r4 ru ry r� r� rH rS r� r� r� r� r� r r' r r r r! �<module> s^ 8 k & -f