Edit File: connector.cpython-37.pyc
B �k�a�� � @ sR d dl Z d dlZd dlZd dlZd dlZd dlZd dlmZmZ d dl m Z d dl m Z d dl mZmZ d dlmZ d dlmZ d dlmZmZmZmZmZmZmZm Z m Z m Z m Z m Z m!Z!m"Z" d dl#Z#d d l$m%Z%m&Z& d d l'm(Z( d d l)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3 d d l4m5Z5 d dl6m7Z7m8Z8m9Z9 d dl&m:Z:m;Z;m<Z<m=Z=m>Z>m?Z? d dl@mAZA d dlBmCZC d dlDmEZE yd dlFZFeFjGZGW n eHk �r� dZFeIZGY nX dZJe�r�d dlKmLZL d dl6mMZM d dlNmOZO G dd� d�ZPG dd� d�ZQG dd � d �ZRG d d � d �ZSG d d � d �ZTG d!d"� d"eS�ZUG d#d$� d$eS�ZVG d%d&� d&eS�ZWdS )'� N)� defaultdict�deque)�suppress)� SimpleCookie)�cycle�islice)� monotonic)� TracebackType)� TYPE_CHECKING�Any� Awaitable�Callable� DefaultDict�Dict�Iterator�List�Optional�Set�Tuple�Type�Union�cast� )�hdrs�helpers)�AbstractResolver) �ClientConnectionError� ClientConnectorCertificateError�ClientConnectorError�ClientConnectorSSLError�ClientHttpProxyError�ClientProxyConnectionError�ServerFingerprintMismatch�UnixClientConnectorError� cert_errors� ssl_errors)�ResponseHandler)� ClientRequest� Fingerprint�_merge_ssl_params)�PY_36� ceil_timeout�get_running_loop� is_ip_address�noop�sentinel)� RESPONSES)�EventResultOrError)�DefaultResolver)� BaseConnector� TCPConnector� UnixConnector�NamedPipeConnector)� ClientTimeout)� ConnectionKey)�Tracec @ s@ e Zd ZdZee dd�dd�Zed�dd�Zdd�d d �ZdS ) �_DeprecationWaiter)� _awaitable�_awaitedN)� awaitable�returnc C s || _ d| _d S )NF)r; r< )�selfr= � r@ �D/opt/alt/python37/lib64/python3.7/site-packages/aiohttp/connector.py�__init__Q s z_DeprecationWaiter.__init__)r> c C s d| _ | j�� S )NT)r< r; � __await__)r? r@ r@ rA rC U s z _DeprecationWaiter.__await__c C s | j st�dt� d S )NzDConnector.close() is a coroutine, please use await connector.close())r< �warnings�warn�DeprecationWarning)r? r@ r@ rA �__del__Y s z_DeprecationWaiter.__del__) �__name__� __module__� __qualname__� __slots__r r rB rC rG r@ r@ r@ rA r: N s r: c @ s� e Zd ZdZdZddeejdd�dd�Ze d�dd �Z e fe dd �d d �Z eejd�d d��Zeeej d�dd��Zeee d�dd��Zeg df dd�dd�Zdd�dd�Zdd�dd�Zdd�dd�Zeed�d d ��ZdS ) � ConnectionNr3 r8 )� connector�key�protocol�loopr> c C s< || _ || _|| _|| _g | _|�� r8t�t� d��| _ d S )Nr ) �_key� _connector�_loop� _protocol� _callbacks� get_debug� traceback� extract_stack�sys� _getframe�_source_traceback)r? rM rN rO rP r@ r@ rA rB g s zConnection.__init__)r> c C s d| j � d�S )Nz Connection<�>)rQ )r? r@ r@ rA �__repr__w s zConnection.__repr__)� _warningsr> c C s� | j d k r�trd| i}ni }|jd| ��tf|� | j�� r@d S | jj| j| j dd� | dd�}| j d k rt| j |d< | j� |� d S )N�sourcezUnclosed connection T)� should_closezUnclosed connection)Zclient_connection�message�source_traceback) rT r* rE �ResourceWarningrS � is_closedrR �_releaserQ r[ �call_exception_handler)r? r^ �kwargs�contextr@ r@ rA rG z s zConnection.__del__c C s t jdtdd� | jS )Nz%connector.loop property is deprecated� )� stacklevel)rD rE rF rS )r? r@ r@ rA rP � s zConnection.loopc C s | j d krd S | j jS )N)rT � transport)r? r@ r@ rA rk � s zConnection.transportc C s | j S )N)rT )r? r@ r@ rA rO � s zConnection.protocol)�callbackr> c C s |d k r| j �|� d S )N)rU �append)r? rl r@ r@ rA � add_callback� s zConnection.add_callbackc C sB | j d d � g }| _ x&|D ] }tt�� |� W d Q R X q W d S )N)rU r � Exception)r? � callbacks�cbr@ r@ rA �_notify_release� s zConnection._notify_releasec C s2 | � � | jd k r.| jj| j| jdd� d | _d S )NT)r` )rr rT rR re rQ )r? r@ r@ rA �close� s zConnection.closec C s6 | � � | jd k r2| jj| j| j| jjd� d | _d S )N)r` )rr rT rR re rQ r` )r? r@ r@ rA �release� s zConnection.releasec C s | j d kp| j �� S )N)rT � is_connected)r? r@ r@ rA �closed� s zConnection.closed)rH rI rJ r[ � _transportr& �asyncio�AbstractEventLooprB �strr] rD r rG �propertyrP r � Transportrk rO r rn rr rs rt �boolrv r@ r@ r@ rA rL b s* rL c @ s e Zd ZdZdd�dd�ZdS )�_TransportPlaceholderz.placeholder for BaseConnector.connect functionN)r> c C s d S )Nr@ )r? r@ r@ rA rs � s z_TransportPlaceholder.close)rH rI rJ �__doc__rs r@ r@ r@ rA r~ � s r~ c @ s� e Zd ZdZdZdZdZedddddd�ee de f e e e e e ej dd �d d �Zefedd �d d�Zd d�dd�Zedd�dd�Zd d�dd�ZdDe ee e e e e dd�dd�Zee d�dd��Z ee d�d d ��Z ee d�d d ��Z dd�d d!�Z d"e dd#�d$d%�Z!dd�d&d'�Z"e#d d�d(d)�Z$dd�d*d+�Z%ee d�d,d-��Z&d"e d.�d/d0�Z'd1e(d2 d3e)d4�d5d6�Z*d"e e d.�d7d8�Z+dd�d9d:�Z,d"e dd;�d<d=�Z-dd>�d"e e dd?�d@dA�Z.d1e(d2 d3e d4�dBdC�Z/dS )Er3 a� Base connector class. keepalive_timeout - (optional) Keep-alive timeout. force_close - Set to True to force close and do reconnect after each request (and between redirects). limit - The total number of simultaneous connections. limit_per_host - Number of simultaneous connections to one host. enable_cleanup_closed - Enables clean-up closed ssl transports. Disabled by default. loop - Optional event loop. TNg @F�d r )�keepalive_timeout� force_close�limit�limit_per_host�enable_cleanup_closedrP )r� r� r� r� r� rP r> c C s� |r |d k r*|t k r*td��n |t kr*d}t|�}d| _|�� rRt�t�d��| _ i | _ || _ || _ t � | _tt �| _tt|�| _|| _tt�| _|| _tjt|d�| _t � | _ d | _ d | _ | | _ g | _!| �"� d S )Nz6keepalive_timeout cannot be set if force_close is Trueg .@Fr )rP )#r/ � ValueErrorr, �_closedrV rW rX rY rZ r[ �_conns�_limit�_limit_per_host�set� _acquiredr �_acquired_per_hostr �float�_keepalive_timeout� _force_closer �_waitersrS � functools�partialr& �_factoryr Zcookies�_cleanup_handle�_cleanup_closed_handle�_cleanup_closed_disabled�_cleanup_closed_transports�_cleanup_closed)r? r� r� r� r� r� rP r@ r@ rA rB � s6 zBaseConnector.__init__)r^ r> c C s� | j r d S | jsd S dd� | j�� D �}| �� tr>d| i}ni }|jd| ��tf|� | |dd�}| jd k rx| j|d< | j� |� d S )Nc S s g | ] }t |��qS r@ )�repr)�.0�cr@ r@ rA � <listcomp> s z)BaseConnector.__del__.<locals>.<listcomp>r_ zUnclosed connector zUnclosed connector)rM � connectionsra rb ) r� r� �values�_closer* rE rc r[ rS rf )r? r^ �connsrg rh r@ r@ rA rG s zBaseConnector.__del__)r> c C s t �dt� | S )NzH"witn Connector():" is deprecated, use "async with Connector():" instead)rD rE rF )r? r@ r@ rA � __enter__% s zBaseConnector.__enter__)�excr> c G s | � � d S )N)rs )r? r� r@ r@ rA �__exit__- s zBaseConnector.__exit__c � s | S )Nr@ )r? r@ r@ rA � __aenter__0 s zBaseConnector.__aenter__)�exc_type� exc_value� exc_tracebackr> c � s | � � I d H d S )N)rs )r? r� r� r� r@ r@ rA � __aexit__3 s zBaseConnector.__aexit__c C s | j S )z1Ultimately close connection on releasing if True.)r� )r? r@ r@ rA r� ; s zBaseConnector.force_closec C s | j S )z�The total number for simultaneous connections. If limit is 0 the connector has no limit. The default limit size is 100. )r� )r? r@ r@ rA r� @ s zBaseConnector.limitc C s | j S )z�The limit for simultaneous connections to the same endpoint. Endpoints are the same if they are have equal (host, port, is_ssl) triple. )r� )r? r@ r@ rA r� I s z BaseConnector.limit_per_hostc C s | j r| j �� d| _ | j�� }| j}| jr�i }|| }x�| j�� D ]�\}}g }x�|D ]z\}} |�� r�| | dk r�|j} |� � |j r�| j s�| j � | � q�|� || f� qV|j} |� � |j rV| j sV| j � | � qVW |rD|||< qDW || _| j�rt�| d|| j�| _ dS )zCleanup unused transports.Nr �_cleanup)r� �cancelrS �timer� r� �itemsru rk rs �is_sslr� r� rm r �weakref_handle) r? �now�timeoutr� ZdeadlinerN r� �alive�protoZuse_timerk r@ r@ rA r� R s8 zBaseConnector._cleanupr8 )rN �valr> c C s4 | j }||krd S || }|�|� |s0| j |= d S )N)r� �remove)r? rN r� Zacquired_per_hostr� r@ r@ rA �_drop_acquired_per_host{ s z%BaseConnector._drop_acquired_per_hostc C sV | j r| j �� x | jD ]}|dk r|�� qW g | _| jsRt�| d| j| j�| _ dS )z~Double confirmation for transport close. Some broken ssl servers may leave socket open without proper close. Nr� ) r� r� r� �abortr� r r� �_cleanup_closed_periodrS )r? rk r@ r@ rA r� � s z BaseConnector._cleanup_closedc C s | � � tt� �S )z Close all opened transports.)r� r: r. )r? r@ r@ rA rs � s zBaseConnector.closec C s� | j r d S d| _ z�| j�� r d S | jr0| j�� | jr@| j�� x,| j�� D ] }x|D ]\}}|�� qVW qLW x| j D ] }|�� qvW x | j D ]}|d k r�|� � q�W W d | j� � | j � � | j � � d | _| j � � d | _X d S )NT)r� rS rd r� r� r� r� r� rs r� r� r� �clearr� )r? �datar� �t0rk r@ r@ rA r� � s0 zBaseConnector._closec C s | j S )z;Is connector closed. A readonly property. )r� )r? r@ r@ rA rv � s zBaseConnector.closed)rN r> c C s� | j rV| j t| j� }| jr�|dkr�|| jkr�| j�|�}|dk sFt�| jt|� }n<| jr�|| jkr�| j�|�}|dk s~t�| jt|� }nd}|S )z� Return number of available connections. The limit, limit_per_host and the connection key are taken into account. If it returns less than 1 means that there are no connections available. r Nr )r� �lenr� r� r� �get�AssertionError)r? rN � availableZacquiredr@ r@ rA �_available_connections� s z$BaseConnector._available_connectionsr' r9 r7 )�req�tracesr� r> c � s� |j }| �|�}|dks$|| jk�r| j�� }| j| �|� |r^x|D ]}|�� I dH qHW zny|I dH W nZ tk r� } z<|| jkr�y| j| �|� W n t k r� Y nX |�W dd}~X Y nX W d|| jkr�| j| s�| j|= X |�rx|D ]}|� � I dH q�W | � |�} | dk�r&t t t� �} | j�| � | j| �| � |�rnx |D ]}|�� I dH �qVW y0| �|||�I dH } | j�r�| �� td��W n@ tk �r� | j�s�| j�| � | �|| � | �� � Y n"X | j�s | j�| � | �|| � |�r�x�|D ]}|�� I dH �q W nd|�r�t t t� �} | j�| � | j| �| � x |D ]}|�� I dH �qZW | j�| � | �|| � | j�| � | j| �| � t| || | j�S )z'Get from pool or create new connection.r NzConnector is closed.) �connection_keyr� r� rS Z create_futurerm Z send_connection_queued_start� BaseExceptionr� r� Zsend_connection_queued_end�_getr r& r~ r� �addr� Z send_connection_create_start�_create_connectionr� rs r r� �_release_waiterZsend_connection_create_endZsend_connection_reuseconnrL ) r? r� r� r� rN r� �fut�trace�er� � placeholderr@ r@ rA �connect� st zBaseConnector.connectc C s� y| j | }W n tk r" d S X | j�� }x�|r�|�� \}}|�� r�|| | jkr~|j}|�� |j r�| j s�| j � |� q�|s�| j |= |S q0|j}|�� |j r0| j s0| j � |� q0W | j |= d S )N) r� �KeyErrorrS r� �popru r� rk rs r� r� r� rm )r? rN r� �t1r� r� rk r@ r@ rA r� ? s, zBaseConnector._getc C sv | j s dS t| j �� �}t�|� xN|D ]F}| �|�dk r<q(| j | }x&|rl|�� }|�� sH|�d� dS qHW q(W dS )z� Iterates over all waiters until one to be released is found. The one to be released is not finsihed and belongs to a host that has available connections. Nr ) r� �list�keys�random�shuffler� �popleft�done� set_result)r? ZqueuesrN �waiters�waiterr@ r@ rA r� ^ s z BaseConnector._release_waiter)rN r� r> c C sH | j r d S y | j�|� | �||� W n tk r: Y n X | �� d S )N)r� r� r� r� r� r� )r? rN r� r@ r@ rA �_release_acquiredx s z BaseConnector._release_acquired)r` )rN rO r` r> c C s� | j r d S | �||� | jr d}|s*|jrR|j}|�� |jr�| js�| j� |� nV| j � |�}|d krtg }| j |< |� || j � � f� | jd kr�t�| d| j| j �| _d S )NTr� )r� r� r� r` rk rs r� r� r� rm r� r� rS r� r� r r� r� )r? rN rO r` rk r� r@ r@ rA re � s" zBaseConnector._releasec � s t � �d S )N)�NotImplementedError)r? r� r� r� r@ r@ rA r� � s z BaseConnector._create_connection)NNN)0rH rI rJ r r� r[ r� r/ r �objectr� r} �intr rx ry rB rD r rG r� r� r� r r� r r� r{ r� r� r� r� r& r� r� r rs r� rv r� r rL r� r� r� r� re r� r@ r@ r@ rA r3 � sV ". * %" Q r3 c @ s� e Zd Zdee dd�dd�Zeed�dd�Ze e e f e e e ef dd�d d �Ze e e f dd �d d �Zdd�dd�Ze e e f e e e ef d �dd�Ze e e f ed �dd�ZdS )�_DNSCacheTableN)�ttlr> c C s i | _ i | _|| _d S )N)� _addrs_rr� _timestamps�_ttl)r? r� r@ r@ rA rB � s z_DNSCacheTable.__init__)�hostr> c C s || j kS )N)r� )r? r� r@ r@ rA � __contains__� s z_DNSCacheTable.__contains__)rN �addrsr> c C s, t |�t|�f| j|< | jr(t� | j|< d S )N)r r� r� r� r r� )r? rN r� r@ r@ rA r� � s z_DNSCacheTable.add)rN r> c C s& | j �|d � | jr"| j�|d � d S )N)r� r� r� r� )r? rN r@ r@ rA r� � s z_DNSCacheTable.remove)r> c C s | j �� | j�� d S )N)r� r� r� )r? r@ r@ rA r� � s z_DNSCacheTable.clearc C s( | j | \}}tt||��}t|� |S )N)r� r� r �next)r? rN rP �lengthr� r@ r@ rA � next_addrs� s z_DNSCacheTable.next_addrsc C s$ | j d krdS | j| | j t� k S )NF)r� r� r )r? rN r@ r@ rA �expired� s z_DNSCacheTable.expired)N)rH rI rJ r r� rB r� r} r� r rz r� r r r r� r� r� r� r� r@ r@ r@ rA r� � s &$r� c s` e Zd ZdZdddddddddedddddd�eee eee eee e dee e f ee e ef ee e deef eeeeeej d�� fd d �Zed d �� fd d � Zeed �dd��Zeed �dd��Zd<ee ee dd�dd�Zd=e eeed eee e f d�dd�Z ded de d�d d �Z e e!�"d�ee d �d d ���Z#dee d!�d"d#�Z$ded$ d!�d%d&�Z%e&d'�e dde'e( e e ej)e f d(�d)d*�Z*ddd!�d+d,�Z+dd �d-d.�Z,ed �d/d0�Z-ej)ddd1�d2d3�Z.e&fej)dde'e( e ej/e f d4�d5d6�Z0e&d'�ded de'e( e ej)e f d7�d8d9�Z1ded de ej/e f d�d:d;�Z2� Z3S )>r4 a/ TCP connector. verify_ssl - Set to True to check ssl certifications. fingerprint - Pass the binary sha256 digest of the expected certificate in DER format to verify that the certificate the server presents matches. See also https://en.wikipedia.org/wiki/Transport_Layer_Security#Certificate_pinning resolver - Enable DNS lookups and use this resolver use_dns_cache - Use memory cache for DNS lookups. ttl_dns_cache - Max seconds having cached a DNS entry, None forever. family - socket address family local_addr - local tuple of (host, port) to bind socket to keepalive_timeout - (optional) Keep-alive timeout. force_close - Set to True to force close and do reconnect after each request (and between redirects). limit - The total number of simultaneous connections. limit_per_host - Number of simultaneous connections to one host. enable_cleanup_closed - Enables clean-up closed ssl transports. Disabled by default. loop - Optional event loop. TN� r Fr� )� verify_ssl� fingerprint� use_dns_cache� ttl_dns_cache�family� ssl_context�ssl� local_addr�resolverr� r� r� r� r� rP c sj t � j| | | | ||d� t||||�| _| d kr<t| jd�} | | _|| _t|d�| _ i | _ || _ || _ d S )N)r� r� r� r� r� rP )rP )r� ) �superrB r) �_sslr2 rS � _resolver�_use_dns_cacher� � _cached_hosts�_throttle_dns_events�_family� _local_addr)r? r� r� r� r� r� r� r� r� r� r� r� r� r� r� rP )� __class__r@ rA rB � s zTCPConnector.__init__)r> c s& x| j �� D ] }|�� q W t� �� S )z Close all ongoing DNS calls.)r� r� r� r� rs )r? Zev)r� r@ rA rs s zTCPConnector.closec C s | j S )zSocket family like AF_INET.)r� )r? r@ r@ rA r� s zTCPConnector.familyc C s | j S )z%True if local DNS caching is enabled.)r� )r? r@ r@ rA r� % s zTCPConnector.use_dns_cache)r� �portr> c C sJ |dk r"|dk r"| j �||f� n$|dk s2|dk r<td��n | j �� dS )z8Remove specified host/port or clear all dns local cache.Nz5either both host and port or none of them are allowed)r� r� r� r� )r? r� r� r@ r@ rA �clear_dns_cache* s z TCPConnector.clear_dns_cacher9 )r� r� r� r> c � s8 t |�r |||| jddd�gS | js�|rFx |D ]}|�|�I d H q.W | jj||| jd�I d H }|r�x |D ]}|�|�I d H qjW |S ||f}|| jkr�| j�|�s�| j� |�}|r�x |D ]}|� |�I d H q�W |S || j k�r"| j | }|�rx |D ]}|� |�I d H q�W |� � I d H �n t | j�| j |< |�rXx |D ]}|�|�I d H �q>W z�y�|�r�x |D ]}|�|�I d H �qhW | jj||| jd�I d H } |�r�x |D ]}|�|�I d H �q�W | j�|| � | j | �� W n8 tk �r } z| j | j| d� � W d d } ~ X Y nX W d | j �|� X | j� |�S )Nr )�hostnamer� r� r� r� �flags)r� )r� )r- r� r� Zsend_dns_resolvehost_startr� �resolveZsend_dns_resolvehost_endr� r� r� Zsend_dns_cache_hitr� �waitr1 rS Zsend_dns_cache_missr� r� r� r� ) r? r� r� r� r� �resrN �result�eventr� r� r@ r@ rA � _resolve_host5 s` zTCPConnector._resolve_hostr' r7 )r� r� r� r> c � s< |j r | �|||�I dH \}}n| �|||�I dH \}}|S )zcCreate connection. Has same keyword arguments as BaseEventLoop.create_connection. N)�proxy�_create_proxy_connection�_create_direct_connection)r? r� r� r� �_r� r@ r@ rA r� � s z TCPConnector._create_connection)�verifiedr> c C s� | r t �� S t �t j�}| jt jO _| jt jO _d|_t j|_ y| jt j O _W n2 t k r� } zt � d�|�� W d d }~X Y nX |�� |S d S )NFz�{!s}: The Python interpreter is compiled against OpenSSL < 1.0.0. Ref: https://docs.python.org/3/library/ssl.html#ssl.OP_NO_COMPRESSION)r� Zcreate_default_context� SSLContextZPROTOCOL_TLS_CLIENT�optionsZ OP_NO_SSLv2Z OP_NO_SSLv3Zcheck_hostnameZ CERT_NONEZ verify_modeZOP_NO_COMPRESSION�AttributeErrorrD rE �formatZset_default_verify_paths)r � sslcontextZattr_errr@ r@ rA �_make_ssl_context� s z TCPConnector._make_ssl_context)r� r> c C sz |� � rrtdkrtd��|j}t|tj�r.|S |dk r@| �d�S | j}t|tj�rV|S |dk rh| �d�S | �d�S dS dS )a* Logic to get the correct SSL context 0. if req.ssl is false, return None 1. if ssl_context is specified in req, use it 2. if _ssl_context is specified in self, use it 3. otherwise: 1. if verify_ssl is not specified in req, use self.ssl_context (will generate a default context according to self.verify_ssl) 2. if verify_ssl is True in req, generate a default SSL context 3. if verify_ssl is False in req, generate a SSL context that won't verify NzSSL is not supported.FT)r� r� � RuntimeError� isinstancer r r� )r? r� r r@ r@ rA �_get_ssl_context� s z TCPConnector._get_ssl_contextr( c C s, |j }t|t�r|S | j}t|t�r(|S d S )N)r� r r( r� )r? r� �retr@ r@ rA �_get_fingerprint� s z TCPConnector._get_fingerprint)� client_error)�argsr� r� r rg r> c � s� y8t |j�4 I d H � | jj||�I d H S Q I d H R X W n� tk rh } zt|j|�|�W d d }~X Y n^ tk r� } zt|j|�|�W d d }~X Y n0 t k r� } z||j|�|�W d d }~X Y nX d S )N) r+ � sock_connectrS �create_connectionr$ r r� r% r �OSError)r? r� r� r r rg r� r@ r@ rA �_wrap_create_connection� s $ z$TCPConnector._wrap_create_connectionc C s8 |� � s dS |j}|dk s t�|jdkr,dS | �� dS )aW Raise a :py:exc:`RuntimeError` on missing ``start_tls()``. One case is that :py:meth:`asyncio.loop.start_tls` is not yet implemented under Python 3.6. It is necessary for TLS-in-TLS so that it is possible to send HTTPS queries through HTTPS proxies. This doesn't affect regular HTTP requests, though. N�https)r� r r� �scheme�_check_loop_for_start_tls)r? r� Z proxy_urlr@ r@ rA �_fail_on_no_start_tls� s z"TCPConnector._fail_on_no_start_tlsc C s> y | j j W n, tk r8 } ztd�|�W d d }~X Y nX d S )Na� An HTTPS request is being sent through an HTTPS proxy. This needs support for TLS in TLS but it is not implemented in your runtime for the stdlib asyncio. Please upgrade to Python 3.7 or higher. For more details, please see: * https://bugs.python.org/issue37179 * https://github.com/python/cpython/pull/28073 * https://docs.aiohttp.org/en/stable/client_advanced.html#proxy-support * https://github.com/aio-libs/aiohttp/discussions/6044 )rS � start_tlsr r )r? Zattr_excr@ r@ rA r � s z&TCPConnector._check_loop_for_start_tlsc C s* y | � � W n tk r dS X dS d S )NFT)r r )r? r@ r@ rA �_loop_supports_start_tls s z%TCPConnector._loop_supports_start_tls)�underlying_transportr� r> c C s< |j jjdkrdS t|dd�}|r&dS tjdt| dd� dS )z6Issue a warning if the requested URL has HTTPS scheme.r NZ_start_tls_compatibleFa An HTTPS request is being sent through an HTTPS proxy. This support for TLS in TLS is known to be disabled in the stdlib asyncio. This is why you'll probably see an error in the log below. It is possible to enable it via monkeypatching under Python 3.7 or higher. For more details, see: * https://bugs.python.org/issue37179 * https://github.com/python/cpython/pull/28073 You can temporarily patch this as follows: * https://docs.aiohttp.org/en/stable/client_advanced.html#proxy-support * https://github.com/aio-libs/aiohttp/discussions/6044 � )r_ rj )� request_info�urlr �getattrrD rE �RuntimeWarning)r? r# r� Zasyncio_supports_tls_in_tlsr@ r@ rA �_warn_about_tls_in_tls s z#TCPConnector._warn_about_tls_in_tls)r# r� r� r r> c � s� | � � }ttj| �|��}ylt|j�4 I dH �J y$| jj||||j |j d�I dH }W n t k rr |� � � Y nX W dQ I dH R X W n� t k r� } zt|j|�|�W dd}~X Y n� tk r� } zt|j|�|�W dd}~X Y n� tk �r } z||j|�|�W dd}~X Y nh tk �rp } z>td|j �d|jd�d|j�d|j�pNd� d | �d � �| �W dd} ~ X Y n X |�|� ||fS ) z$Wrap the raw TCP transport with TLS.N)�server_hostnameZssl_handshake_timeoutz2Cannot initialize a TLS-in-TLS connection to host �:�dz4 through an underlying connection to an HTTPS proxy z ssl:�defaultz [�])r� r r� r r r+ r rS r! r� �totalr� rs r$ r r� r% r r � TypeErrorr r� r Zconnection_made) r? r# r� r� r Z tls_protor Z tls_transportr� Ztype_errr@ r@ rA �_start_tls_connection3 s6 4z"TCPConnector._start_tls_connection)r� r� r� r r> c � s� | � |�}| �|�}|jj}|d k s(t�|j}|d k s:t�tj| j|||d�| j d�} yt� | �I d H } W n` tj k r� dd d�dd�} | � | � � Y n0 t k r� } zt|j| �| �W d d } ~ X Y nX d } �x| D ]�}|d }|d }yN| j| j|||||d |d |d |�r |d nd | j||d � I d H \}}W n* tk �rd } z | } w�W d d } ~ X Y nX |�� �r�|�r�y|�|� W nF tk �r� } z&|�� | j�s�| j�|� | } w�W d d } ~ X Y nX ||fS W | d k �s�t�| �d S )N)r� )rP z$asyncio.Future[List[Dict[str, Any]]])r� r> c S s$ t ttj�� | �� W d Q R X d S )N)r ro rx �CancelledErrorr )r� r@ r@ rA �drop_exception� s z>TCPConnector._create_direct_connection.<locals>.drop_exceptionr� r� r� r� r r� ) r� r� r� r� r r* r� r� r )r r r& Zraw_hostr� r� rx Z ensure_futurer rS Zshieldr2 �add_done_callbackr r r� r r� r� r� �checkr" rs r� r� rm )r? r� r� r� r r r� r� r� Z host_resolvedZhostsr3 r� �last_excZhinfoZtranspr� r@ r@ rA r l sb z&TCPConnector._create_direct_connectionc � s� | � |� | �� }i }|jd k r&|j}|jtj |tj< |j}|d k sJt�ttj |||j | j |j d�}| j |g |td�I d H \}} | �� |j�tjd �} | d k r�|�� s�| |jtj< n | |jtj< |�� �r�|r�| �||� tj|_|j|_tj|jd d d d�} t| | | | j �} |� | �I d H } �zdy4| j }|d k �s<t�|j |d� | � | �I d H }W n* t k �r� | �!� | �!� � Y �nX d | _ d | _"z�yv|j#dk�r�|j$}|d k�r�t%|j# d }t&| j'|j(|j#||jd��|�s|j)dd d �}|d k�r t*d ��|�+� }W n t k �r* |�!� � Y nX W d |�s>|�!� X |�sp| �,|�}| j-| j.||||j/|d �I d H S | j0|||d �I d H S W d | �!� X || fS ) N)�headers�authrP r� )r )r � proxy_authZproxy_headers_hash)Zread_until_eof�� r )�statusra r7 �socket)r- z)Transport does not expose socket instance)r� r� �sockr* r� )r� r� )1r r" Z proxy_headersr7 r ZHOSTr r� r' ZMETH_GETr9 rS r� r r! r� r� Z AUTHORIZATIONr� ZPROXY_AUTHORIZATIONr) Z METH_CONNECT�methodr& �attrZevolver� rL �sendrT Zset_response_params�startr� rs rw r; �reasonr0 r r% �historyZget_extra_infor �dupr r r� r� r1 )r? r� r� r� Zruntime_has_start_tlsr7 r& Z proxy_reqrk r� r8 rN ZconnZ proxy_resprO Zrespra Zrawsockr r@ r@ rA r � s� z%TCPConnector._create_proxy_connection)NN)N)4rH rI rJ r r/ r} r �bytesr� r r r( r rz r r� r� rx ry rB r rs r{ r� r� r� r r r r r& r� � staticmethodr� � lru_cacher r r r r ro r| r r r r" r) Z BaseTransportr1 r r � __classcell__r@ r@ )r� rA r4 � s^ l K ! &9F r4 c sx e Zd ZdZdedddfeeeee df e e e e j dd�� fdd� Zeed �d d ��Zd ed ded�dd�Z� ZS )r5 a� Unix socket connector. path - Unix socket path. keepalive_timeout - (optional) Keep-alive timeout. force_close - Set to True to force close and do reconnect after each request (and between redirects). limit - The total number of simultaneous connections. limit_per_host - Number of simultaneous connections to one host. loop - Optional event loop. Fr� r N)�pathr� r� r� r� rP r> c s t � j|||||d� || _d S )N)r� r� r� r� rP )r� rB �_path)r? rI r� r� r� r� rP )r� r@ rA rB F s zUnixConnector.__init__)r> c C s | j S )zPath to unix socket.)rJ )r? r@ r@ rA rI X s zUnixConnector.pathr' r9 r7 )r� r� r� r> c � s� yDt |j�4 I d H �" | j�| j| j�I d H \}}W d Q I d H R X W n4 tk rx } zt| j|j |�|�W d d }~X Y nX t t |�S )N) r+ r rS Zcreate_unix_connectionr� rJ r r# rI r� r r& )r? r� r� r� r r� r� r@ r@ rA r� ] s *$z UnixConnector._create_connection)rH rI rJ r r/ rz r} r r� r� r� r rx ry rB r{ rI r r& r� rH r@ r@ )r� rA r5 : s r5 c sx e Zd ZdZdedddfeeeee df e e e e j dd�� fdd� Zeed �d d ��Zd ed ded�dd�Z� ZS )r6 a Named pipe connector. Only supported by the proactor event loop. See also: https://docs.python.org/3.7/library/asyncio-eventloop.html path - Windows named pipe path. keepalive_timeout - (optional) Keep-alive timeout. force_close - Set to True to force close and do reconnect after each request (and between redirects). limit - The total number of simultaneous connections. limit_per_host - Number of simultaneous connections to one host. loop - Optional event loop. Fr� r N)rI r� r� r� r� rP r> c s6 t � j|||||d� t| jtj�s,td��|| _d S )N)r� r� r� r� rP z9Named Pipes only available in proactor loop under windows)r� rB r rS rx ZProactorEventLoopr rJ )r? rI r� r� r� r� rP )r� r@ rA rB z s zNamedPipeConnector.__init__)r> c C s | j S )zPath to the named pipe.)rJ )r? r@ r@ rA rI � s zNamedPipeConnector.pathr' r9 r7 )r� r� r� r> c � s� yTt |j�4 I d H �2 | j�| j| j�I d H \}}t�d�I d H W d Q I d H R X W n0 tk r� } zt |j |�|�W d d }~X Y nX t t |�S )Nr ) r+ r rS Zcreate_pipe_connectionr� rJ rx �sleepr r r� r r& )r? r� r� r� r r� r� r@ r@ rA r� � s $ z%NamedPipeConnector._create_connection)rH rI rJ r r/ rz r} r r� r� r� r rx ry rB r{ rI r r& r� rH r@ r@ )r� rA r6 k s r6 )Xrx r� r� rY rW rD � collectionsr r � contextlibr Z http.cookiesr � itertoolsr r r� r �typesr �typingr r r r r r r r r r r r r r r? � r r �abcr Zclient_exceptionsr r r r r r! r" r# r$ r% Z client_protor& Z client_reqrepr' r( r) r* r+ r, r- r. r/ �httpr0 �locksr1 r� r2 r� r � ImportErrorr� �__all__Zclientr7 r8 �tracingr9 r: rL r~ r3 r� r4 r5 r6 r@ r@ r@ rA �<module> s` @ 0 Z n) g1