U
.e @ s d Z ddlZddlZddlZddlmZ ddlmZ ddl m
Z
ddl m Z m
Z
mZmZ ddlmZ dd lmZ dd
lmZ dd lmZ dd lmZmZmZ dd
l m Z m Z m Z m Z m!Z!m"Z"m#Z# ddl$m%Z%m&Z& ddl'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1 ddl2m3Z3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:m;Z;mZ> ddl2m?Z@ ddlAmBZB eBjCeBjDeBjEeBjFeBjGfZHdZIdZJdZKG dd deLZMG dd deLZNG dd deNZOG d d d eMeNZPG d d d eLZQdS ) z`
requests.models
~~~~~~~~~~~~~~~
This module contains the primary objects that power Requests.
N) RequestField)encode_multipart_formdata) parse_url) DecodeErrorReadTimeoutError
ProtocolErrorLocationParseError)UnsupportedOperation )
default_hooks)CaseInsensitiveDict)
HTTPBasicAuth)cookiejar_from_dictget_cookie_header_copy_cookie_jar) HTTPError
MissingSchema
InvalidURLChunkedEncodingErrorContentDecodingErrorConnectionErrorStreamConsumedError)to_native_stringunicode_is_ascii)
guess_filenameget_auth_from_url requote_uri stream_decode_response_unicodeto_key_val_listparse_header_links iter_slicesguess_json_utf super_lencheck_header_validity) CallableMapping cookielib
urlunparseurlsplit urlencodestrbytesis_py2chardet builtin_str
basestring)json)codes i ( i c @ s0 e Zd Zedd Zedd Zedd ZdS )RequestEncodingMixinc C sN g }t | j}|j}|s d}|| |j}|rD|d || d|S )zBuild the path URL to use./? )r( urlpathappendqueryjoin)selfr7 pr8 r: r> ?/usr/lib/python3.8/site-packages/pip/_vendor/requests/models.pypath_url= s
z RequestEncodingMixin.path_urlc C s t | ttfr| S t| dr | S t| drg }t| D ]j\}}t |tsRt|dsX|g}|D ]B}|dk r\|t |tr|dn|t |tr|dn|f q\q6t|ddS | S dS )zEncode parameters in a piece of data.
Will successfully encode parameters when passed as a dict or a list of
2-tuples. Order is retained if data is a list of 2-tuples but arbitrary
if parameters are supplied as a dict.
read__iter__Nutf-8T)Zdoseq)
isinstancer* r+ hasattrr r/ r9 encoder) )dataresultkZvsvr> r> r? _encode_paramsR s$
z#RequestEncodingMixin._encode_paramsc C s | st dnt|tr t dg }t|p,i }t| p8i } |D ]|\}}t|ts\t|dsb|g}|D ]T}|dk rft|tst|}|t|tr|dn|t|tr| dn|f qfq@| D ]\}}d}d} t|t
t fr t |dkr|\}
} n&t |dkr|\}
} }n |\}
} }} nt
|p,|}
|} t| tttfrJ| } n(t| dr`| } n| dkrnqn| } t|| |
| d }
|
j|d
||
qt|\}}||fS ) a Build the body for a multipart/form-data request.
Will successfully encode files when passed as a dict or a list of
tuples. Order is retained if data is a list of tuples but arbitrary
if parameters are supplied as a dict.
The tuples may be 2-tuples (filename, fileobj), 3-tuples (filename, fileobj, contentype)
or 4-tuples (filename, fileobj, contentype, custom_headers).
zFiles must be provided.zData must not be a string.rB NrC rA )namerG filenameheaders) content_type)
ValueErrorrD r/ r rE r+ r* r9 decoderF tuplelistlenr bytearrayrA r Zmake_multipartr )filesrG Z
new_fieldsZfieldsZfieldvalrJ rI ZftZfhfnfpZfdataZrfbodyrQ r> r> r?
_encode_filesm sT
z"RequestEncodingMixin._encode_filesN)__name__
__module__ __qualname__propertyr@ staticmethodrK r] r> r> r> r? r3 < s
r3 c @ s e Zd Zdd Zdd ZdS )RequestHooksMixinc C sZ || j krtd| t|tr2| j | | n$t|drV| j | dd |D dS )zProperly register a hook.z1Unsupported event specified, with event name "%s"rB c s s | ]}t |tr|V qd S N)rD r$ ).0hr> r> r? s
z2RequestHooksMixin.register_hook..N)hooksrR rD r$ r9 rE extendr< eventhookr> r> r?
register_hook s
z RequestHooksMixin.register_hookc C s2 z| j | | W dS tk
r, Y dS X dS )ziDeregister a previously registered hook.
Returns True if the hook existed, False if not.
TFN)rh removerR rj r> r> r? deregister_hook s
z!RequestHooksMixin.deregister_hookN)r^ r_ r` rm ro r> r> r> r? rc s rc c
@ s* e Zd ZdZd ddZdd Zdd ZdS )
Requesta{ A user-created :class:`Request ` object.
Used to prepare a :class:`PreparedRequest `, which is sent to the server.
:param method: HTTP method to use.
:param url: URL to send.
:param headers: dictionary of headers to send.
:param files: dictionary of {filename: fileobject} files to multipart upload.
:param data: the body to attach to the request. If a dictionary or
list of tuples ``[(key, value)]`` is provided, form-encoding will
take place.
:param json: json for the body to attach to the request (if files or data is not specified).
:param params: URL parameters to append to the URL. If a dictionary or
list of tuples ``[(key, value)]`` is provided, form-encoding will
take place.
:param auth: Auth handler or (user, pass) tuple.
:param cookies: dictionary or CookieJar of cookies to attach to this request.
:param hooks: dictionary of callback hooks, for internal usage.
Usage::
>>> import requests
>>> req = requests.Request('GET', 'https://httpbin.org/get')
>>> req.prepare()
Nc
C s |d kr g n|}|d kr g n|}|d kr,i n|}|d kr r> r? __init__ s" zRequest.__init__c C s
d| j S )Nzrr r< r> r> r? __repr__ s zRequest.__repr__c C s< t }|j| j| j| j| j| j| j| j| j | j
| j d
|S )zXConstructs a :class:`PreparedRequest ` for transmission and returns it.)
rr r7 rP rX rG r0 rs rt ru rh ) PreparedRequestpreparerr r7 rP rX rG r0 rs rt ru rh r< r= r> r> r? r{ s zRequest.prepare)
NNNNNNNNNN)r^ r_ r` __doc__rv ry r{ r> r> r> r? rp s
rp c
@ s e Zd ZdZdd Zd ddZdd Zd d
Zd d Ze d
d Z
dd Z dd Z d ddZ
dd Zd ddZdd Zd d ZdS )!rz a The fully mutable :class:`PreparedRequest ` object,
containing the exact bytes that will be sent to the server.
Generated from either a :class:`Request ` object or manually.
Usage::
>>> import requests
>>> req = requests.Request('GET', 'https://httpbin.org/get')
>>> r = req.prepare()
>>> s = requests.Session()
>>> s.send(r)
c C s0 d | _ d | _d | _d | _d | _t | _d | _d S rd )rr r7 rP _cookiesr\ r rh _body_positionrx r> r> r? rv " s zPreparedRequest.__init__Nc C sR | | | || | | | | | |||
| || | | dS )z6Prepares the entire request with the given parameters.N)prepare_method prepare_urlprepare_headersprepare_cookies prepare_body prepare_auth
prepare_hooks) r< rr r7 rP rX rG rs rt ru rh r0 r> r> r? r{ 3 s
zPreparedRequest.preparec C s
d| j S )Nzrw rx r> r> r? ry E s zPreparedRequest.__repr__c C sX t }| j|_| j|_| jd k r*| j nd |_t| j|_| j|_| j|_| j |_ |S rd )
rz rr r7 rP copyr r~ r\ rh r r| r> r> r? r H s zPreparedRequest.copyc C s$ || _ | j dk r t| j | _ dS )z Prepares the given HTTP method.N)rr r upper)r< rr r> r> r? r S s
z PreparedRequest.prepare_methodc C sD ddl m} z|j| ddd} W n |jk
r> tY nX | S )Nr )idnaT)Zuts46rC )Z pip._vendorr rF rS Z IDNAError UnicodeError)hostr r> r> r? _get_idna_encoded_hostY s
z&PreparedRequest._get_idna_encoded_hostc
C s, t |tr|d}ntr"t|nt|}| }d|krR| dsR|| _ dS zt
|\}}}}}}} W n, t k
r }
zt |
j
W 5 d}
~
X Y nX |sd} | t|d} t| |st d| t|sz| |}W n tk
r t dY nX n|drt d|p d } | r.| d
7 } | |7 } |rL| dt| 7 } |sVd }trt |trr|d }t | tr| d } t |tr|d }t |tr|d }t | tr| d } t |ttfrt|}| |}
|
r
|rd
||
f }n|
}tt|| |d|| g}|| _ dS )z Prepares the given HTTP URL.utf8:ZhttpNzDInvalid URL {0!r}: No schema supplied. Perhaps you meant http://{0}?z Invalid URL %r: No host suppliedzURL has an invalid label.*r6 @r4 rC z%s&%s)rD r+ rS r, Zunicoder* lstriplower
startswithr7 r r r argsformatr r r r r rF rK r r' )r< r7 rs Zschemert r Zportr8 r: ZfragmenteerrorZnetlocZ
enc_paramsr> r> r? r c sh
zPreparedRequest.prepare_urlc C s< t | _|r8| D ]"}t| |\}}|| jt|< qdS )z Prepares the given HTTP headers.N)r rP rq r# r )r< rP headerrN valuer> r> r? r s z PreparedRequest.prepare_headersc
C sr d}d}|s6|dk r6d}t |}t|ts6|d}tt|dt|ttt t
f g}z t |}W n t t
tfk
r d}Y nX |r|}t|dddk rz| | _W n ttfk
r t | _Y nX |rtd|rt|| jd< n
d| jd < np|r| ||\}}n2|rB| |}t|ts8t|d
r>d}nd }| | |rhd | jkrh|| jd
< || _dS )z"Prepares the given HTTP body data.Nzapplication/jsonrC rB tellz1Streamed bodies and files are mutually exclusive.Content-LengthZchunkedzTransfer-EncodingrA z!application/x-www-form-urlencodedz content-typez Content-Type) complexjsondumpsrD r+ rF allrE r/ rU rT r% r" TypeErrorAttributeErrorr getattrr r IOErrorOSErrorobjectNotImplementedErrorr. rP r] rK prepare_content_lengthr\ )r< rG rX r0 r\ rQ Z is_streamlengthr> r> r? r sL
z PreparedRequest.prepare_bodyc C sL |dk r$t |}|rHt|| jd< n$| jdkrH| jddkrHd| jd< dS )z>Prepare Content-Length header based on request method and bodyNr )ZGETZHEAD0)r" r. rP rr get)r< r\ r r> r> r? r s z&PreparedRequest.prepare_content_lengthr6 c C sj |dkr"t | j}t|r |nd}|rft|trDt|dkrDt| }|| }| j|j | | j
dS )z"Prepares the given HTTP auth data.NrL ) r r7 anyrD rT rV r
__dict__updater r\ )r< rt r7 Zurl_authrr> r> r? r s
z PreparedRequest.prepare_authc C s@ t |tjr|| _n
t|| _t| j| }|dk r<|| jd< dS )a Prepares the given HTTP cookie data.
This function eventually generates a ``Cookie`` header from the
given cookies using cookielib. Due to cookielib's design, the header
will not be regenerated if it already exists, meaning this function
can only be called once for the life of the
:class:`PreparedRequest ` object. Any subsequent calls
to ``prepare_cookies`` will have no actual effect, unless the "Cookie"
header is removed beforehand.
NZCookie)rD r& Z CookieJarr~ r r rP )r< ru Z
cookie_headerr> r> r? r , s
z PreparedRequest.prepare_cookiesc C s& |pg }|D ]}| ||| q dS )zPrepares the given hooks.N)rm )r< rh rk r> r> r? r @ s z PreparedRequest.prepare_hooks)
NNNNNNNNNN)N)r6 )r^ r_ r` r} rv r{ ry r r rb r r r r r r r r r> r> r> r? rz s2
V
E
rz c
@ s e Zd ZdZdddddddd d
d g
Zd d
Zdd Zdd Zdd Zdd Z dd Z
dd Z dd Z d d Z
ed d Zed d! Zed"d# Zed$d% Zed&d' Zd;d*d+Zed)d,fd-d.Zed/d0 Zed1d2 Zd3d4 Zed5d6 Zd7d8 Zd9d: Z d,S )<ResponsezhThe :class:`Response ` object, which contains a
server's response to an HTTP request.
_content status_coderP r7 historyencodingreasonru elapsedrequestc C s^ d| _ d| _d | _d | _t | _d | _d | _d | _g | _ d | _
t i | _ t
d| _d | _d S )NFr )r _content_consumed_nextr r rP rawr7 r r r r ru datetimeZ timedeltar r rx r> r> r? rv T s
zResponse.__init__c C s | S rd r> rx r> r> r? __enter__ s zResponse.__enter__c G s | d S rd )close)r< r r> r> r? __exit__ s zResponse.__exit__c s j s j fdd jD S )Nc s i | ]}|t |d qS rd )r )re attrrx r> r?
s z)Response.__getstate__..)r content __attrs__rx r> rx r? __getstate__ s zResponse.__getstate__c C s: | D ]\}}t| || qt| dd t| dd d S )Nr Tr )rq setattr)r< staterN r r> r> r? __setstate__ s zResponse.__setstate__c C s
d| j S )Nz)r rx r> r> r? ry s zResponse.__repr__c C s | j S ak Returns True if :attr:`status_code` is less than 400.
This attribute checks if the status code of the response is between
400 and 600 to see if there was a client error or a server error. If
the status code, is between 200 and 400, this will return True. This
is **not** a check to see if the response code is ``200 OK``.
okrx r> r> r? __bool__ s zResponse.__bool__c C s | j S r r rx r> r> r? __nonzero__ s zResponse.__nonzero__c C s
| dS )z,Allows you to use a response as an iterator. ) iter_contentrx r> r> r? rB s zResponse.__iter__c C s( z | W n tk
r" Y dS X dS )ax Returns True if :attr:`status_code` is less than 400, False if not.
This attribute checks if the status code of the response is between
400 and 600 to see if there was a client error or a server error. If
the status code is between 200 and 400, this will return True. This
is **not** a check to see if the response code is ``200 OK``.
FT)raise_for_statusr rx r> r> r? r s
z Response.okc C s d| j ko| jtkS )zTrue if this Response is a well-formed HTTP redirect that could have
been processed automatically (by :meth:`Session.resolve_redirects`).
location)rP r REDIRECT_STATIrx r> r> r? is_redirect s zResponse.is_redirectc C s d| j ko| jtjtjfkS )z@True if this Response one of the permanent versions of redirect.r )rP r r1 Zmoved_permanentlypermanent_redirectrx r> r> r? is_permanent_redirect s z Response.is_permanent_redirectc C s | j S )zTReturns a PreparedRequest for the next request in a redirect chain, if there is one.)r rx r> r> r? next s z
Response.nextc C s t | jd S )z7The apparent encoding, provided by the chardet library.r )r- Zdetectr rx r> r> r? apparent_encoding s zResponse.apparent_encodingr
Fc s| fdd}j r(tjtr(t n" dk rJt tsJtdt tj }| }j rf|n|}|rxt |}|S )a Iterates over the response data. When stream=True is set on the
request, this avoids reading the content at once into memory for
large responses. The chunk size is the number of bytes it should
read into memory. This is not necessarily the length of each item
returned as decoding can take place.
chunk_size must be of type int or None. A value of None will
function differently depending on the value of `stream`.
stream=True will read data as it arrives in whatever size the
chunks are received. If stream=False, data is returned as
a single chunk.
If decode_unicode is True, content will be decoded using the best
available encoding based on the response.
c
3 s t jdrz jj ddD ]
} | V q W q tk
rV } z t|W 5 d }~X Y q tk
r~ } z t|W 5 d }~X Y q tk
r } z t|W 5 d }~X Y qX nj } | sq| V qd_
d S )NstreamT)Zdecode_content) rE r r r r r r r r rA r )chunkr
chunk_sizer< r> r? generate s z'Response.iter_content..generateNz.chunk_size must be an int, it is instead a %s.)
r rD r boolr intr typer r )r< r decode_unicoder Z
reused_chunksZ
stream_chunksZchunksr> r r? r s
zResponse.iter_contentNc c s d}| j ||dD ]n}|dk r&|| }|r6||}n| }|rl|d rl|rl|d d |d krl| }nd}|D ]
}|V qtq|dk r|V dS )zIterates over the response data, one line at a time. When
stream=True is set on the request, this avoids reading the
content at once into memory for large responses.
.. note:: This method is not reentrant safe.
N)r r )r split
splitlinespop)r< r r Z delimiterZpendingr linesliner> r> r?
iter_lines s $
zResponse.iter_linesc C sV | j dkrJ| jrtd| jdks,| jdkr4d| _ nd| tpFd| _ d| _| j S )z"Content of the response, in bytes.Fz2The content for this response was already consumedr N T)r r RuntimeErrorr r r; r CONTENT_CHUNK_SIZErx r> r> r? r / s
zResponse.contentc C sh d}| j }| jstdS | j dkr(| j}zt| j|dd}W n& ttfk
rb t| jdd}Y nX |S )a Content of the response, in unicode.
If Response.encoding is None, encoding will be guessed using
``chardet``.
The encoding of the response content is determined based solely on HTTP
headers, following RFC 2616 to the letter. If you can take advantage of
non-HTTP knowledge to make a better guess at the encoding, you should
set ``r.encoding`` appropriately before accessing this property.
Nr6 replace)errors)r r r* r LookupErrorr )r< r r r> r> r? textC s
z
Response.textc K sj | j sZ| jrZt| jdkrZt| j}|dk rZztj| j|f|W S tk
rX Y nX tj| jf|S )zReturns the json-encoded content of a response, if any.
:param \*\*kwargs: Optional arguments that ``json.loads`` takes.
:raises ValueError: If the response body does not contain valid json.
rM N) r r rV r! r loadsrS UnicodeDecodeErrorr )r< kwargsr r> r> r? r0 i s
z
Response.jsonc C sF | j d}i }|rBt|}|D ] }|dp6|d}|||< q |S )z8Returns the parsed header links of the response, if any.linkZrelr7 )rP r r )r< r llinksr keyr> r> r? r s
zResponse.linksc C s d}t | jtrDz| jd}W qJ tk
r@ | jd}Y qJX n| j}d| j kr`dk rxn nd| j|| jf }n,d| j krdk rn nd| j|| jf }|rt|| d d
S ) z2Raises stored :class:`HTTPError`, if one occurred.r6 rC z
iso-8859-1i i z %s Client Error: %s for url: %siX z %s Server Error: %s for url: %s)ZresponseN)rD r r+ rS r r r7 r )r< Zhttp_error_msgr r> r> r? r s zResponse.raise_for_statusc C s0 | j s| j t| jdd}|dk r,| dS )zReleases the connection back to the pool. Once this method has been
called the underlying ``raw`` object must not be accessed again.
*Note: Should not normally need to be called explicitly.*
release_connN)r r r r )r< r r> r> r? r s
zResponse.close)r
F) r^ r_ r` r} r rv r r r r ry r r rB ra r r r r r r ITER_CHUNK_SIZEr r r r0 r r r r> r> r> r? r J sT /
7
%
r )Rr} r sysZencodings.idnaZ encodingsZpip._vendor.urllib3.fieldsr Z pip._vendor.urllib3.filepostr Zpip._vendor.urllib3.utilr Z pip._vendor.urllib3.exceptionsr r r r ior rh r Z
structuresr rt r
ru r r r
exceptionsr r r r r r r Z_internal_utilsr r Zutilsr r r r r r r r! r" r# compatr$ r% r& r' r( r) r* r+ r, r- r. r/ r0 r Z status_codesr1 ZmovedfoundotherZtemporary_redirectr r ZDEFAULT_REDIRECT_LIMITr r r r3 rc rp rz r r> r> r> r? sD $08 rJ <