o ,] @sdZddlmZmZmZmZddlmZmZm Z m Z ddl m Z ddl mZddl mZddlmZddlZddlZddlZdd lmZddlZdd lmZe rWdd lmZndd lmZgd Zd Z dZ!dZ"dZ#dZ$dZ%dZ&dZ'dZ(dZ)dZ*dZ+dZ,dZ-dZ.dZ/dZ0dZ1dZ2d Z3d!Z4d"Z5d#Z6d$Z7d%Z8d&Z9d'Z:d(Z;d)Zd,Z?d-Z@d.ZAd/ZBd0ZCd1ZDd2ZEd3ZFd4ZGd5ZHd6ZId7ZJd8ZKd9ZLd:ZMd;ZNdZQd?ZRd@ZSdAZTdBZUdCZVdDZWdEZXdFZYdGZZiddHddIddJddKddLddMddNddOddPddQd dRd!dSd"dTd#dUd$dVdWdXd%dYid&dZd'd[d(d\d)d]d*d^d+d_d,d`d-dad.dbd/dcd0ddd1ded2dfd3dgd4dhd5did6djdkdldmdndodpdqdrdsdtdudv Z[dwZ\dxZ]dZ^Gdydzdzej_Z`e`fd{d|ZaebZcGd}d~d~ejdZeGdddebZfz ddlgZgddlgmhZhWn eiyYnwGdddefZjekdGdddelZmGdddemZnGdddemZoGdddemZpGdddemZqGdddemZrGdddemZsGdddemZtGdddetZuGdddetZvGdddetZwGdddemZxGdddemZyemZzdS)aD HTTP/1.1 client library A backport of the Python 3.3 http/client.py module for python-future. HTTPConnection goes through a number of "states", which define when a client may legally make another request or fetch the response for a particular request. This diagram details these state transitions: (null) | | HTTPConnection() v Idle | | putrequest() v Request-started | | ( putheader() )* endheaders() v Request-sent | | response = getresponse() v Unread-response [Response-headers-read] |\____________________ | | | response.read() | putrequest() v v Idle Req-started-unread-response ______/| / | response.read() | | ( putheader() )* endheaders() v v Request-started Req-sent-unread-response | | response.read() v Request-sent This diagram presents the following rules: -- a second request may not be started until {response-headers-read} -- a response [object] cannot be retrieved until {request-sent} -- there is no differentiation between an unread response body and a partially read response body Note: this enforcement is applied by the HTTPConnection class. The HTTPResponse class does not enforce this state machine, which implies sophisticated clients may accelerate the request/response pipeline. Caution should be taken, though: accelerating the states beyond the above pattern may imply knowledge of the server's connection-close behavior for certain requests. For example, it is impossible to tell whether the server will close the connection UNTIL the response headers have been read; this means that further requests cannot be placed into the pipeline until it is known that the server will NOT be closing the connection. Logical State __state __response ------------- ------- ---------- Idle _CS_IDLE None Request-started _CS_REQ_STARTED None Request-sent _CS_REQ_SENT None Unread-response _CS_IDLE Req-started-unread-response _CS_REQ_STARTED Req-sent-unread-response _CS_REQ_SENT )absolute_importdivisionprint_functionunicode_literals)bytesintstrsuper)PY2)parser)message)create_connectionN)urlsplit)array)Iterable) HTTPResponseHTTPConnection HTTPException NotConnectedUnknownProtocolUnknownTransferEncodingUnimplementedFileModeIncompleteRead InvalidURLImproperConnectionStateCannotSendRequestCannotSendHeaderResponseNotReady BadStatusLineerror responsesPiUNKNOWNIdlezRequest-startedz Request-sentdefi,i-i.i/i0i1i3iiiiiiiiiiiiiiiiiiiiiiiContinuezSwitching ProtocolsOKCreatedAcceptedzNon-Authoritative Informationz No Contentz Reset ContentzPartial ContentzMultiple ChoiceszMoved PermanentlyFoundz See Otherz Not Modifiedz Use Proxyi2z(Unused)zTemporary Redirectz Bad Request UnauthorizedzPayment Required Forbiddenz Not FoundzMethod Not AllowedzNot AcceptablezProxy Authentication RequiredzRequest TimeoutConflictGonezLength RequiredzPrecondition FailedzRequest Entity Too LargezRequest-URI Too LongzUnsupported Media TypezRequested Range Not SatisfiablezExpectation FailedzPrecondition RequiredzToo Many RequestszRequest Header Fields Too LargezInternal Server ErrorzNot Implementedz Bad GatewayzService UnavailablezGateway TimeoutzHTTP Version Not SupportedzNetwork Authentication Required) r0r1r2r3r4r5r6r7r8r9r:iic@eZdZddZdS) HTTPMessagecCsj|d}t|}g}d}|D] }|d||kr!d}n |dds+d}|r2||q|S)aFind all header lines matching a given header name. Look through the list of headers and find all lines matching a given header name (and their continuation lines). A list of the lines is returned, without interpretation. If the header does not occur, an empty list is returned. If the header occurs multiple times, all occurrences are returned. Case is not important in the header name. :rN)lowerlenkeysisspaceappend)selfnamenlsthitlinerS>/usr/lib/python3/dist-packages/future/backports/http/client.pygetallmatchingheaderss   z!HTTPMessage.getallmatchingheadersN)__name__ __module__ __qualname__rUrSrSrSrTrEs rEcCs|g} |td}t|tkrtd||t|tkr%tdt|dvr*nqtd| d}t j |d |S) aGParses only RFC2822 headers from a file pointer. email Parser wants to see strings rather than bytes. But a TextIOWrapper around self.rfile would buffer too many bytes from the stream, bytes which we later need to read as bytes. So we read the correct bytes here, as bytes, for email Parser to parse. TrG header linezgot more than %d headers  r] iso-8859-1)_class) readline_MAXLINErI LineTooLongrL _MAXHEADERSrrjoindecode email_parserParserparsestr)fpr_headersrRhstringrSrSrT parse_headerss      rlcseZdZdeddfddZddZddZd d Zd d Zfd dZ fddZ ddZ ddZ d3fdd Z ddZddZddZddZdd Zd!d"Zd#d$Zd%d&Zd3d'd(Zd)d*Zd+d,Zd-d.Zd/d0Zd1d2ZZS)4rrNcCsh|d|_||_|turtdtd||_d|_|_ t |_ t |_ t |_ t |_t |_t |_t |_dS)Nrbithe 'strict' argument isn't supported anymore; http.client now always assumes HTTP/1.x compliant servers.)makefileri debuglevel_strict_sentinelwarningswarnDeprecationWarning_methodrjmsg_UNKNOWNversionstatusreasonchunked chunk_leftlength will_close)rMsockrqstrictmethodurlrSrSrT__init__*s   zHTTPResponse.__init__c Cst|jtdd}t|tkrtd|jdkr!tdt||s't |z | dd\}}}Wn!t ySz | dd\}}d}Wn t yPd}YnwYnw| dsa| t |zt|}|d ksn|d krrt |Wn t y~t |w|||fS) NrGr^z status linerzreply:rozHTTP/r$i)rrir`rarIrbrqprintreprrsplit ValueError startswith _close_connr)rMrRryrzr{rSrSrT _read_statusLs<       zHTTPResponse._read_statuscCs|jdurdS |\}}}|tkrn& |jtd}t|tkr'td|}|s.n |j dkr8t d|qq||_ |_ ||_ |dvrMd|_n |drVd |_nt|t|j|_|_|j dkru|jD] }t d|d d qk|jd }|r|d krd|_d|_nd|_||_d|_|jd}|jd }|r|jszt||_Wn tyd|_Yn w|jdkrd|_nd|_|tks|tksd|krdksn|jdkrd|_|js|js|jdurd|_dSdSdSdS)NTrGrYrzheader:)zHTTP/1.0zHTTP/0.9 zHTTP/1.  )endztransfer-encodingr|Fcontent-lengthr$r'HEAD)rjrCONTINUErir`rarIrbstriprqrcoderzr{ryrrrlrwgetrHr|r} _check_closerr~rr NO_CONTENT NOT_MODIFIEDrv)rMryrzr{skiphdrtr_encr~rSrSrTbeginlst                    zHTTPResponse.begincCs|jd}|jdkr|jd}|rd|vrdSdS|jdr%dS|r/d|vr/dS|jd}|r?d|vr?dSdS)N connectionrcloseTFz keep-alivezproxy-connection)rjrryrH)rMconnpconnrSrSrTrs     zHTTPResponse._check_closecCs|j}d|_|dSN)rir)rMrirSrSrTrs zHTTPResponse._close_conncs t|jr|dSdSr)r rrirrM __class__rSrTrs  zHTTPResponse.closecs"t|jr|jdSdSr)r flushrirrrSrTrs zHTTPResponse.flushcCsdS)NTrSrrSrSrTreadablezHTTPResponse.readablecCs |jduS)z!True if the connection is closed.N)rirrSrSrTiscloseds zHTTPResponse.isclosedcs|jdur tdS|jdkr|tdS|dur$ttt||S|jr+|S|j dur6|j}nz| |j }Wn t yJ|wd|_ |t|S)Nr]rr) rirrvrr rreadr|_readall_chunkedr~ _safe_readr)rMamtsrrSrTrs(     zHTTPResponse.readcCs|jdurdS|jdkr|dS|jr||S|jdur/t||jkr/t|d|j}trD|j t|}t|}||d|<n|j |}|sT|rT||S|jdurg|j|8_|jsg||S)Nrr) rirvrr|_readinto_chunkedr~rI memoryviewr rreadinto)rMbdatarOrSrSrTrs.      zHTTPResponse.readintocCsh|jtd}t|tkrtd|d}|dkr!|d|}zt|dWSty3|w)NrGz chunk size;r) rir`rarIrbfindrrr)rMrRirSrSrT_read_next_chunk_sizeAs     z"HTTPResponse._read_next_chunk_sizecCs< |jtd}t|tkrtd|sdS|dvrdSq)NTrGz trailer linerZ)rir`rarIrbrMrRrSrSrT_read_and_discard_trailerQs z&HTTPResponse._read_and_discard_trailercCs|jtksJ|j}g} |dur.z |}|dkrWn"Wnty-ttd|w|| || dd}q | | td|S)NTrr]ro) r|rxr}rrrrrdrLrrr)rMr}valuerSrSrTr_s(  zHTTPResponse._readall_chunkedcCs |jtksJ|j}d}t|} |dur3z |}|dkr Wn[Wnty2tt|d|wt||krG| |}|||_||St||kr^| |}| dd|_||S|d|}| |}||d}||7}| dd}q| | |S)NrTro) r|rxr}rrrrrrI_safe_readintorrr)rMrr} total_bytesmvbrOtemp_mvbrSrSrTrxsB           zHTTPResponse._readinto_chunkedcCsbg}|dkr*|jt|t}|sttd|||||t|8}|dkstd|S)aVRead the number of bytes requested, compensating for partial reads. Normally, we have a blocking socket, but a read() can be interrupted by a signal (resulting in a partial read). Note that we cannot distinguish between EOF and an interrupt when zero bytes have been read. IncompleteRead() will be raised in this situation. This function should be used when bytes "should" be present for reading. If the bytes are truly not available (due to EOF), then the IncompleteRead exception can be used to detect the problem. rr]) rirmin MAXAMOUNTrrrdrLrI)rMrrchunkrSrSrTrs  zHTTPResponse._safe_readcCsd}t|}|t|krntt|kr4|dt}tr-|jt|}t|}||d|<n"|j|}ntrI|jt|}t|}||d|<n|j|}|s^tt|d|t|||d}||7}|t|ks |S)z2Same as _safe_read, but for reading into a buffer.rN) rrIrr rirrrr)rMrrrrrrOrSrSrTrs*      zHTTPResponse._safe_readintocCs |jSr)rifilenorrSrSrTr zHTTPResponse.filenocCsB|jdurt|j|p|}t|tst|ds|Sd|S)N__iter__z, )rjrget_all isinstancerhasattrrd)rMrNdefaultrjrSrSrT getheaders  zHTTPResponse.getheadercCs|jdurtt|jS)z&Return list of (header, value) tuples.N)rjrlistitemsrrSrSrT getheaderss zHTTPResponse.getheaderscCs|SrrSrrSrSrTrrzHTTPResponse.__iter__cC|jSr)rjrrSrSrTinfozHTTPResponse.infocCrr)rrrSrSrTgeturlrzHTTPResponse.geturlcCrr)rzrrSrSrTgetcoderzHTTPResponse.getcoder)rVrWrXrrrrrrrrrrrrrrrrrrrrrrrrrr __classcell__rSrSrrTr!s2 " P   %)  rc@seZdZdZdZeZeZdZ dZ de e j dfddZd(dd Zd d Zd d ZddZddZddZddZddZd)ddZd*ddZddZd)ddZdifd d!Zd"d#Zd$d%Zd&d'ZdS)+rrzHTTP/1.1rGrNcCsb|tur tdtd||_||_d|_g|_d|_t |_ d|_ d|_ d|_ i|_|||dS)Nrnro)rrrsrtrutimeoutsource_addressr_buffer_HTTPConnection__response_CS_IDLE_HTTPConnection__staterv _tunnel_host _tunnel_port_tunnel_headers _set_hostport)rMhostportrrrrSrSrTrszHTTPConnection.__init__cCs(||_||_|r ||_dS|jdS)z Sets up the host and the port for the HTTP CONNECT Tunnelling. The headers argument should be a mapping of extra HTTP headers to send with the CONNECT request. N)rrrclear)rMrrrjrSrSrT set_tunnels  zHTTPConnection.set_tunnelcCs|dur`|d}|d}||krIz t||dd}Wn#tyA||dddkr3|j}n td||ddYnw|d|}n|j}|r`|ddkr`|ddkr`|dd}||_||_dS) NrF]rGrznonnumeric port: '%s'r[)rfindrr default_portrrr)rMrrrjrSrSrTrs$     zHTTPConnection._set_hostportcCs ||_dSr)rq)rMlevelrSrSrTset_debuglevel2rzHTTPConnection.set_debuglevelc Cs||j|jd|j|jf}|d}|||jD]\}}d||f}|d}||q|t d|j |j |j d}| \}} } | dkr^|td| | f |jtd } t| tkrqtd | sudS| d vr{dSq_) NzCONNECT %s:%d HTTP/1.0 asciiz%s: %s latin-1r[rr'zTunnel connection failed: %d %sTrGrYrZ)rrrrrencodesendrrrresponse_classrrvrrsocketrrrir`rarIrb) rM connect_str connect_bytesheaderr header_str header_bytesresponseryrr rRrSrSrT_tunnel5s2      zHTTPConnection._tunnelcCs0t|j|jf|j|j|_|jr|dSdS)z3Connect to the host and port specified in __init__.N)socket_create_connectionrrrrrrrrrSrSrTconnectQs  zHTTPConnection.connectcCs6|jr |jd|_|jr|jd|_t|_dS)z(Close the connection to the HTTP server.N)rrrrrrrSrSrTrXs   zHTTPConnection.closecCs,|jdur|jr |nt|jdkrtdt|d}t|drjt|t sj|jdkr1tdd}z|j }Wn t yAYnwd|vrQd }|jdkrQtd  | |}|s\ dS|rc| d }|j|qRz |j|WdStyt|tr|D]}|j|qYdStd t|w)zSend `data' to the server. ``data`` can be a string object, a bytes object, an array object, a file-like object that supports a .read() method, or an iterable object. Nrzsend:i rzsendIng a read()ableFrTzencoding file using iso-8859-1rGr^z9data should be a bytes-like object or an iterable, got %r)r auto_openrrrqrrrrrmodeAttributeErrorrrsendall TypeErrorrtype)rMr blocksizerr datablockdrSrSrTrbsP            zHTTPConnection.sendcCs|j|dS)zuAdd a line of output to the current request buffer. Assumes that the line does *not* end with \r\n. N)rrL)rMrrSrSrT_outputszHTTPConnection._outputcCsn|jtdtdftd|j}|jdd=t|tr%||7}d}|||dur5||dSdS)zSend the currently buffered request and clear the buffer. Appends an extra \r\n to the buffer. A message_body may be specified, to be appended to the request. r]r[N)rextendrrdrr)rM message_bodyrwrSrSrT _send_outputs   zHTTPConnection._send_outputc Cst|jr |jr d|_|jtkrt|_nt|j||_|s d}d|||jf}|| d|j dkr|sd}| drGt |\}}}}}|rfz| d}Wnt y^| d}Ynw|d |nEz|j d} Wnt y}|j d} Ynw|jd d krtd | d } |j|jkr|d | n| d} |d d| |jf|s|dddSdS dS)a`Send a request to the server. `method' specifies an HTTP request method, e.g. 'GET'. `url' specifies the object being requested, e.g. '/index.html'. `skip_host' if True does not add automatically a 'Host:' header `skip_accept_encoding' if True does not add automatically an 'Accept-Encoding:' header N/z%s %s %srrrhttpidnaHostrFr[]z%s:%szAccept-Encodingidentity)rrrr_CS_REQ_STARTEDrrv _http_vsn_strrr _http_vsnrrUnicodeEncodeError putheaderrrrrrre) rMrr skip_hostskip_accept_encodingrequestnetlocnil netloc_enchost_encrSrSrT putrequestsJ           zHTTPConnection.putrequestcGs|jtkrtt|dr|d}t|}t|D]\}}t|dr+|d||<qt|tr9t |d||<qt d |}|t d|}| |dS)zkSend a request header line to the server. For example: h.putheader('Accept', 'text/html') rrrs s: N) rrrrrr enumeraterrrrrdr)rMrvaluesr one_valuerrSrSrTr$s     zHTTPConnection.putheadercCs&|jtkr t|_nt||dS)aIndicate that the last header line has been sent to the server. This method sends the request to the server. The optional message_body argument can be used to pass a message body associated with the request. The message body will be sent in the same packet as the message headers if it is a string, otherwise it is sent as a separate packet. N)rr _CS_REQ_SENTrr)rMrrSrSrT endheaders8s zHTTPConnection.endheaderscCs|||||dS)z&Send a complete request to the server.N) _send_request)rMrrbodyrjrSrSrTrGszHTTPConnection.requestc Csd}ztt|}Wn3ty=}z'z tt|j}Wnttfy2|j dkr0t dYnwWYd}~nd}~ww|durJ| d|dSdS)Nrz Cannot stat!!zContent-Length) rrIrosfstatrst_sizerOSErrorrqrr)rMr!thelenterSrSrT_set_content_lengthKs z"HTTPConnection._set_content_lengthc Cstdd|D}i}d|vrd|d<d|vrd|d<|j||fi||dur3d|vr3|||D] \}}|||q7t|trL|d }| |dS) NcSsg|]}|qSrS)rH).0krSrSrT ^sz0HTTPConnection._send_request..rrGrzaccept-encodingrrr^) dictfromkeysrr(rrrrrr) rMrrr!rj header_namesskipsrrrSrSrTr \s   zHTTPConnection._send_requestcCs|jr |jr d|_|jtks|jrt|j|jdkr)|j|j|j|jd}n |j|j|jd}| |j t ks=Jt |_|j rI| |S||_|S)a/Get the response from the server. If the HTTPConnection is in the correct state, returns an instance of HTTPResponse or of whatever object is returned by class the response_class variable. If a request has not been sent or if a previous response has not be handled, ResponseNotReady is raised. If the HTTP response indicates that the connection should be closed, then it will be closed before the response is returned. When the connection is closed, the underlying socket is closed. Nrr)rrrrrrqrrrvrrrxrr)rMrrSrSrT getresponseqs"   zHTTPConnection.getresponse)NNr)rr)rVrWrXrrrr HTTP_PORTrrrqrrr_GLOBAL_DEFAULT_TIMEOUTrrrrrrrrrrrrrrr(r r0rSrSrSrTrs4   2  t  r) SSLContextcs<eZdZdZeZdddeejdffdd Z ddZ Z S)HTTPSConnectionz(This class allows communication via SSL.Nc  sd|vr |d} |d=nd} d|vr|d} |d=nd} tt||||||||_||_| dur@ttj} | jtj O_| j tj k} | durM| } n| rU| sUt d|sY|r_| ||| |_| |_dS)Ncheck_hostnamecontextzMcheck_hostname needs a SSL context with either CERT_OPTIONAL or CERT_REQUIRED)r r4rkey_file cert_filesslr3PROTOCOL_SSLv23options OP_NO_SSLv2 verify_mode CERT_NONErload_cert_chain_context_check_hostname) rMrrr7r8rrr _3to2kwargsr5r6 will_verifyrrSrTrs*    zHTTPSConnection.__init__cCst|j|jf|j|j}|jr||_|tj r|jnd}|j j ||d|_z|j r8t |j|jWdSWdStyN|jtj|jw)z(Connect to a host on a given (SSL) port.N)server_hostname)rrrrrrrrr9HAS_SNIr@ wrap_socketrAmatch_hostname getpeercert Exceptionshutdownr SHUT_RDWRr)rMrrDrSrSrTrs&   zHTTPSConnection.connect) rVrWrX__doc__ HTTPS_PORTrrrrr2rrrrSrSrrTr4sr4c@ eZdZdS)rNrVrWrXrSrSrSrTrsrc@rN)rNrOrSrSrSrTr rc@rN)rNrOrSrSrSrTr rPrc@rD)rcCs|f|_||_dSr)argsry)rMryrSrSrTrs zUnknownProtocol.__init__NrVrWrXrrSrSrSrTr rc@rN)rNrOrSrSrSrTrrPrc@rN)rNrOrSrSrSrTrrPrc@s&eZdZdddZddZddZdS) rNcCs|f|_||_||_dSr)rQpartialexpected)rMrTrUrSrSrTrs zIncompleteRead.__init__cCs,|jdur d|j}nd}dt|j|fS)Nz, %i more expectedrzIncompleteRead(%i bytes read%s))rUrIrT)rMerSrSrT__repr__ s  zIncompleteRead.__repr__cCst|Sr)rrrSrSrT__str__&szIncompleteRead.__str__r)rVrWrXrrWrXrSrSrSrTrs  rc@rN)rNrOrSrSrSrTr)rPrc@rN)rNrOrSrSrSrTr,rPrc@rN)rNrOrSrSrSrTr/rPrc@rN)rNrOrSrSrSrTr2rPrc@rD)rcCs|st|}|f|_||_dSr)rrQrRrrSrSrTr6s zBadStatusLine.__init__NrRrSrSrSrTr5rSrc@rD)rbcCst|dt|fdS)Nz&got more than %d bytes when reading %s)rrra)rM line_typerSrSrTr=s zLineTooLong.__init__NrRrSrSrSrTrb<rSrb){rL __future__rrrrfuture.builtinsrrrr future.utilsr future.backports.emailr rfr email_messagefuture.backports.miscr rior"rfuture.backports.urllib.parserrsr collectionsrcollections.abc__all__r1rMrxrrrrSWITCHING_PROTOCOLS PROCESSINGr<CREATEDACCEPTEDNON_AUTHORITATIVE_INFORMATIONr RESET_CONTENTPARTIAL_CONTENT MULTI_STATUSIM_USEDMULTIPLE_CHOICESMOVED_PERMANENTLYFOUND SEE_OTHERr USE_PROXYTEMPORARY_REDIRECT BAD_REQUEST UNAUTHORIZEDPAYMENT_REQUIRED FORBIDDEN NOT_FOUNDMETHOD_NOT_ALLOWEDNOT_ACCEPTABLEPROXY_AUTHENTICATION_REQUIREDREQUEST_TIMEOUTCONFLICTGONELENGTH_REQUIREDPRECONDITION_FAILEDREQUEST_ENTITY_TOO_LARGEREQUEST_URI_TOO_LONGUNSUPPORTED_MEDIA_TYPEREQUESTED_RANGE_NOT_SATISFIABLEEXPECTATION_FAILEDUNPROCESSABLE_ENTITYLOCKEDFAILED_DEPENDENCYUPGRADE_REQUIREDPRECONDITION_REQUIREDTOO_MANY_REQUESTSREQUEST_HEADER_FIELDS_TOO_LARGEINTERNAL_SERVER_ERRORNOT_IMPLEMENTED BAD_GATEWAYSERVICE_UNAVAILABLEGATEWAY_TIMEOUTHTTP_VERSION_NOT_SUPPORTEDINSUFFICIENT_STORAGE NOT_EXTENDEDNETWORK_AUTHENTICATION_REQUIREDr rrarcMessagerErlobjectrr RawIOBaserrr9r3 ImportErrorr4rLrIrrrrrrrrrrrrrbrrSrSrSrTsF            !"#$%&5 V7 6!