o ~j6h @sNdZddlmZdZddlZddlmZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlZddlZddlZddlZddlZzddlZWn eyReZYnwejZddlmZddlmZddlmZddlmZdd l m!Z!dd l m"Z#dd l$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*dd l+m,Z,e -e.Z/d Z0dZ1dZ2dZ3dZ4dZ5ddZ6ddZ7GdddeZ8GdddeZ9GdddeZ:Gddde:Z;Gdd d e;ZGd%d&d&eZ?Gd'd(d(eZ@Gd)d*d*eZAGd+d,d,eZBGd-d.d.eZCGd/d0d0eZDGd1d2d2eZEd3d4ZFd5d6ZGd7d8ZHdS)9zClasses to encapsulate a single HTTP request. The classes implement a command pattern, with every object supporting an execute() method that does the actual HTTP request. )absolute_importz$jcgregorio@google.com (Joe Gregorio)N) Generator) MIMEMultipart)MIMENonMultipart) FeedParser)_auth)_helpers) BatchError HttpErrorInvalidChunkSizeErrorResumableUploadErrorUnexpectedBodyErrorUnexpectedMethodError) JsonModeli@iii<z https://www.googleapis.com/batchc sd}|dkrdS|tkrdS|tjkr||sdSzEt|dttrQtfdddDd }|rPd |}t|t rPt |d krP|d }d |vrP|d }n d d d d }Wnt t t fyotd|YdSwtd||dvr|dSdS)zDetermines whether a response should be retried. Args: resp_status: The response status received. content: The response content body. Returns: True if the response should be retried, otherwise False. NiTFutf-8c3s |] }|dvr|VqdS)errorN).0kwdatarc/var/www/html/chefvision.cloud.itp360.com/venv/lib/python3.10/site-packages/googleapiclient/http.py ws z)_should_retry_response..)errorsstatusmessagerrreasonrz&Invalid JSON content from response: %sz*Encountered 403 Forbidden with reason "%s")userRateLimitExceededrateLimitExceeded)_TOO_MANY_REQUESTS http_client FORBIDDENjsonloadsdecode isinstancedictnextlistlenUnicodeDecodeError ValueErrorKeyErrorLOGGERwarning) resp_statuscontentrerror_detail_keywordrrr_should_retry_responsePsD       r4c Osd} d} d} t|dD]} | dkr.|d| } td| | ||||| r'| jn| || zd} |j||g|Ri|\} } WnmtyU}z|} WYd}~n^d}~wtjyi}z|} WYd}~nJd}~wty|}z|} WYd}~n7d}~wt y}ztj j |j dvr|} WYd}~nd}~wt jy}z|} WYd}~nd}~ww| r| |kr| q t| j| s| | fSq | | fS)aRetries an HTTP request multiple times while handling errors. If after all retries the request still fails, last error is either returned as return value (for HTTP 5xx errors) or thrown (for ssl.SSLError). Args: http: Http object to be used to execute request. num_retries: Maximum number of retries. req_type: Type of the request (used for logging retries). sleep, rand: Functions to sleep for random time between retries. uri: URI to be requested. method: HTTP method to be used. args, kwargs: Additional arguments passed to http.request. Returns: resp, content - Response from the http request (may be HTTP 5xx). NrzCSleeping %.2f seconds before retry %d of %d for %s: %s %s, after %s>EPIPE ETIMEDOUT ECONNRESET ECONNABORTED ECONNREFUSED WSAETIMEDOUT)ranger/r0rrequest _ssl_SSLErrorsockettimeoutConnectionErrorOSErrorerrno errorcodegethttplib2ServerNotFoundErrorr4)http num_retriesreq_typesleeprandurimethodargskwargsrespr2 exception retry_num sleep_time ssl_errorsocket_timeoutconnection_error socket_errorserver_not_found_errorrrr_retry_requests^  " r[c@ eZdZdZddZddZdS)MediaUploadProgresszStatus of a resumable upload.cC||_||_dS)zConstructor. Args: resumable_progress: int, bytes sent so far. total_size: int, total bytes in complete upload, or None if the total upload size isn't known ahead of time. Nresumable_progress total_sizeselfr`rarrr__init__s zMediaUploadProgress.__init__cC,|jdur|jdkrt|jt|jSdS)zPercent of upload completed, as a float. Returns: the percentage complete as a float, returning 0.0 if the total size of the upload is unknown. Nrrafloatr`rcrrrprogresszMediaUploadProgress.progressN__name__ __module__ __qualname____doc__rdrjrrrrr]s r]c@r\)MediaDownloadProgresszStatus of a resumable download.cCr^)zConstructor. Args: resumable_progress: int, bytes received so far. total_size: int, total bytes in complete download. Nr_rbrrrrds zMediaDownloadProgress.__init__cCre)zPercent of download completed, as a float. Returns: the percentage complete as a float, returning 0.0 if the total size of the download is unknown. NrrfrgrirrrrjrkzMediaDownloadProgress.progressNrlrrrrrqs rqc@speZdZdZddZddZddZdd Zd d Zd d Z ddZ e ddddZ ddZeddZdS) MediaUploadaDescribes a media object to upload. Base class that defines the interface of MediaUpload subclasses. Note that subclasses of MediaUpload may allow you to control the chunksize when uploading a media object. It is important to keep the size of the chunk as large as possible to keep the upload efficient. Other factors may influence the size of the chunk you use, particularly if you are working in an environment where individual HTTP requests may have a hardcoded time limit, such as under certain classes of requests under Google App Engine. Streams are io.Base compatible objects that support seek(). Some MediaUpload subclasses support using streams directly to upload data. Support for streaming may be indicated by a MediaUpload sub-class and if appropriate for a platform that stream will be used for uploading the media object. The support for streaming is indicated by has_stream() returning True. The stream() method should return an io.Base object that supports seek(). On platforms where the underlying httplib module supports streaming, for example Python 2.6 and later, the stream will be passed into the http library which will result in less memory being used and possibly faster uploads. If you need to upload media that can't be uploaded using any of the existing MediaUpload sub-class then you can sub-class MediaUpload for your particular needs. cCtz[Chunk size for resumable uploads. Returns: Chunk size in bytes. NotImplementedErrorrirrr chunksize8zMediaUpload.chunksizecCdS)FMime type of the body. Returns: Mime type. application/octet-streamrrirrrmimetype@zMediaUpload.mimetypecCry)fSize of upload. Returns: Size of the body, or None of the size is unknown. NrrirrrsizeHr}zMediaUpload.sizecCry)iWhether this upload is resumable. Returns: True if resumable upload or False. Frrirrr resumablePr}zMediaUpload.resumablecCrs)aGet bytes from the media. Args: begin: int, offset from beginning of file. length: int, number of bytes to read, starting at begin. Returns: A string of bytes read. May be shorter than length if EOF was reached first. ru)rcbeginendrrrgetbytesXs zMediaUpload.getbytescCry),Does the underlying upload support a streaming interface. Streaming means it is an io.IOBase subclass that supports seek, i.e. seekable() returns True. Returns: True if the call to stream() will return an instance of a seekable io.Base subclass. Frrirrr has_streame zMediaUpload.has_streamcCrszA stream interface to the data being uploaded. Returns: The returned value is an io.IOBase subclass that supports seek, i.e. seekable() returns True. rurirrrstreamqzMediaUpload.streamr5NcCsJt|}t|j}|dur|D]}||=q|j|d<|j|d<t|S)a'Utility function for creating a JSON representation of a MediaUpload. Args: strip: array, An array of names of members to not include in the JSON. Returns: string, a JSON representation of this instance, suitable to pass to from_json(). N_class_module)typecopy__dict__rmrnr$dumps)rcstriptdmemberrrr_to_jsonzs    zMediaUpload._to_jsoncCs|S)zCreate a JSON representation of an instance of MediaUpload. Returns: string, a JSON representation of this instance, suitable to pass to from_json(). rrirrrto_jsonszMediaUpload.to_jsoncCsLt|}|d}t||dddd}t||d}t|d}||S)a+Utility class method to instantiate a MediaUpload subclass from a JSON representation produced by to_json(). Args: s: string, JSON from to_json(). Returns: An instance of the subclass of MediaUpload that was serialized with to_json(). r.N)fromlistr from_json)r$r% __import__splitgetattr)clssrmodulemklsrrrr new_from_jsons  zMediaUpload.new_from_jsonN)rmrnrorprwr|rrrrrutil positionalrr classmethodrrrrrrrs    rrcspeZdZdZededffdd ZddZdd Z d d Z d d Z ddZ ddZ ddZddZZS)MediaIoBaseUploadaA MediaUpload for a io.Base objects. Note that the Python file object is compatible with io.Base and can be used with this class also. fh = BytesIO('...Some data to upload...') media = MediaIoBaseUpload(fh, mimetype='image/png', chunksize=1024*1024, resumable=True) farm.animals().insert( id='cow', name='cow.png', media_body=media).execute() Depending on the platform you are working on, you may pass -1 as the chunksize, which indicates that the entire file should be uploaded in a single request. If the underlying platform supports streams, such as Python 2.6 or later, then this can be very efficient as it avoids multiple connections, and also avoids loading the entire file into memory before sending it. Note that Google App Engine has a 5MB limit on request size, so you should never set your chunksize larger than 5MB, or to -1. Fcs\tt|||_||_|dks|dkst||_||_|jdt j |j |_ dS)a;Constructor. Args: fd: io.Base or file object, The source of the bytes to upload. MUST be opened in blocking mode, do not use streams opened in non-blocking mode. The given stream must be seekable, that is, it must be able to call seek() on fd. mimetype: string, Mime-type of the file. chunksize: int, File will be uploaded in chunks of this many bytes. Only used if resumable=True. Pass in a value of -1 if the file is to be uploaded as a single chunk. Note that Google App Engine has a 5MB limit on request size, so you should never set your chunksize larger than 5MB, or to -1. resumable: bool, True if this is a resumable upload. False means upload in a single request. rrN) superrrd_fd _mimetyper _chunksize _resumableseekosSEEK_ENDtell_size)rcfdr|rwr __class__rrrdszMediaIoBaseUpload.__init__cC|jSrt)rrirrrrwrxzMediaIoBaseUpload.chunksizecCr)rz)rrirrrr|rxzMediaIoBaseUpload.mimetypecCr)r~)rrirrrrrxzMediaIoBaseUpload.sizecCr)r)rrirrrrrxzMediaIoBaseUpload.resumablecCs|j||j|S)aGet bytes from the media. Args: begin: int, offset from beginning of file. length: int, number of bytes to read, starting at begin. Returns: A string of bytes read. May be shorted than length if EOF was reached first. )rrread)rcrlengthrrrrs zMediaIoBaseUpload.getbytescCry)rTrrirrrrrzMediaIoBaseUpload.has_streamcCrr)rrirrrrrzMediaIoBaseUpload.streamcCstd)z%This upload type is not serializable.z&MediaIoBaseUpload is not serializable.rurirrrr#zMediaIoBaseUpload.to_json)rmrnrorprrDEFAULT_CHUNK_SIZErdrwr|rrrrrr __classcell__rrrrrs  rcsNeZdZdZeddedffdd ZddZd d Z e d d Z Z S) MediaFileUploadaA MediaUpload for a file. Construct a MediaFileUpload and pass as the media_body parameter of the method. For example, if we had a service that allowed uploading images: media = MediaFileUpload('cow.png', mimetype='image/png', chunksize=1024*1024, resumable=True) farm.animals().insert( id='cow', name='cow.png', media_body=media).execute() Depending on the platform you are working on, you may pass -1 as the chunksize, which indicates that the entire file should be uploaded in a single request. If the underlying platform supports streams, such as Python 2.6 or later, then this can be very efficient as it avoids multiple connections, and also avoids loading the entire file into memory before sending it. Note that Google App Engine has a 5MB limit on request size, so you should never set your chunksize larger than 5MB, or to -1. r6NFcsZd|_||_t|jd|_|durt|\}}|durd}tt|j|j|||ddS)aConstructor. Args: filename: string, Name of the file. mimetype: string, Mime-type of the file. If None then a mime-type will be guessed from the file extension. chunksize: int, File will be uploaded in chunks of this many bytes. Only used if resumable=True. Pass in a value of -1 if the file is to be uploaded in a single chunk. Note that Google App Engine has a 5MB limit on request size, so you should never set your chunksize larger than 5MB, or to -1. resumable: bool, True if this is a resumable upload. False means upload in a single request. Nrbr{rwr)r _filenameopen mimetypes guess_typerrrd)rcfilenamer|rwr_rrrrd>s   zMediaFileUpload.__init__cCs|jr |jdSdSr)rcloserirrr__del__]szMediaFileUpload.__del__cCs|jdgdS)zCreating a JSON representation of an instance of MediaFileUpload. Returns: string, a JSON representation of this instance, suitable to pass to from_json(). r)rrrirrrraszMediaFileUpload.to_jsoncCs*t|}t|d|d|d|ddS)Nrrrr)r|rwr)r$r%r)rrrrrrjs zMediaFileUpload.from_json) rmrnrorprrrrdrr staticmethodrrrrrrr(s rcs2eZdZdZeddedffdd ZZS)MediaInMemoryUploadzMediaUpload for a chunk of bytes. DEPRECATED: Use MediaIoBaseUpload with either io.TextIOBase or io.StringIO for the stream. r6r{Fcs&t|}tt|j||||ddS)a&Create a new MediaInMemoryUpload. DEPRECATED: Use MediaIoBaseUpload with either io.TextIOBase or io.StringIO for the stream. Args: body: string, Bytes of body content. mimetype: string, Mime-type of the file or default of 'application/octet-stream'. chunksize: int, File will be uploaded in chunks of this many bytes. Only used if resumable=True. resumable: bool, True if this is a resumable upload. False means upload in a single request. rN)ioBytesIOrrrd)rcbodyr|rwrrrrrrd|s   zMediaInMemoryUpload.__init__) rmrnrorprrrrdrrrrrrusrc@s:eZdZdZedefddZedd ddZd S) MediaIoBaseDownloada "Download media resources. Note that the Python file object is compatible with io.Base and can be used with this class also. Example: request = farms.animals().get_media(id='cow') fh = io.FileIO('cow.png', mode='wb') downloader = MediaIoBaseDownload(fh, request, chunksize=1024*1024) done = False while done is False: status, done = downloader.next_chunk() if status: print "Download %d%%." % int(status.progress() * 100) print "Download Complete!" rcCsp||_||_|j|_||_d|_d|_d|_tj |_ t j |_ i|_ |jD]\}}|dvr5||j |<q&dS)aBConstructor. Args: fd: io.Base or file object, The stream in which to write the downloaded bytes. request: googleapiclient.http.HttpRequest, the media request to perform in chunks. chunksize: int, File will be downloaded in chunks of this many bytes. rNF)acceptzaccept-encoding user-agent)r_requestrN_urir _progress _total_size_donetimerL_sleeprandom_rand_headersheadersitemslower)rcrr>rwkvrrrrds   zMediaIoBaseDownload.__init__r5rc Csl|j}d|j|j|jdf|d<|jj}t||d|j|j|j d|d\}}|j dvrd|vr>|d|j kr>|d|_ |jt |7_|j |d |vrc|d }|d dd}t||_n d |vrnt|d |_|jd usy|j|jkr|d |_t|j|j|jfS|j dkr|d }|d dd}t||_|jdkrd |_t|j|j|jfSt|||j d)aGet the next chunk of the download. Args: num_retries: Integer, number of times to retry with randomized exponential backoff. If all retries fail, the raised HttpError represents the last request. If zero (default), we attempt the request only once. Returns: (status, done): (MediaDownloadProgress, boolean) The value of 'done' will be True when the media has been fully downloaded or the total size of the media is unknown. Raises: googleapiclient.errors.HttpError if the response was not a 2xx. httplib2.HttpLib2Error if a transport error has occurred. z bytes=%d-%dr5r=zmedia downloadGETr)zcontent-locationz content-range/content-lengthNTirrN)rrrrrrIr[rrrrr+rwritersplitintrrrqr )rcrJrrIrRr2 content_rangerrrr next_chunksP          zMediaIoBaseDownload.next_chunkN)r) rmrnrorprrrrdrrrrrrs rc@s"eZdZdZddZdddZdS) _StreamSliceaTruncated stream. Takes a stream and presents a stream that is a slice of the original stream. This is used when uploading media in chunks. In later versions of Python a stream can be passed to httplib in place of the string of data to send. The problem is that httplib just blindly reads to the end of the stream. This wrapper presents a virtual stream that only reads to the end of the chunk. cCs"||_||_||_|j|dS)zConstructor. Args: stream: (io.Base, file object), the stream to wrap. begin: int, the seek position the chunk begins at. chunksize: int, the size of the chunk. N)_stream_beginrr)rcrrrwrrrrdsz_StreamSlice.__init__rcCs>|j}|j|j}|dks|||kr||}|j|S)zRead n bytes. Args: n, int, the number of bytes to read. Returns: A string of length 'n', or less if EOF is reached. r)rrrrr)rcncurrrrrr&s  z_StreamSlice.readN)r)rmrnrorprdrrrrrrs  rc@seZdZdZed     dddZeddd d Zed d d ZeddddZ ddZ ddZ e ddZ e ddZdS) HttpRequestz#Encapsulates a single HTTP request.rNc Csp||_||_||_|p i|_||_||_||_||_g|_d|_ t |jp%d|_ d|_ d|_ tj|_tj|_dS)aConstructor for an HttpRequest. Args: http: httplib2.Http, the transport object to use to make a request postproc: callable, called on the HTTP response and content to transform it into a data object before returning, or raising an exception on an error. uri: string, the absolute URI to send the request to method: string, the HTTP method to use body: string, the request body of the HTTP request, headers: dict, the HTTP request headers methodId: string, a unique identifier for the API method being called. resumable: MediaUpload, None if this is not a resumbale request. FrNr)rNrOrrmethodIdrIpostprocrresponse_callbacks_in_error_stater+ body_size resumable_urir`rrrrLr) rcrIrrNrOrrrrrrrrd:s  zHttpRequest.__init__r5rc CsB|dur|j}|jrd}|dur|j||d\}}|dus|Sd|jvr,t|j|jd<t|jtkrk|j dkrkd|_ d|jd<d|jd<t j |j}t j |j|j|j|jddf|_|j|_tt|j|jd<t||d |j|jt|jt|j |j|jd \}}|jD]}||q|jd krt|||jd |||S) aExecute the request. Args: http: httplib2.Http, an http object to be used in place of the one the HttpRequest request object was constructed with. num_retries: Integer, number of times to retry with randomized exponential backoff. If all retries fail, the raised HttpError represents the last request. If zero (default), we attempt the request only once. Returns: A deserialized object model of the response body as determined by the postproc. Raises: googleapiclient.errors.HttpError if the response was not a 2xx. httplib2.HttpLib2Error if a transport error has occurred. N)rIrJrrPOSTx-http-method-overridez!application/x-www-form-urlencoded content-typer>rOrr,r)rIrrrstrrr+rNMAX_URI_LENGTHrOurllibparseurlparse urlunparseschemenetlocpathparamsqueryrr[rrrrr r) rcrIrJrrparsedrRr2callbackrrrexecutelsH      zHttpRequest.executer6cCs|j|dS)zadd_response_headers_callback Args: cb: Callback to be called on receiving the response headers, of signature: def cb(resp): # Where resp is an instance of httplib2.Response N)rappend)rccbrrradd_response_callbacks z!HttpRequest.add_response_callbackc Cs|dur|j}|jdurd}nt|j}|jdurat|j}|j|d<|dkr2||d<t|j|d<t ||d|j |j |j |j |j|d \}}|jdkr\d |vr\|d |_n(t|||jrd |d d }|j|jd |d\}}|||\}} | r|| fS|jr|j} |jdkr| |j|j|jd} nCt| |j|j} t|j|jd|jd} n&|j|j|j} t| |jkrt|jt| }|jt| d} dt| |jdi}| dkrd|j| |f|d<t|dD]@} | dkr)| | d| td| |j |j |jfz|j|jd | |d\}}Wnd|_t |j|sHnq |||S)aExecute the next step of a resumable upload. Can only be used if the method being executed supports media uploads and the MediaUpload object passed in was flagged as using resumable upload. Example: media = MediaFileUpload('cow.png', mimetype='image/png', chunksize=1000, resumable=True) request = farm.animals().insert( id='cow', name='cow.png', media_body=media) response = None while response is None: status, response = request.next_chunk() if status: print "Upload %d%% complete." % int(status.progress() * 100) Args: http: httplib2.Http, an http object to be used in place of the one the HttpRequest request object was constructed with. num_retries: Integer, number of times to retry with randomized exponential backoff. If all retries fail, the raised HttpError represents the last request. If zero (default), we attempt the request only once. Returns: (status, body): (ResumableMediaStatus, object) The body will be None until the resumable media is fully uploaded. Raises: googleapiclient.errors.HttpError if the response was not a 2xx. httplib2.HttpLib2Error if a transport error has occurred. N*zX-Upload-Content-TypezX-Upload-Content-Lengthrzresumable URI requestrrlocationz bytes */%s0) Content-RangerPUTrrr5zContent-Lengthzbytes %d-%d/%srrr6z7Retry #%d for media upload: %s %s, following status: %dT)!rIrrrrrrr|rr[rrrNrOrrr rr>_process_responserrrwrr`rminrr+r=r/r0r4) rcrIrJr start_headersrRr2rrrr chunk_endrTrrrrs'               zHttpRequest.next_chunkcCs|jdvrd|_d|||fS|jdkr?d|_zt|dddd|_Wn ty4d|_Ynwd |vr>|d |_n d |_t|||j d t |j|j dfS) aProcess the response from a single chunk upload. Args: resp: httplib2.Response, the response object. content: string, the content of the response. Returns: (status, body): (ResumableMediaStatus, object) The body will be None until the resumable media is fully uploaded. Raises: googleapiclient.errors.HttpError if the response was not a 2xx or a 308. )rFN4r=-r5rrTr) rrrrrr`r.rr rNr]rr)rcrRr2rrrrGs$      zHttpRequest._process_responsecCsHt|j}|ddur|j|d<|d=|d=|d=|d=t|S)z1Returns a JSON representation of the HttpRequest.rNrIrrr)rrrrr$r)rcrrrrrks   zHttpRequest.to_jsonc CsXt|}|ddurt|d|d<t|||d|d|d|d|d|ddS) z>Returns an HttpRequest populated with info from a JSON object.rNrNrOrrr)rNrOrrrr)r$r%rrrr)rrIrrrrrrws  zHttpRequest.from_jsoncCs||fSrr)rRcontentsrrr null_postprocrzHttpRequest.null_postprocrNNNN)Nr)rmrnrorprrrdr rrrrrrrrrrrr7s, 1 @  $ rc@seZdZdZeddddZddZdd Zd d Z d d Z ddZ ddZ eddddZ ddZeddddZdS)BatchHttpRequestaBatches multiple HttpRequest objects into a single HTTP request. Example: from googleapiclient.http import BatchHttpRequest def list_animals(request_id, response, exception): """Do something with the animals list response.""" if exception is not None: # Do something with the exception. pass else: # Do something with the response. pass def list_farmers(request_id, response, exception): """Do something with the farmers list response.""" if exception is not None: # Do something with the exception. pass else: # Do something with the response. pass service = build('farm', 'v2') batch = BatchHttpRequest() batch.add(service.animals().list(), list_animals) batch.add(service.farmers().list(), list_farmers) batch.execute(http=http) r5NcCsZ|durt}|tkrtdt||_||_i|_i|_g|_d|_d|_ i|_ i|_ dS)aConstructor for a BatchHttpRequest. Args: callback: callable, A callback to be called for each response, of the form callback(id, response, exception). The first parameter is the request id, and the second is the deserialized response object. The third is an googleapiclient.errors.HttpError exception object if an HTTP error occurred while processing the request, or None if no error occurred. batch_uri: string, URI to send batch requests to. NaYou have constructed a BatchHttpRequest using the legacy batch endpoint %s. This endpoint will be turned down on August 12, 2020. Please provide the API-specific endpoint or use service.new_batch_http_request(). For more details see https://developers.googleblog.com/2018/03/discontinuing-support-for-json-rpc-and.htmland https://developers.google.com/api-client-library/python/guide/batch.r) _LEGACY_BATCH_URIr/r0 _batch_uri _callback _requests _callbacks_order _last_auto_id_base_id _responses_refreshed_credentials)rcr  batch_urirrrrds    zBatchHttpRequest.__init__cCsd}d}|jdurt|j}d}|dur|durt|}|dur5t||jvr5t|d|jt|<|jdus<|sEt||jdSdS)zRefresh the credentials and apply to the request. Args: request: HttpRequest, the request. http: httplib2.Http, the global http object for the batch. NFTr5)rIrget_credentials_from_httpidr(refresh_credentialsapply_credentialsr)rcr>rIcredsrequest_credentialsrrr_refresh_and_apply_credentialss     z/BatchHttpRequest._refresh_and_apply_credentialscCs*|jdur t|_d|jtj|fS)aAConvert an id to a Content-ID header value. Args: id_: string, identifier of individual request. Returns: A Content-ID header with the id_ encoded into it. A UUID is prepended to the value because Content-ID headers are supposed to be universally unique. Nz <%s + %s>)r&uuiduuid4rrquote)rcid_rrr _id_to_headers zBatchHttpRequest._id_to_headercCs\|ddks |ddkrtd|d|vrtd||dddd\}}tj|S) abConvert a Content-ID header value to an id. Presumes the Content-ID header conforms to the format that _id_to_header() returns. Args: header: string, Content-ID header value. Returns: The extracted id value. Raises: BatchError if the header is not in the expected format. rz Invalid value for Content-ID: %s+r5z + )r rrrunquote)rcheaderbaser4rrr _header_to_ids    zBatchHttpRequest._header_to_idcCs*tj|j}tjdd|j|j|jdf}|jd|d}|j dd d\}}t ||}|j }|jdurJt|j} | durJt| |d|vrQ|d=|D]\} } | || <qU|j|d<|d|jdur|||jtt|j|d <t} t| d d } | j|d d | }||S)zConvert an HttpRequest object into a string. Args: request: HttpRequest, the request to serialize. Returns: The request as a string in application/http format. r z HTTP/1.1 rzapplication/jsonrNHostrr) maxheaderlenFunixfrom)rrrrNrrrrrOrrFrrrrIrr*r-rr set_unixfromr set_payloadrr+rStringIOrflattengetvalue)rcr>r  request_line status_linemajorminormsgr credentialskeyvaluefpgrrrr_serialize_request)s8            z#BatchHttpRequest._serialize_requestc Cs|dd\}}|dd\}}}t}|||}||d<t|}||_t|ddddd|_ |d dd} || fS) zConvert string into httplib2 response and content. Args: payload: string, headers and body as a string. Returns: A pair (resp, content), such as would be returned from httplib2.request.  r5r=r6rrrrz ) rrfeedrrGResponserrreplaceversion) rcpayloadrHprotocolrrparserrKrRr2rrr_deserialize_responseYs   z&BatchHttpRequest._deserialize_responsecCsF|jd7_t|j|jvr|jd7_t|j|jvst|jS)zCreate a new id. Auto incrementing number that avoids conflicts with ids already used. Returns: string, a new unique id. r5)r%rr"rirrr_new_idus  zBatchHttpRequest._new_idr6cCsvt|jtkr tdt|dur|}|jdurtd||jvr)td|||j|<||j|<|j |dS)a9Add a new request. Every callback added will be paired with a unique id, the request_id. That unique id will be passed back to the callback when the response comes back from the server. The default behavior is to have the library generate it's own unique id. If the caller passes in a request_id then they must ensure uniqueness for each request_id, and if they are not an exception is raised. Callers should either supply all request_ids or never supply a request id, to avoid such an error. Args: request: HttpRequest, Request to add to the batch. callback: callable, A callback to be called for this response, of the form callback(id, response, exception). The first parameter is the request id, and the second is the deserialized response object. The third is an googleapiclient.errors.HttpError exception object if an HTTP error occurred while processing the request, or None if no errors occurred. request_id: string, A unique id for the request. The id will be passed to the callback with the response. Returns: None Raises: BatchError if a media request is added to a batch. KeyError is the request_id is not unique. z9Exceeded the maximum calls(%d) in a single batch request.Nz1Media requests cannot be used in a batch request.z)A request with this ID already exists: %s) r+r$MAX_BATCH_LIMITr r[rr"r.r#r )rcr>r  request_idrrradds     zBatchHttpRequest.addcCsxtd}t|ddd|D]%}||}tdd}d|d<|||d <||}||||qt} t | d d } | j |d d | }i} d | | d<|j |jd|| d\} } | jdkrlt| | |jdd| d}| d} || }t}|||}|std| | d|D]#}||d }||\}} t| tr| d} || f|j|<qdS)aSerialize batch request, send to server, process response. Args: http: httplib2.Http, an http object to be used to make the request with. order: list, list of request ids in the order they were added to the batch. requests: list, list of request objects to send. Raises: httplib2.HttpLib2Error if a transport error has occurred. googleapiclient.errors.BatchError if the response is the wrong format. mixed_write_headerscSdSrrrirrrsz+BatchHttpRequest._execute.. applicationrIbinaryzContent-Transfer-Encodingz Content-IDF) mangle_from_r@zmultipart/mixed; boundary="%s"rrrrrzcontent-type: %s rz'Response not in multipart/mixed format.)rRr2N)rsetattrrr5rQrCattachrrDrrErF get_boundaryr>r rr r&rrSr is_multipartr get_payloadr<rZr'rencoder')rcrIorderrequestsrr]r>rKrrOrPrrRr2r: for_parserrY mime_responsepartresponserrr_executesP              zBatchHttpRequest._executec Cst|jdkr dS|dur!|jD]}|j|}|dur |j}nq|dur)tdt|}|durAt|sAt dt || ||j|ji}g}|jD]#}|j |\}}|ddkrt| ||j|}||||||<qQ|r~| ||||jD]W}|j |\}}|j|}|j|} d} d} z|jdkrt|||jd|||} Wnty} z| } WYd} ~ nd} ~ ww| dur| || | |jdur||| | qdS) aExecute all the requests as a single batched HTTP request. Args: http: httplib2.Http, an http object to be used in place of the one the HttpRequest request object was constructed with. If one isn't supplied then use a http object from the requests in this batch. Returns: None Raises: httplib2.HttpLib2Error if a transport error has occurred. googleapiclient.errors.BatchError if the response is the wrong format. rNzMissing a valid http object.z1Attempting refresh to obtain initial access_tokenr401rr)r+r$r"rIr-rr*is_validr/infor,rrr'r r0r#rr rNrr!) rcrIr]r>r. redo_requests redo_orderrRr2r rqrSerrrr sb                 zBatchHttpRequest.executeNNr)rmrnrorprrrdr0r5r<rQrZr[r^rrr rrrrrs 20 ,Hrc@s"eZdZdZddZdddZdS)HttpRequestMockzYMock of HttpRequest. Do not construct directly, instead use RequestMockBuilder. cCsL||_||_||_|durtddd|_d|jvr$|jd|j_dSdS)aYConstructor for HttpRequestMock Args: resp: httplib2.Response, the response to emulate coming from the request content: string, the response body postproc: callable, the post processing function usually supplied by the model class. See model.JsonModel.response() as an example. NrOK)rrr)rRr2rrGrTr)rcrRr2rrrrrdOs  zHttpRequestMock.__init__NcCs||j|jS)zExecute the request. Same behavior as HttpRequest.execute(), but the response is mocked and not really from an HTTP request/response. )rrRr2)rcrIrrrr `szHttpRequestMock.executer)rmrnrorprdr rrrrrzIsrzc@s.eZdZdZd ddZ     d ddZdS) RequestMockBuilderaA simple mock of HttpRequest Pass in a dictionary to the constructor that maps request methodIds to tuples of (httplib2.Response, content, opt_expected_body) that should be returned when that method is called. None may also be passed in for the httplib2.Response, in which case a 200 OK response will be generated. If an opt_expected_body (str or dict) is provided, it will be compared to the body and UnexpectedBodyError will be raised on inequality. Example: response = '{"data": {"id": "tag:google.c...' requestBuilder = RequestMockBuilder( { 'plus.activities.get': (None, response), } ) googleapiclient.discovery.build("plus", "v1", requestBuilder=requestBuilder) Methods that you do not supply a response for will return a 200 OK with an empty string as the response content or raise an excpetion if check_unexpected is set to True. The methodId is taken from the rpcName in the discovery document. For more details see the project wiki. FcCr^)aConstructor for RequestMockBuilder The constructed object should be a callable object that can replace the class HttpResponse. responses - A dictionary that maps methodIds into tuples of (httplib2.Response, content). The methodId comes from the 'rpcName' field in the discovery document. check_unexpected - A boolean setting whether or not UnexpectedMethodError should be raised on unsupplied method. N) responsescheck_unexpected)rcr}r~rrrrds zRequestMockBuilder.__init__rNc Cs||jvrG|j|} | dd\} } t| dkrA| d} t| t|kr)t| |t| tr3t| } t|}|| krAt| |t| | |S|j rOt |dt d} tdd| j S)aImplements the callable interface that discovery.build() expects of requestBuilder, which is to build an object compatible with HttpRequest.execute(). See that method for the description of the parameters and the expected response. Nr6)rFz{}) r}r+boolr r'rr$r%rzr~rrrq)rcrIrrNrOrrrrrqrRr2 expected_bodymodelrrr__call__s"          zRequestMockBuilder.__call__)Fr)rmrnrorprdrrrrrr|is r|c@s6eZdZdZd ddZ     d ddZd d ZdS) HttpMockzMock of httplib2.HttpNcCsx|durddi}|r%t|d }||_Wdn1swYnd|_||_d|_d|_d|_d|_d|_dS)z Args: filename: string, absolute filename to read response from headers: dict, header to return with response Nr200r)rrrresponse_headersrrNrOr)rcrrfrrrrds   zHttpMock.__init__rr5cCs*||_||_||_||_t|j|jfSr)rNrOrrrGrTrr)rcrNrOrr redirectionsconnection_typerrrr>s  zHttpMock.requestcCrarrrirrrrszHttpMock.closeryrNNr5N)rmrnrorprdr>rrrrrrs  rc@s,eZdZdZddZ     d ddZdS) HttpMockSequenceaMock of httplib2.Http Mocks a sequence of calls to request returning different responses for each call. Create an instance initialized with the desired response headers and content and then use as if an httplib2.Http instance. http = HttpMockSequence([ ({'status': '401'}, ''), ({'status': '200'}, '{"access_token":"1/3w","expires_in":3600}'), ({'status': '200'}, 'echo_request_headers'), ]) resp, content = http.request("http://examples.com") There are special values you can pass in for content to trigger behavours that are helpful in testing. 'echo_request_headers' means return the request headers in the response body 'echo_request_headers_as_json' means return the request headers in the response body 'echo_request_body' means return the request body in the response body 'echo_request_uri' means return the request uri in the response body cCs||_d|_t|_dS)z\ Args: iterable: iterable, a sequence of pairs of (headers, body) TN) _iterablefollow_redirectsr*request_sequence)rciterablerrrrds zHttpMockSequence.__init__rNr5c Cs|j||||f|jd\}}t|tr|d}|dkr#|}n!|dkr-t|}n|dkr>t |dr;| }n |}n|dkrD|}t|trN|d}t ||fS)Nrrsecho_request_headerssecho_request_headers_as_jsonsecho_request_bodyrsecho_request_uri) rr rpopr'rrkr$rhasattrrrGrT) rcrNrOrrrrrRr2rrrr>s"        zHttpMockSequence.requestr)rmrnrorprdr>rrrrrs rcs,|jdddtjdffdd }||_|S)aSet the user-agent on every request. Args: http - An instance of httplib2.Http or something that acts like it. user_agent: string, the value for the user-agent header. Returns: A modified instance of http that was passed in. Example: h = httplib2.Http() h = set_user_agent(h, "my-app-name/6.0") Most of the time the user-agent will be set doing auth, this is for the rare cases where you are accessing an unauthenticated endpoint. rNcsR|duri}d|vrd|d|d<n|d<||||||d\}}||fS)1Modify the request headers to add the user-agent.Nrr=rOrrrrrrNrOrrrrrRr2 request_orig user_agentrr new_request;s  z#set_user_agent..new_requestr>rGDEFAULT_MAX_REDIRECTS)rIrrrrrset_user_agent%srcs*|jdddtjdffdd }||_|S)aTunnel PATCH requests over POST. Args: http - An instance of httplib2.Http or something that acts like it. Returns: A modified instance of http that was passed in. Example: h = httplib2.Http() h = tunnel_patch(h, "my-app-name/6.0") Useful if you are running on a platform that doesn't support PATCH. Apply this last if you are using OAuth 1.0, as changing the method will result in a different signature. rNcsZ|duri}|dkrd|ddvrtdd|d<d}||||||d \}}||fS) rNPATCH oauth_token authorizationrz;OAuth 1.0 request made with Credentials after tunnel_patch.rrr)rFr/r0rrrrrms$  z!tunnel_patch..new_requestr)rIrrrr tunnel_patchXsrcCsPtdur t}nt}tj|d}z |jdh|_W|Sty'Y|Sw)aBuilds httplib2.Http object Returns: A httplib2.Http object, which is used to make http requests, and which has timeout set by default. To override default timeout call socket.setdefaulttimeout(timeout_in_sec) before interacting with this method. N)rAr)r@getdefaulttimeoutDEFAULT_HTTP_TIMEOUT_SECrGHttpredirect_codesAttributeError) http_timeoutrIrrr build_https   r)Irp __future__r __author__r http.clientclientr"rr$loggingrrrr@rrr1rGssl ImportErrorobjectr?SSLErroremail.generatorremail.mime.multipartremail.mime.nonmultipartr email.parserrgoogleapiclientrrrgoogleapiclient.errorsr r r r r rgoogleapiclient.modelr getLoggerrmr/rrr\r!rrr4r[r]rqrrrrrrrrrrzr|rrrrrrrrrs|              FR|M#w(X? R*@3 5