U h٢@sddlZddlZddlZddlZddlZddlZddlZddlmZddl m Z m Z m Z m Z ddlmZddlmZmZmZz ddlZWnek rdZYnXejrddlmZd Zd ZdZGd d d eZGd ddeZGdddeZGdddZ dS)N)AES)utilshelperserrorshints) RequestIter)TLObjecttypes functions)TelegramClientiic@seZdZdddZdS) _CdnRedirectNcCs ||_dSN) cdn_redirect)selfrr=/tmp/pip-unpacked-wheel-c81u5j2r/telethon/client/downloads.py__init__ sz_CdnRedirect.__init__)N)__name__ __module__ __qualname__rrrrrrsrc@sJeZdZdddZddZddZdd Zd d Zd d Ze j Z e j Z dS)_DirectDownloadIterNc s@tjj|||d|_|j|_| |_| dk rTtjj| j||d|_|j | IdH|_||_ ||_ ||_ d|_ ||_d|_|o|jjj|k|_|js|jj|_nz|j|IdH|_Wntjk r:|tjIdH} | jD]>} | j|jjjkr|jj| j| j| j|jjq&q|jj|_d|_YnXdS)N)offsetlimitF) r uploadZGetFileRequestrequestclient_client _cdn_redirectZGetCdnFileRequest file_tokenZ_get_cdn_clienttotal_stride _chunk_size _last_part _msg_data _timed_outsessiondc_id _exported_sender_borrow_exported_senderrZDcIdInvalidErrorhelpZGetConfigRequestZ dc_options ip_addressserver_addressZset_dcidportsave) rfiler(rstride chunk_size request_size file_sizemsg_datarconfigoptionrrr_init%sD    z_DirectDownloadIter._initcs\|IdH}|j|t||jjkrFt|j|_|IdHn|jj|j 7_dSr) _requestbufferappendlenrrleftcloserr")rcurrrr_load_next_chunkKs   z$_DirectDownloadIter._load_next_chunkc sfz|j|j|jIdH}d|_t|tjjrH|j j j r@t dt |t|tjjr|j |j jtjj|jj|jdIdH|j|j|jIdH}|jWS|jWSWntjk r(}zX|jr|j jtdd|_|j jtdttIdH|IdHWYSd}~XYn:tjk r}zD|j jtd|j |j!IdH|_d|_"|IdHWYSd}~XYntj#tj$fk r`}z|j%rt|jj&tj'r|jj&j(dkr҂|j jtd |j%\}}|j j)||d IdH}t|j*tj+s|j*j,}|j-|jj&j-kr2|j.|jj&_.|IdHWYSd}~XYnXdS) NFzFileCdnRedirect but the GetCdnFileRequest API access for bot users is restricted. Try to change api_id to avoid FileCdnRedirect)r request_tokenz0Got two timeouts in a row while downloading fileTz1Got timeout while downloading file, retrying oncezFile lives in another DCz4File ref expired during download; refetching message)ids)/rZ_callr*rr& isinstancer rFileCdnRedirectrZ_mb_entity_cacheZself_bot ValueErrorrZCdnFileReuploadNeededr ZReuploadCdnFileRequestrr rCbytesrZ TimedOutError_logrwarninginfoasynciosleepTIMED_OUT_SLEEPr;ZFileMigrateErrorr+Znew_dcr)ZFilerefUpgradeNeededErrorZFileReferenceExpiredErrorr%locationInputDocumentFileLocation thumb_sizeZ get_messagesmediaMessageMediaDocumentdocumentr/file_reference)rresulteZchatZmsg_idmsgrUrrrr;TsT *$"   z_DirectDownloadIter._requestcsV|js dSz>|jr(|j|jIdHn|j|jjkrF|jIdHW5d|_XdSr)r*r)rZ_return_exported_senderZ disconnectrrrrr@sz_DirectDownloadIter.closecs|SrrrZrrr __aenter__sz_DirectDownloadIter.__aenter__cs|IdHdSr)r@)rargsrrr __aexit__sz_DirectDownloadIter.__aexit__)N)rrrr:rBr;r@r[r]rZ _sync_enter __enter__Z _sync_exit__exit__rrrrr$s & 6 rc@seZdZddZdS)_GenericDownloadItercs4d}|jj|jj}|jj}|jj|8_d}|st|||jkr|IdH}|jj|jj7_||7}t||jjk}q0||j_t|}t|t||jD]0}|j ||||j|jj|j7_q|rt|j |_ | IdHdSt|j d|jkr0|j |_|jj|j8_dS)NF)rrrr>r#r; memoryviewranger"r<r=r?r@poptobytesr$)rdatabadbeforedonerAZmemirrrrBs, z%_GenericDownloadIter._load_next_chunkN)rrrrBrrrrr`sr`c@seZdZd4dddddeejeddd Zd5ddd dd dd d ejejee fdddZ d6dddddddddde e d e e e eje d ddZ d7dddddddddddde e d e e e eejjeje d ddZddddeddddde e e e e e e d ddZddddeddddd dde e e e e e e eejjd d!d"Zed#d$Zdd%d&d'Zdd%d(d)Zed*d+Zd,d-Zed.d/Zed0d1Zed8d2d3ZdS)9DownloadMethodsNT) download_bigr zhints.EntityLikezhints.FileLike)rentityr2rmreturnc sd}d}t|tr|j|kr,||IdH}|r4dnd}g}|j|krL|}nVt|dst|dsddS|j|j|d|ddIdHSd D]} |t|| dq|j }t|t j t j fr|j } t jtj|d d |j|d } ndS|j|d d|d}z*|j| || dIdH} |tkr| n|WStjk r||IdH} t| }|tjjkr|tj| IdH}|j|jj|dd|dIdHYSYdSYnXdS)a Downloads the profile photo from the given user, chat or channel. Arguments entity (`entity`): From who the photo will be downloaded. .. note:: This method expects the full entity (which has the data to download the photo), not an input variant. It's possible that sometimes you can't fetch the entity from its input (since you can get errors like ``ChannelPrivateError``) but you already have it through another call, like getting a forwarded message from it. file (`str` | `file`, optional): The output file path, directory, or stream-like object. If the path exists and is a file, it will be overwritten. If file is the type `bytes`, it will be downloaded in-memory and returned as a bytestring (i.e. ``file=bytes``, without parentheses or quotes). download_big (`bool`, optional): Whether to use the big version of the available photos. Returns `None` if no photo was provided, or if it was Empty. On success the file path is returned since it may differ from the one given. Example .. code-block:: python # Download your own profile photo path = await client.download_profile_photo('me') print(path) )iwy-l]^ iaFl&4))l9lF?Li@Nrbrphoto chat_photo)datethumbprogress_callback)username first_nametitleF)Z check_hash)Zpeerphoto_idbigZ profile_photo.jpgpossible_names)r()rrrtrs) rFr ZSUBCLASS_OF_IDZ get_entityhasattr_download_photorqr=getattrrpr ZUserProfilePhotoZ ChatPhotor(ZInputPeerPhotoFileLocationrZget_input_peerrx_get_proper_filename download_filerIrZLocationInvalidErrorZget_input_entityrZ _entity_typeZ _EntityTypeZCHANNELr ZchannelsZGetFullChannelRequestZ full_chat)rrnr2rmZENTITIESZINPUTSrsr|rpattrr(locrWZietyfullrrrdownload_profile_photosf.        z&DownloadMethods.download_profile_photo)rsrtzhints.MessageLikez&typing.Union[int, types.TypePhotoSize]zhints.ProgressCallback)rmessager2rsrtrocsPd}t|tjr4|j}|j}|jr.|j|jfnd}ntj}|}t|t rVt |}t|tj rvt|j tjrv|j}t|tjrt|jtjr|jjp|jj}t|tjtjfr||||||IdHSt|tjtjfr|||||||IdHSt|tjr|dkr|||St|tjtjfrL|dkrL||||IdHSdS)av Downloads the given media from a message object. Note that if the download is too slow, you should consider installing ``cryptg`` (through ``pip install cryptg``) so that decrypting the received data is done in C instead of Python (much faster). See also `Message.download_media() `. Arguments message (`Message ` | :tl:`Media`): The media or message containing the media that will be downloaded. file (`str` | `file`, optional): The output file path, directory, or stream-like object. If the path exists and is a file, it will be overwritten. If file is the type `bytes`, it will be downloaded in-memory and returned as a bytestring (i.e. ``file=bytes``, without parentheses or quotes). progress_callback (`callable`, optional): A callback function accepting two parameters: ``(received bytes, total)``. thumb (`int` | :tl:`PhotoSize`, optional): Which thumbnail size from the document or photo to download, instead of downloading the document or photo itself. If it's specified but the file does not have a thumbnail, this method will return `None`. The parameter should be an integer index between ``0`` and ``len(sizes)``. ``0`` will download the smallest thumbnail, and ``len(sizes) - 1`` will download the largest thumbnail. You can also use negative indices, which work the same as they do in Python's `list`. You can also pass the :tl:`PhotoSize` instance to use. Alternatively, the thumb size type `str` may be used. In short, use ``thumb=0`` if you want the smallest thumbnail and ``thumb=-1`` if you want the largest thumbnail. .. note:: The largest thumbnail may be a video instead of a photo, as they are available since layer 116 and are bigger than any of the photos. Returns `None` if no media was provided, or if it was Empty. On success the file path is returned since it may differ from the one given. Example .. code-block:: python path = await client.download_media(message) await client.download_media(message, filename) # or path = await message.download_media() await message.download_media(filename) # Downloading to memory blob = await client.download_media(message, bytes) # Printing download progress def callback(current, total): print('Downloaded', current, 'out of', total, 'bytes: {:.2%}'.format(current / total)) await client.download_media(message, progress_callback=callback) N)rFr MessagerrrSZ input_chatr/datetimenowstrrZresolve_bot_file_idZMessageServiceactionZMessageActionChatEditPhotorpZMessageMediaWebPageZwebpageZWebPagerUMessageMediaPhotoPhotor~rTDocument_download_documentZMessageMediaContact_download_contactZ WebDocumentZWebDocumentNoProxy_download_web_document)rrr2rsrtr7rrrSrrrdownload_mediaIsZQ        zDownloadMethods.download_media part_size_kbr6rtr(keyivzhints.OutFileLike) rinput_locationr2rr6rtr(rrroc s |j||||||||dIdHS)a Low-level method to download files from their input location. .. note:: Generally, you should instead use `download_media`. This method is intended to be a bit more low-level. Arguments input_location (:tl:`InputFileLocation`): The file location from which the file will be downloaded. See `telethon.utils.get_input_location` source for a complete list of supported types. file (`str` | `file`, optional): The output file path, directory, or stream-like object. If the path exists and is a file, it will be overwritten. If the file path is `None` or `bytes`, then the result will be saved in memory and returned as `bytes`. part_size_kb (`int`, optional): Chunk size when downloading files. The larger, the less requests will be made (up to 512KB maximum). file_size (`int`, optional): The file size that is about to be downloaded, if known. Only used if ``progress_callback`` is specified. progress_callback (`callable`, optional): A callback function accepting two parameters: ``(downloaded bytes, total)``. Note that the ``total`` is the provided ``file_size``. dc_id (`int`, optional): The data center the library should connect to in order to download the file. You shouldn't worry about this. key ('bytes', optional): In case of an encrypted upload (secret chats) a key is supplied iv ('bytes', optional): In case of an encrypted upload (secret chats) an iv is supplied Example .. code-block:: python # Download a file and print its header data = await client.download_file(input_file, bytes) print(data[:16]) rN)_download_file) rrr2rr6rtr(rrrrrrs?zDownloadMethods.download_file)rr6rtr(rrr7r) rrr2rr6rtr(rrr7rrocs|s|sd}n t|}t|d} | tdkr8tdt|tjrPt| }|dkp^|t k} | rnt } n$t|trt |t|d} n|} z*z|j|| || | d2zf3dHW}|r|rt|||}| |}t|r|IdH|r|| |}t|r|IdHq6tt| ddr0| | rD| WW~SWnttk r}zT|jtd|j j!|j"||||||j j!|j j#|j j$| |j d IdHWYWSd}~XYnXW5t|ts| r| XdS) N@irz/The part size must be evenly divisible by 4096.wb)r5r(r7rflushz%FileCdnRedirect to CDN data center %s) rr2rr6rtr(rrr7r)%rZget_appropriated_part_sizeintMIN_CHUNK_SIZErHrFpathlibPathrabsoluterIioBytesIOrensure_parent_dir_existsopenr@_iter_downloadrZ decrypt_igewriteinspect isawaitabletellcallablerrgetvaluerrJrrLrr(rZencryption_keyZ encryption_iv)rrr2rr6rtr(rrr7rZ part_sizeZ in_memoryfchunkrrXrrrr sn             * zDownloadMethods._download_filerrr3rr4r5r6r( rr2rr3rr4r5r6r(c Cs|j||||||||dS)a Iterates over a file download, yielding chunks of the file. This method can be used to stream files in a more convenient way, since it offers more control (pausing, resuming, etc.) .. note:: Using a value for `offset` or `stride` which is not a multiple of the minimum allowed `request_size`, or if `chunk_size` is different from `request_size`, the library will need to do a bit more work to fetch the data in the way you intend it to. You normally shouldn't worry about this. Arguments file (`hints.FileLike`): The file of which contents you want to iterate over. offset (`int`, optional): The offset in bytes into the file from where the download should start. For example, if a file is 1024KB long and you just want the last 512KB, you would use ``offset=512 * 1024``. stride (`int`, optional): The stride of each chunk (how much the offset should advance between reading each chunk). This parameter should only be used for more advanced use cases. It must be bigger than or equal to the `chunk_size`. limit (`int`, optional): The limit for how many *chunks* will be yielded at most. chunk_size (`int`, optional): The maximum size of the chunks that will be yielded. Note that the last chunk may be less than this value. By default, it equals to `request_size`. request_size (`int`, optional): How many bytes will be requested to Telegram when more data is required. By default, as many bytes as possible are requested. If you would like to request data in smaller sizes, adjust this parameter. Note that values outside the valid range will be clamped, and the final value will also be a multiple of the minimum allowed size. file_size (`int`, optional): If the file size is known beforehand, you should set this parameter to said value. Depending on the type of the input file passed, this may be set automatically. dc_id (`int`, optional): The data center the library should connect to in order to download the file. You shouldn't worry about this. Yields `bytes` objects representing the chunks of the file if the right conditions are met, or `memoryview` objects instead. Example .. code-block:: python # Streaming `media` to an output file # After the iteration ends, the sender is cleaned up with open('photo.jpg', 'wb') as fd: async for chunk in client.iter_download(media): fd.write(chunk) # Fetching only the header of a file (32 bytes) # You should manually close the iterator in this case. # # "stream" is a common name for asynchronous generators, # and iter_download will yield `bytes` (chunks of the file). stream = client.iter_download(media, request_size=32) header = await stream.__anext__() # "manual" version of `async for` await stream.close() assert len(header) == 32 r)rrrrr iter_downloadXs_zDownloadMethods.iter_download) rr3rr4r5r6r(r7r) rr2rr3rr4r5r6r(r7rc Cs&t|} | jdk r| j}|dkr(| j}| j}|dkr:|}|dkrZ|dk rZ||d|}|dkrh|}n||krxtd||t8}|tkrt}n |tkrt}||kr|tdkr|tdkr|dks||dkrt} |j t  d|||nt } |j t  d|||| |||||||||| | d S)Nr zstride must be >= chunk_sizerz>Starting direct file download in chunks of %d at %d, stride %dz@Starting indirect file download in chunks of %d at %d, stride %d) r2r(rr3r4r5r6r7r) rZ_get_file_infor(sizerPrHrMAX_CHUNK_SIZErrJrrLr`) rr2rr3rr4r5r6r(r7rrLclsrrrrsj        zDownloadMethods._iter_downloadcs|sdSdd}tt||d}ttt|D]}t||tjr0||q0dkr`|dStt rr|Stt rt fdd|DdSttj tj tjtjfrSdSdS)NcSs~t|tjrdt|jfSt|tjr4dt|jfSt|tjrJd|jfSt|tjrddt |j fSt|tj rzd|jfSdS)Nr r)rr) rFr PhotoStrippedSizer>rIPhotoCachedSize PhotoSizerPhotoSizeProgressivemaxsizes VideoSizersrrr sort_thumbss       z/DownloadMethods._get_thumb..sort_thumbs)rrbc3s|]}|jkr|VqdSr)type).0trrr -s z-DownloadMethods._get_thumb..)listsortedreversedrdr>rFr Z PhotoPathSizererrnextrrrr)thumbsrsrrkrrr _get_thumbs&    zDownloadMethods._get_thumbrZc Csxt|tjrt|j}n|j}|tkr,|St|trLt|t |d}n|}z| |W5t|trr| X|S)Nr) rFr rrZstripped_photo_to_jpgrIrrrrr@r)rrr2rgrrrr_download_cached_photo_size4s      z+DownloadMethods._download_cached_photo_sizec st|tjr|j}t|tjs"dS||j|jp2g|}|rJt|tjrNdSt|tj rn|j |dd|d}n|j |dd|d}t|tj tj fr| ||St|tjrt|j}n|j}|jtj|j|j|j|jd|||dIdH}|tkr|S|S) z3Specialized version of .download_media() for photosNvideoz.mp4rrrprzr/ access_hashrVrR)r6rt)rFr rrprrrZ video_sizesPhotoSizeEmptyrrrrrrrrrZInputPhotoFileLocationr/rrVrrI) rrpr2rrrsrtrr6rWrrrr~Js6       zDownloadMethods._download_photocCsd}g}|D]}t|tjr,|d|jq t|tjr d}|jr`|jr`|d |j|jq |jrt||jq |jr||jq |j r d}q ||fS)z9Gets kind and possible names for :tl:`DocumentAttribute`.rUraudioz{} - {}voice) rFr ZDocumentAttributeFilenameinsert file_nameZDocumentAttributeAudioZ performerrwr=formatr) attributeskindr|rrrr_get_kind_and_namesqs&   z#DownloadMethods._get_kind_and_namesc st|tjr|j}t|tjs"dS|dkrZ||j\}}|j||t |||d}d} nR|j|dd|d}| |j |} | rt| tj rdSt| tj tjfr|| |S|jtj|j|j|j| r| jndd|| r| jn|j||dIdH} |tkr| S|S) z7Specialized version of .download_media() for documents.N)rrr|rprzrrDr)r6rtr7)rFr rTrUrrrrr get_extensionrrrrrrrrQr/rrVrrrI) rrUr2rrrsrtr7rr|rrWrrrrsB     z"DownloadMethods._download_documentcCs|j}|j}|j}|dd}|p$ddd}dj|||dd}|j|dd|||gd}|tkrh|St|d rv|nt |d }z| |W5||kr| X|S) zw Specialized version of .download_media() for contacts. Will make use of the vCard 4.0 format. ;rDz[BEGIN:VCARD VERSION:4.0 N:{f};{l};;; FN:{f} {l} TEL;TYPE=cell;VALUE=uri:tel:+{p} END:VCARD )rlpzutf-8contactz.vcardr{rr) rv last_name phone_numberreplacerencoderrIr}rr@r)rZ mm_contactr2rvrrrWrrrrrs6   z!DownloadMethods._download_contactc sts td||j\}}|j||t||d}|tkrFt }nt |drV|}n t |d}zpt 4IdHP}||j4IdH*}|jdIdH} | sq|| qW5QIdHRXW5QIdHRXW5||kr| X|tkr|S|S)zM Specialized version of .download_media() for web documents. z]Cannot download web documents without the aiohttp dependency install it (pip install aiohttp)r{rrNi)aiohttprHrrrrrrIrrr}rr@Z ClientSessiongeturlcontentreadrr) rZwebr2rtrr|rr'responserrrrrs4   0 z&DownloadMethods._download_web_documentc Csft|tjrt|}|dk r.t|ts.|S|dkr.z#{}_{}-{:02}-{:02}_{:02}-{:02}-{:02}r z {} ({}){})rFrrrrospathisfileisdirr StopIterationrrryearmonthdayhourminutesecondjoinsplitsplitext) r2r extensionrrr|name directoryextrWrkrrrrsP      z$DownloadMethods._get_proper_filename)N)N)N)N)NN) rrrbooltypingOptionalrrUnionrIrfloatrrtupler rrGrrrr staticmethodrrr~rr classmethodrrrrrrrrls u | M P n F +' ' & 'rl)!rrrrrrrMZcryptorrDrrrrZ requestiterrtlr r r r ImportError TYPE_CHECKINGZtelegramclientr rrrO Exceptionrrr`rlrrrrs.     |3