|
Server : Apache System : Linux iad1-shared-b8-43 6.6.49-grsec-jammy+ #10 SMP Thu Sep 12 23:23:08 UTC 2024 x86_64 User : dh_edsupp ( 6597262) PHP Version : 8.2.26 Disable Function : NONE Directory : /lib/python3/dist-packages/s3transfer/__pycache__/ |
Upload File : |
o
�y�`Z4 � @ s� d dl Z d dlZd dlmZ d dlmZ d dlmZ d dlmZ d dlmZ d dlm Z d dlm
Z
d d lm Z G d
d � d e�Z G d d
� d
e�Z
G dd� de�ZdS )� N)�Task)�SubmissionTask)�CreateMultipartUploadTask)�CompleteMultipartUploadTask)�
get_callbacks)�calculate_range_parameter)�get_filtered_dict)�ChunksizeAdjusterc
@ sx e Zd ZdZdddddddd d
d � Zg d �Zg d
�Zd d
gZdd� Zdd� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zd S ) �CopySubmissionTaskz+Task for submitting tasks to execute a copy�IfMatch�IfModifiedSince� IfNoneMatch�IfUnmodifiedSince�SSECustomerKey�SSECustomerAlgorithm�SSECustomerKeyMD5� RequestPayer�ExpectedBucketOwner) �CopySourceIfMatch�CopySourceIfModifiedSince�CopySourceIfNoneMatch�CopySourceIfUnmodifiedSince�CopySourceSSECustomerKey� CopySourceSSECustomerAlgorithm�CopySourceSSECustomerKeyMD5r r ) r r r r r r r r r r r r ) r r r r r r r �MetadataDirective�TaggingDirectivec C s� |j jdu r9|j j}| �|j�}|j}|�� D ]\} }
| | jv r'|
|| j| < q|jj di |��} |j �
| d � |j j|j k rK| � |||||� dS | �
|||||� dS )a�
:param client: The client associated with the transfer manager
:type config: s3transfer.manager.TransferConfig
:param config: The transfer config associated with the transfer
manager
:type osutil: s3transfer.utils.OSUtil
:param osutil: The os utility associated to the transfer manager
:type request_executor: s3transfer.futures.BoundedExecutor
:param request_executor: The request executor associated with the
transfer manager
:type transfer_future: s3transfer.futures.TransferFuture
:param transfer_future: The transfer future associated with the
transfer request that tasks are being submitted for
N�
ContentLength� )�meta�size� call_args�)_get_head_object_request_from_copy_source� copy_source�
extra_args�items� EXTRA_ARGS_TO_HEAD_ARGS_MAPPING�
source_client� head_object�provide_transfer_size�multipart_threshold�_submit_copy_request�_submit_multipart_request) �self�client�config�osutil�request_executor�transfer_futurer! �head_object_requestr$ �param�value�responser r �3/usr/lib/python3/dist-packages/s3transfer/copies.py�_submitI s6 ��
���
��
�
�zCopySubmissionTask._submitc
C sL |j j}t|d�}| j�|t| j||j|j|j|j ||j j
d�dd�� d S )N�progress)r. r# �bucket�keyr$ � callbacksr T)�transfer_coordinator� main_kwargs�is_final) r r! r �_transfer_coordinator�submit�CopyObjectTaskr# r: r; r$ r )r- r. r/ r0 r1 r2 r! �progress_callbacksr r r7 r+ s"
� ��z'CopySubmissionTask._submit_copy_requestc C sj |j j}i }|j�� D ]
\}} || jvr| ||< q | j�|t| j||j|j |d�d��}
|j
} t � } | � | |j j
�} tt�|j j
t| � ��}
g }t|d�}td|
d �D ]?}| �|j�}t| |d |
|j j
�|d< | �| |d |
|j j
�}|�| j�|t| j||j|j|j ||||d�d|
id��� qU| �|j�}| j�|t| j||j|j |d�|
|d �d
d �� d S ) N)r. r: r; r$ )r= r> r9 � �CopySourceRange)r. r# r: r; � part_numberr$ r< r � upload_id)r= r> �pending_main_kwargs)rG �partsT)r= r> rH r? ) r r! r$ r% � CREATE_MULTIPART_ARGS_BLACKLISTr@ rA r r: r; �multipart_chunksizer �adjust_chunksizer �int�math�ceil�floatr �range�_extra_upload_part_argsr �_get_transfer_size�append� CopyPartTaskr# � _extra_complete_multipart_argsr )r- r. r/ r0 r1 r2 r! �create_multipart_extra_argsr4 �val�create_multipart_future� part_size�adjuster� num_parts� part_futuresrC rF �extra_part_argsr � complete_multipart_extra_argsr r r7 r, � s�
������
���� ���������z,CopySubmissionTask._submit_multipart_requestc C s( t |t�r
t�|�S td|t|�f ��)NzZExpecting dictionary formatted: {"Bucket": bucket_name, "Key": key} but got %s or type %s.)�
isinstance�dict�copy� TypeError�type)r- r# r r r7 r" � s
��z<CopySubmissionTask._get_head_object_request_from_copy_sourcec C � t || j�S �N)r �UPLOAD_PART_COPY_ARGS�r- r$ r r r7 rR s z*CopySubmissionTask._extra_upload_part_argsc C re rf )r �COMPLETE_MULTIPART_ARGSrh r r r7 rV s z1CopySubmissionTask._extra_complete_multipart_argsc C s ||d kr ||| S |S )NrD r )r- rZ �
part_indexr\ �total_transfer_sizer r r7 rS s z%CopySubmissionTask._get_transfer_sizeN)�__name__�
__module__� __qualname__�__doc__r& rg rJ ri r8 r+ r, r" rR rV rS r r r r7 r
s0 �
�6] r
c @ � e Zd ZdZdd� ZdS )rB z Task to do a nonmultipart copyc C s0 |j d|||d�|�� |D ]}||d� qdS )a�
:param client: The client to use when calling PutObject
:param copy_source: The CopySource parameter to use
:param bucket: The name of the bucket to copy to
:param key: The name of the key to copy to
:param extra_args: A dictionary of any extra arguments that may be
used in the upload.
:param callbacks: List of callbacks to call after copy
:param size: The size of the transfer. This value is passed into
the callbacks
)�
CopySource�Bucket�Key��bytes_transferredNr )� copy_object) r- r. r# r: r; r$ r< r �callbackr r r7 �_main s �� �zCopyObjectTask._mainN�rl rm rn ro rx r r r r7 rB � rB c @ rp )rU z)Task to upload a part in a multipart copyc
C sF |j d|||||d�|��}
|D ]} | | d� q|
d d } | |d�S )a�
:param client: The client to use when calling PutObject
:param copy_source: The CopySource parameter to use
:param bucket: The name of the bucket to upload to
:param key: The name of the key to upload to
:param upload_id: The id of the upload
:param part_number: The number representing the part of the multipart
upload
:param extra_args: A dictionary of any extra arguments that may be
used in the upload.
:param callbacks: List of callbacks to call after copy part
:param size: The size of the transfer. This value is passed into
the callbacks
:rtype: dict
:returns: A dictionary representing a part::
{'Etag': etag_value, 'PartNumber': part_number}
This value can be appended to a list to be used to complete
the multipart upload.
)rq rr rs �UploadId�
PartNumberrt �CopyPartResult�ETag)r~ r| Nr )�upload_part_copy)
r- r. r# r: r; rG rF r$ r< r r6 rw �etagr r r7 rx ) s ��
zCopyPartTask._mainNry r r r r7 rU ' rz rU )rb rN �s3transfer.tasksr r r r �s3transfer.utilsr r r r r
rB rU r r r r7 �<module> s x