|
Server : Apache System : Linux iad1-shared-b8-43 6.6.49-grsec-jammy+ #10 SMP Thu Sep 12 23:23:08 UTC 2024 x86_64 User : dh_edsupp ( 6597262) PHP Version : 8.2.26 Disable Function : NONE Directory : /lib/python3/dist-packages/boto/glacier/__pycache__/ |
Upload File : |
o
ckF[�% � @ st d dl Z d dlmZmZmZ d dlmZ dZG dd� de�ZG dd� de�Z d d
� Z
efd d �Z G d
d� de�Z dS )� N)� chunk_hashes� tree_hash� bytes_to_hex)�compute_hashes_from_fileobji c @ s0 e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
S ) � _Partitionera� Convert variable-size writes into part-sized writes
Call write(data) with variable sized data as needed to write all data. Call
flush() after all data is written.
This instance will call send_fn(part_data) as needed in part_size pieces,
except for the final part which may be shorter than part_size. Make sure to
call flush() to ensure that a short final part results in a final send_fn
call.
c C s || _ || _g | _d| _d S �Nr )� part_size�send_fn�_buffer� _buffer_size)�selfr r � r
�5/usr/lib/python3/dist-packages/boto/glacier/writer.py�__init__1 s
z_Partitioner.__init__c C sR |dkrd S | j �|� | jt|�7 _| j| jkr'| �� | j| jksd S d S )N� )r
�appendr �lenr �
_send_part�r �datar
r
r �write7 s �z_Partitioner.writec C sf d� | j�}t|�| jkr || jd � g| _t| jd �| _ng | _d| _|d | j� }| �|� d S )Nr r )�joinr
r r r r )r r �partr
r
r r ? s z_Partitioner._send_partc C s | j dkr | �� d S d S r )r r �r r
r
r �flushM s
�z_Partitioner.flushN)�__name__�
__module__� __qualname__�__doc__r r r r r
r
r
r r % s r c @ s< e Zd ZdZefdd�Zdd� Zdd� Zdd � Zd
d � Z d S )
� _Uploaderz�Upload to a Glacier upload_id.
Call upload_part for each part (in any order) and then close to complete
the upload.
c C s4 || _ || _|| _|| _d | _d| _g | _d| _d S )Nr F)�vault� upload_idr �
chunk_size�
archive_id�_uploaded_size� _tree_hashes�closed�r r r! r r" r
r
r r Y s
z_Uploader.__init__c C s: t | j�}||kr| j�d g|| d � || j|< d S �N� )r r% �extend)r �index�
raw_tree_hash� list_lengthr
r
r �_insert_tree_hashe s
z_Uploader._insert_tree_hashc C s� | j rtd��tt|| j��}| �||� t|�}t�|�� � }| j
| }||t |� d f}| j j
�| j j| j||||�}|�� | jt |�7 _dS )z�Upload a part to Glacier.
:param part_index: part number where 0 is the first part
:param part_data: data to upload corresponding to this part
� I/O operation on closed filer) N)r& �
ValueErrorr r r" r. r �hashlib�sha256� hexdigestr r r �layer1� upload_part�namer! �readr$ ) r �
part_index� part_data�part_tree_hash�
hex_tree_hash� linear_hash�start�
content_range�responser
r
r r5 k s$
��z_Uploader.upload_partc C s, | j rtd��| �||� | j|7 _dS )a� Skip uploading of a part.
The final close call needs to calculate the tree hash and total size
of all uploaded data, so this is the mechanism for resume
functionality to provide it without actually uploading the data again.
:param part_index: part number where 0 is the first part
:param part_tree_hash: binary tree_hash of part being skipped
:param part_length: length of part being skipped
r/ N)r& r0 r. r$ )r r8 r: � part_lengthr
r
r � skip_part� s z_Uploader.skip_partc C sZ | j rd S d | jv rtd��tt| j��}| jj�| jj| j || j
�}|d | _ d| _ d S )Nz Some parts were not uploaded.� ArchiveIdT) r& r% � RuntimeErrorr r r r4 �complete_multipart_uploadr6 r! r$ r# )r r; r? r
r
r �close� s
�
z_Uploader.closeN)
r r r r �
_ONE_MEGABYTEr r. r5 rA rE r
r
r
r r R s r c c s2 � | � |�}|r|�d�V | � |�}|sd S d S )Nzutf-8)r7 �encode)�fobjr r r
r
r �generate_parts_from_fobj� s �
�rI c
C sv t | |||�}tt||��D ]%\}}tt||��} ||vs#|| | kr*|�||� q|�|| t|�� q|�� |j S )a� Resume upload of a file already part-uploaded to Glacier.
The resumption of an upload where the part-uploaded section is empty is a
valid degenerate case that this function can handle. In this case,
part_hash_map should be an empty dict.
:param vault: boto.glacier.vault.Vault object.
:param upload_id: existing Glacier upload id of upload being resumed.
:param part_size: part size of existing upload.
:param fobj: file object containing local data to resume. This must read
from the start of the entire upload, not just from the point being
resumed. Use fobj.seek(0) to achieve this if necessary.
:param part_hash_map: {part_index: part_tree_hash, ...} of data already
uploaded. Each supplied part_tree_hash will be verified and the part
re-uploaded if there is a mismatch.
:param chunk_size: chunk size of tree hash calculation. This must be
1 MiB for Amazon.
)
r � enumeraterI r r r5 rA r rE r# )
r r! r rH �
part_hash_mapr" �uploaderr8 r9 r: r
r
r �resume_file_upload� s � rM c @ sl e Zd ZdZefdd�Zdd� Zdd� Zdd � Zd
d � Z e
d d
� �Z e
dd� �Z e
dd� �Z
e
dd� �ZdS )�Writerz�
Presents a file-like object for writing to a Amazon Glacier
Archive. The data is written using the multi-part upload API.
c C s. t ||||�| _t|| j�| _d| _d| _d S )NFr )r rL r � _upload_part� partitionerr& �next_part_indexr' r
r
r r � s
zWriter.__init__c C s | j rtd��| j�|� d S )Nr/ )r& r0 rP r r r
r
r r � s z Writer.writec C s" | j �| j|� | jd7 _d S r( )rL r5 rQ )r r9 r
r
r rO � s zWriter._upload_partc C s( | j rd S | j�� | j�� d| _ d S )NT)r& rP r rL rE r r
r
r rE � s
z Writer.closec C s | � � | jjS �N)rE rL r# r r
r
r �get_archive_id� s zWriter.get_archive_idc C s t | jj�S )z�
Returns the current tree hash for the data that's been written
**so far**.
Only once the writing is complete is the final tree hash returned.
)r rL r% r r
r
r �current_tree_hash� s zWriter.current_tree_hashc C � | j jS )z�
Returns the current uploaded size for the data that's been written
**so far**.
Only once the writing is complete is the final uploaded size returned.
)rL r$ r r
r
r �current_uploaded_size� s z Writer.current_uploaded_sizec C rU rR )rL r! r r
r
r r! � zWriter.upload_idc C rU rR )rL r r r
r
r r rW z Writer.vaultN)r r r r rF r r rO rE rS �propertyrT rV r! r r
r
r
r rN � s
rN )
r1 �boto.glacier.utilsr r r r rF �objectr r rI rM rN r
r
r
r �<module> s -R
�"