|
Server : Apache System : Linux iad1-shared-b8-43 6.6.49-grsec-jammy+ #10 SMP Thu Sep 12 23:23:08 UTC 2024 x86_64 User : dh_edsupp ( 6597262) PHP Version : 8.2.26 Disable Function : NONE Directory : /lib/python3/dist-packages/duplicity/__pycache__/ |
Upload File : |
o
�0ka,X � @ s� d dl mZ d dl mZ d dl mZ d dl mZ d dlZd dlZd dlZd dlm Z d dlm
Z
d dlm Z d d lm Z d d
lm
Z
d d lmZ d d lmZ d d
lmZ d dlmZ d dlT d dlT G dd� de�Zdd� Zd7dd�Zd7dd�Zdd� Zdd � Zd d � Zd d � Z G d!d"� d"e�Z G d#d$� d$e �Z G d%d&� d&e�Z d'd(� Z!G d)d*� d*e�Z"d+d,� Z#d-d.� Z$d/d0� Z%d7d1d2�Z&d3d4� Z'G d5d6� d6e �Z(dS )8� )�map)�next)�object)�rangeN)�errors)�diffdir)�config)�librsync)�log)� selection)�tarfile)�tempdir)�util)�*c @ s e Zd ZdS )�PatchDirExceptionN)�__name__�
__module__� __qualname__� r r �4/usr/lib/python3/dist-packages/duplicity/patchdir.pyr . s r c C s( t �dd|�}t| |� |�� rJ �dS )z6Patch given base_path and file object containing delta� arbitrary�rN)r �TarFile�patch_diff_tarfile�close)� base_path�difftar_fileobj� diff_tarfiler r r �Patch2 s
r r c C s t |�}t| ||� dS )z8Patch given base_path and iterator of delta file objectsN)�TarFile_FromFileobjsr )r � fileobj_iter�restrict_indexr r r r �Patch_from_iter9 s r" c C s� | � � r t�| ��� }nt� }t|�}|rt||�}t�||�}t t
| g�}|D ]C\}}|rMt � t
d�t�|�� � t jjt�|�� �� ||j||� q(t � t
d�t�|�� � t jjt�|�� �� ||j||� q(|�� | �� dS )z�Patch given Path object using delta tarfile (as in tarfile.TarFile)
If restrict_index is set, ignore any deltas in diff_tarfile that
don't start with restrict_index.
z Patching %sN)�existsr �Select�set_iter�
empty_iter�difftar2path_iter�filter_path_iterr �
collate2iters�IterTreeReducer� PathPatcherr
�Info�_r �fsdecode�get_relative_path�InfoCode�patch_file_patching�escape�index�Finish�setdata) r r r! � path_iter�diff_path_iter�collated�ITR�
basis_path� diff_ropathr r r r ? s,
� � r c c s � d S �Nr r r r r r& ` s �r& c c sV � t |t�r|s J |��t|�}| D ]}|jd|� |kr(|j|d� |_|V qdS )z�Rewrite path elements of path_iter so they start with index
Discard any that doesn't start with index, and remove the index
prefix from the rest.
N)�
isinstance�tuple�lenr3 )r6 r3 �l�pathr r r r( e s ���r( c c s � t | �}d}zt|�g}W n
ty Y dS w |d s dS |r*|js*|�� qt|d �\}}}t|�}|�|d � ||_|dkrId|_ n |�
� ri|r_t | |||�}|� |� |V q|� | �
|d �� |V zt|�|d< W n
ty~ Y dS w q)z2Turn file-like difftarobj into iterator of ROPathsN� r �deleted)�iterr �
StopIteration�at_endr �get_index_from_tarinfo�ROPath�init_from_tarinfo�difftype�type�isreg�Multivol_Filelike�
setfileobj� extractfile)r �tar_iter�multivol_fileobj� tarinfo_listr3 rJ �multivol�ropathr r r r' t sH � �
�
��r' c C sD dD ]d}t �| �}tjjdkrt|t�r|�� }|�|�rf|t |�d� }|�d�rI|dkr1d}nd}d}t
� d d
|�\}}|dkrHt d | ��n|dd � }|t |�d� }|�
d
�rb|dd � }d} nqt d | ��|dksu|dkrxd}n%tjjdkr�tt �|��d��}nt|�d��}d|v r�t dt �|� ��|||fS )z;Return (index, difftype, multivol) pair from tarinfo object)z snapshot/zdiff/zdeleted/�multivol_diff/zmultivol_snapshot/� NrS rU �diff�snapshotrB z+(?s)^multivol_(diff|snapshot)/?(.*)/[0-9]+$z\2zUnrecognized diff entry %s����/r �.� r � � /s ..z/Tar entry %s contains '..'. Security violation)r �get_tarinfo_name�sys� version_info�majorr= �unicode�encode�
startswithr? �re�subnr �endswithr> �fsencode�splitr. )�tarinfo�prefix�tiname�namerJ rS �num_subsr3 r r r rG � sP
����
�� �
rG c @ s2 e Zd ZdZdd� Zd dd�Zdd� Zd d
� Zd S )
rM z�Emulate a file like object from multivols
Maintains a buffer about the size of a volume. When it is read()
to the end, pull in more volumes as desired.
c C s* ||| _ | _|| _|| _d| _d| _dS )z9Initializer. tf is TarFile obj, tarinfo is first tarinfo� r N)�tfrP rR r3 �bufferrF )�selfrq rP rR r3 r r r �__init__� s
zMultivol_Filelike.__init__rY c C s~ |dk r| � � r
| � � st| j�}nt| j�|k r&| � � s nt| j�|k stt| j�|�}| jd|� }| j|d� | _|S )zRead length bytes from filer N)� addtobufferr? rr �min)rs �length�real_len�resultr r r �read� s � �zMultivol_Filelike.readc C s� | j rdS t| jd �\}}}|r|| jkrd| _ dS | j�| jd �}| j|�� 7 _|�� z t | j
�| jd< W dS t yN d| jd< d| _ Y dS w )zAdd next chunk to bufferNr rB ) rF rG rR r3 rq rO rr rz r r rP rE )rs r3 rJ rS �fpr r r ru � s" �
�z Multivol_Filelike.addtobufferc C s$ | j s
d| _| �� s nqd| _ dS )z"If not at end, read remaining datarB rp N)rF rr ru �rs r r r r s �
zMultivol_Filelike.closeN)rY )r r r �__doc__rt rz ru r r r r r rM � s
rM c @ �8 e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
d � Zd S )
r+ z2Used by DirPatch, process the given basis and diffc C s || _ d| _dS �z#Set base_path, Path of root of treeN)r �dir_diff_ropath�rs r r r r rt
s
zPathPatcher.__init__c C s� |r|� � s|dksJ t�|���| �|||� dS |s-| j�|�}|�� r(J �|�� n |� � s9|�� |�� || _ || _
dS )z0Start processing when diff_ropath is a directoryr N) �isdirr �uindex� fast_processr � new_indexr# �mkdir�delete�dir_basis_pathr� �rs r3 r: r; r r r �
start_process s
zPathPatcher.start_processc C � | j r | j �| j� dS dS )z,Copy directory permissions when leaving treeN)r� � copy_attribsr� r| r r r � end_process# � �zPathPatcher.end_processc C s |o|� � S )z3No need to recurse if diff_ropath isn't a directory)r� r� r r r �can_fast_process( s z PathPatcher.can_fast_processc C s� |sdS |s|j dkr
dS |�| j�|�� dS |j dkr-|�� r'|�� dS |�� dS |�� r:|�� rN|j dkrN|�� rC|�� n|�� |�|� dS |j dksXJ |j ��|�|� dS )z#For use when neither is a directoryNrC rX rW ) rJ �copyr r� r� �deltreer� rL �patch_with_attribsr� r r r r� , s"
zPathPatcher.fast_processN� r r r r} rt r� r� r� r� r r r r r+ s r+ c @ r~ )
r z@Like a tarfile.TarFile iterator, but read from multiple fileobjsc C s || _ d\| _| _d| _dS )z�Make new tarinfo iterator
fileobj_iter should be an iterator of file objects opened for
reading. They will be closed at end of reading.
)NNN)r r rP �
current_fp)rs r r r r rt H s
z TarFile_FromFileobjs.__init__c C s | S r< r r| r r r �__iter__S s z TarFile_FromFileobjs.__iter__c C sV | j r
| j �� r
J � t| j�}t|tj�rq
|| _ t�d| j �| _ t
| j �| _ dS )z9Set tarfile from next file object, or raise StopIterationTr N) r� r r r r= r �BadVolumeExceptionr � make_tarfiler rD rP )rs �xr r r � set_tarfileV s
z TarFile_FromFileobjs.set_tarfilec C sh | j sz| �� W n
ty Y d S w zt| j�W S ty3 | j �� r(J �| �� t| j� Y S w r< )r r� rE r rP r r| r r r �__next__g s � �z TarFile_FromFileobjs.__next__c C s | j �|�S )z)Return data associated with given tarinfo)r rO )rs rk r r r rO t s z TarFile_FromFileobjs.extractfileN) r r r r} rt r� r� r� rO r r r r r F s
r c sj t ����dkrt��d �d �S dg� }|dd� }��fdd��dd� � � �fd d
�}|�||�S ) a� Collate iterators by index
Input is a list of n iterators each of which must iterate elements
with an index attribute. The elements must come out in increasing
order, and the index should be a tuple itself.
The output is an iterator which yields tuples where all elements
in the tuple have the same index, and the tuple has n elements in
it. If any iterator lacks an element with that index, the tuple
will have None in that spot.
rV r rB Nc s^ t ��D ](}| | s,|| du r,z
t� | �||< W q ty+ d| |< d||< Y qw qdS )z Set the overflow and rorps listNrB )r r rE )�overflow�elems�i)� iter_list�iter_numr r �setrorps� s ���z collate_iters.<locals>.setrorpsc S s t dd� dd� | D �D ��S )z;Return the first index in elems, assuming elems isn't emptyc S s g | ]}|j �qS r )r3 )�.0�elemr r r �
<listcomp>� s z8collate_iters.<locals>.getleastindex.<locals>.<listcomp>c S s g | ]}|r|�qS r r �r� r� r r r r� � � )rv )r� r r r �
getleastindex� s z$collate_iters.<locals>.getleastindexc 3 sx � �||� d |vr
d S � |�}g }t | �D ] }|| r0|| j|kr0|�|| � d ||< q|�d � qt|�V qr< )r r3 �appendr> )r� r� r� r3 �yieldvalr� )r� r� r r � yield_tuples� s �
�z#collate_iters.<locals>.yield_tuples)r? r r) )r� r� r� r� r )r� r� r� r� r �
collate_itersy s
r� c @ sh e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
d � Zd d
� Z dd� Z
dd� Z dd� Z dd� Z
dd� ZdS )� IndexedTuplez?Like a tuple, but has .index (used previously by collate_iters)c C s || _ t|�| _d S r< )r3 r> �data)rs r3 �sequencer r r rt � s zIndexedTuple.__init__c C s
t | j�S r< )r? r� r| r r r �__len__� s
zIndexedTuple.__len__c C s
| j | S )z4This only works for numerical keys (easier this way))r� )rs �keyr r r � __getitem__� s
zIndexedTuple.__getitem__c C � | � |�dkS �NrY ��__cmp__�rs �otherr r r �__lt__� � zIndexedTuple.__lt__c C � | � |�dkS �NrB r� r� r r r �__le__� r� zIndexedTuple.__le__c C s | � |� S r< )�__eq__r� r r r �__ne__� s zIndexedTuple.__ne__c C r� r� r� r� r r r �__gt__� r� zIndexedTuple.__gt__c C r� r� r� r� r r r �__ge__� r� zIndexedTuple.__ge__c C s2 t |t�sJ �| j|jk rdS | j|jkrdS dS )NrY r rB )r= r� r3 r� r r r r� � s zIndexedTuple.__cmp__c C s: t |t�r| j|jko| j|jkS t |t�r| j|kS d S r< )r= r� r3 r� r> r� r r r r� � s
zIndexedTuple.__eq__c C s dd� tt| j��| jf S )Nz(%s).%sz, )�joinr �strr� r3 r| r r r �__str__� s zIndexedTuple.__str__N)r r r r} rt r� r� r� r� r� r� r� r� r� r� r r r r r� � s r� c C sX g }t | �d }|dkr*| | }|dur"|�d|� |jdkr" |S |d8 }|dks |S )a$ Given an sequence of ROPath deltas, remove blank and unnecessary
The sequence is assumed to be in patch order (later patches apply
to earlier ones). A patch is unnecessary if a later one doesn't
require it (for instance, any patches before a "delete" are
unnecessary).
rB r NrW )r? �insertrJ )�patch_sequence� result_listr� �deltar r r � normalize_ps� s
��r� c C s� | d }|j dksJ d| ��|�� s%t| �dks!J dt| � ��|�� S |�d�}| dd� D ]>}|j dks<J |j ��zt�� W n" tjt �
� � � d�}t �
||� |�� r]J �|�d� |}Y t�||�d��}q0| d �� }|�|� |S )
z4Apply the patches in patch_seq, return single ropathr rW z%First patch in sequence %s was a diffrB z0Patch sequence isn't regular, but has %d entries�rbN)�dirrY )rJ rL r? �
get_ropath�open�cur_file�fileno�tempfile�
TemporaryFiler
�defaultr� r � copyfileobjr �seekr � PatchedFilerN )� patch_seq�first� current_file� delta_ropath�tempfpry r r r �patch_seq2ropath� s6 ��
�
r� c c s� � t | �}|D ]E}t|�}z
t|�}|�� r|V W q tyL } z&|d �� �� }t�t d�t
� |�t
� |�f tj
jt
�|�� W Y d}~qd}~ww dS )z�Combine a list of iterators of ropath patches
The iter_list should be sorted in patch order, and the elements in
each iter_list need to be orderd by index. The output will be an
iterator of the final ROPaths in index order.
rY zError '%s' patching %sN)r� r� r� r# � Exceptionr� r/ r
�Warnr- r �uexcr. � WarningCode�cannot_processr2 )r� r8 r� �
normalized� final_ropath�e�filenamer r r �integrate_patch_iters s( ��
�����r� c s, dd� | D �}� r� fdd�|D �}t |�S )z�Integrate tarfiles of diffs into single ROPath iter
Then filter out all the diffs in that index which don't start with
the restrict_index.
c S s g | ]}t |��qS r )r' r� r r r r� : r� z%tarfiles2rop_iter.<locals>.<listcomp>c s g | ]}t |� ��qS r )r( r� �r! r r r� = s )r� )� tarfile_listr! �
diff_itersr r� r �tarfiles2rop_iter3 s r� c C s> t t| g�}d}|D ]
}d}||j|� q
|�� | �� |S )zxWrite out ropaths in rop_iter starting at base_path
Returns 1 if something was actually written, 0 otherwise.
r rB )r* �ROPath_IterWriterr3 r4 r5 )r �rop_iterr9 �
return_valrT r r r �
Write_ROPathsA s r� c @ r~ )
r� z�Used in Write_ROPaths above
We need to use an ITR because we have to update the
permissions/times of directories after we write the files in them.
c C s || _ d| _d| _dS r )r r� � dir_new_pathr� r r r rt X s
zROPath_IterWriter.__init__c C s� |� � s%|jdksJ |j��| j�|�}|�� r%|�� r |�� |�|� | j�|�| _| j�� r=tj s=|dks<J |��n| j�
� || _ dS )z.Write ropath. Only handles the directory caser N) r� r3 r r� r# r� r� r� r �forcer� r� )rs r3 rT �new_pathr r r r� ^ s
z ROPath_IterWriter.start_processc C r� )z1Update information of a directory when leaving itN)r� r� r� r| r r r r� q r� z ROPath_IterWriter.end_processc C sH t �td�t�|�� �|jf t jjdt� |�� �|jf � |�
� S )z;Can fast process (no recursion) if ropath isn't a directoryzWriting %s of type %sz%s %s) r
r, r- r r. r/ rK r0 �patch_file_writingr2 r� �rs r3 rT r r r r� v s
��
z"ROPath_IterWriter.can_fast_processc C s" |� � r|�| j�|�� dS dS )z)Write non-directory ropath to destinationN)r# r� r r� r� r r r r� ~ s �z ROPath_IterWriter.fast_processNr� r r r r r� Q s r� )r ))�builtinsr r r r rf r` r� � duplicityr r r r r
r r r
r �duplicity.lazy�duplicity.pathr� r r r" r r& r( r' rG rM � ITRBranchr+ r r� r� r� r� r� r� r� r� r r r r �<module> sL
!+,@;351&