|
Server : Apache System : Linux iad1-shared-b8-43 6.6.49-grsec-jammy+ #10 SMP Thu Sep 12 23:23:08 UTC 2024 x86_64 User : dh_edsupp ( 6597262) PHP Version : 8.2.26 Disable Function : NONE Directory : /lib/python3/dist-packages/duplicity/__pycache__/ |
Upload File : |
o
��/a� � @ s2 d Z ddlmZ ddlmZ ddlmZ ddlmZ ddlmZ ddlZddlm Z dd lm
Z
dd
lm Z dd lm Z dd lm
Z
dd
lmZ ddlmZ dd lm Z ddlmZ ejdk rdeefZnefZG dd� de�ZG dd� de�ZG dd� de�ZG dd� de�ZG dd� de�ZG dd � d e�ZdS ) z6Classes and functions on collections of backup volumes� )�str)�zip)�map)�range)�objectN)�log)� file_naming)�path)�util)�dup_time)�config)�manifest)�GPGError)� c @ s e Zd ZdS )�CollectionsErrorN)�__name__�
__module__� __qualname__� r r �;/usr/lib/python3/dist-packages/duplicity/dup_collections.pyr 1 s r c @ s� e Zd ZdZdd� Zdd� Zd(dd�Zd d
� Zd d � Zd
d� Z dd� Z
dd� Z dd� Z d)dd�Z
dd� Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zd$d%� Zd&d'� ZdS )*� BackupSetzE
Backup set - the backup information produced by one session
c C sL || _ d| _i | _d| _d| _d| _d| _d| _d| _d| _ g | _
|| _ dS )zN
Initialize new backup set, only backend is required at first
FN) �backend�info_set�volume_name_dict�remote_manifest_name�local_manifest_path�time�
start_time�end_time�partial� encrypted�
files_changed�action)�selfr r" r r r �__init__9 s
zBackupSet.__init__c C � | j S )z8
Assume complete if found manifest file
)r �r# r r r � is_completeJ � zBackupSet.is_completeNc C s |st �|�}|r|jdks|jdksdS | js | �|� n2|j| jkr&dS |j| jkr.dS |j| jks:|j| jkr<dS t|j �t| j �krP| j
rP|j rP|j | _ |j rZ| � |� dS |j
dusaJ �|j
| jvs{J d|j
t�| j|j
�t�|�f ��|| j|j
< dS )a�
Add a filename to given set. Return true if it fits.
The filename will match the given set if it has the right
times and is of the right type. The information will be set
from the first filename given.
@param filename: name of file to add
@type filename: string
@param pr: pre-computed result of file_naming.parse(filename)
@type pr: Optional[ParseResults]
�full�incFNz�Volume %d is already in the volume list as "%s".
"%s" has the same volume number.
Please check your command line and retry.T)r �parse�typer �set_infor r r �boolr r r
� set_manifest�
volume_numberr r
�fsdecode�r# �filename�prr r r � add_filenameP s<
���� zBackupSet.add_filenamec C sP | j rJ �|j| _|j| _|j| _|j| _|j| _|j| _t|j�| _d| _ dS )z�
Set BackupSet information from ParseResults object
@param pr: parse results
@type pf: ParseResults
TN)r r, r r r r r. r )r# r4 r r r r- � s
zBackupSet.set_infoc C s | � � }|�� | _d S �N)� get_manifest�get_files_changedr! )r# �mfr r r �set_files_changed� s zBackupSet.set_files_changedc C s� | j r J d|| j f ��|| _ | jdkrtj�� }ng }|D ]2}t�|�}|rP|jrP|j| jkrP|j | j krP|j
| j
krP|j | j krPtj� |�| _
| �� dS q dS )zG
Add local and remote manifest filenames to backup set
z@Cannot set filename of remote manifest to %s; already set to %s.� replicateN)r r" r �archive_dir_path�listdirr r+ r
r, r r r �appendr r: )r# �remote_filename�local_filename_list�local_filenamer4 r r r r/ � s, ��
���zBackupSet.set_manifestc C s� | � � }|�� z| j�|� W n ty' t�td�dd� |D � � Y nw | jdkr3t j
� � }ng }|D ]=}t �
|�}|rt|j| jkrt|j| jkrt|j| jkrtz
t j
�|��� W q7 tys t�td�dd� |D � � Y q7w q7t�� dS )z@
Remove all files in set, both local and remote
z BackupSet.delete: missing %sc S � g | ]}t �|��qS r �r
r1 ��.0�fr r r �
<listcomp>� � z$BackupSet.delete.<locals>.<listcomp>r; c S rB r rC rD r r r rG � rH N)�
get_filenames�reverser �delete� Exceptionr �Debug�_r" r r< r= r r+ r r r r> r
�release_lockfile)r# �rfnr@ �lfnr4 r r r rK � s0 �
�� zBackupSet.deletec C s@ g }| j r |�| j � |�t| j�� �� dd�ttj |�� S )z0
For now just list files in set
z[%s]�, )
r r> �extend�listr �values�joinr r
r1 )r# �filelistr r r �__str__� s
zBackupSet.__str__c C s t �| jp| j�S )z@
Return time string suitable for log statements
)r � timetoprettyr r r& r r r � get_timestr� � zBackupSet.get_timestrTc C s� | j s| jst�td�tjj� | j sJ d��|r | �� nd}| jr&| �� }|r;| jr;|r;||kr;t�td�tjj � |sM| jrC|}n
t�td�tjj
� |� � dS )zA
Make sure remote manifest is equal to local one
z6Fatal Error: No manifests found for most recent backupz if only one, should be remoteNz�Fatal Error: Remote manifest does not match local one. Either the remote backup set or the local archive directory has been corrupted.z;Fatal Error: Neither remote nor local manifest is readable.) r r r �
FatalErrorrN � ErrorCode� no_manifests�get_remote_manifest�get_local_manifest�mismatched_manifests�unreadable_manifests�
check_dirinfo)r# � check_remote�remote_manifest�local_manifestr r r �check_manifests� s(
�
�
� zBackupSet.check_manifestsc C s@ | j sJ �| j �� }t�td�| j jt|�f � t�� � |�S )zG
Return manifest object by reading local manifest file
z!Processing local manifest %s (%s))
r �get_datar �InforN �name�lenr
�Manifest� from_string)r# �manifest_bufferr r r r` � s
�z BackupSet.get_local_manifestc
C s� | j sJ �z | j�| j �}W n% ty3 } zt�td�t�| j �t� |�f � W Y d}~dS d}~ww t�
td�t�| j �t |�f � t �
� �|�S )zG
Return manifest by reading remote manifest on backend
z)Error processing remote manifest (%s): %sNz"Processing remote manifest %s (%s))r r rh r r �ErrorrN r
r1 �uexcri rk r
rl rm )r# rn �messager r r r_ s
���
�z BackupSet.get_remote_manifestc C s | j r| �� S | �� S )zK
Return manifest object, showing preference for local copy
)r r` r_ r& r r r r7 s zBackupSet.get_manifestc s^ � j sJ �t� j�� �}|�� � fdd�|D �}� jr-t�� j�}|r-|js-|� � j� |S )zJ
Return sorted list of (remote) filenames of files in set
c s g | ]}� j | �qS r )r )rE �xr& r r rG rH z+BackupSet.get_filenames.<locals>.<listcomp>)
r rT r �keys�sortr r r+ r r> )r# �volume_num_list�volume_filenamesr4 r r& r rI s
zBackupSet.get_filenamesc C s | j r| j S | jr | jS J d��)zH
Return time if full backup, or end_time if incremental
r z'Neither self.time nor self.end_time set)r r r& r r r �get_time+ s
zBackupSet.get_timec C r% r6 )r! r& r r r r8 5 s zBackupSet.get_files_changedc C s t t| j�� ��S )z9
Return the number of volumes in the set
)rk rT r rs r& r r r �__len__8 r[ zBackupSet.__len__c C s@ | j |j ko | j|jko | j|jko | j|jko t| �t|�kS )zB
Return whether this backup set is equal to other
)r, r r r rk )r# �otherr r r �__eq__> s
�
�
��zBackupSet.__eq__r6 )T)r r r �__doc__r$ r' r5 r- r: r/ rK rX rZ rg r` r_ r7 rI rw r8 rx rz r r r r r 5 s(
1
r c @ st e Zd ZdZdd� Zdd� Zdd� Zd d d
�Zd d � Zd
d� Z dd� Z
dd� Z d dd�Z dd� Z
dd� Zdd� Zd S ) � BackupChainz�
BackupChain - a number of linked BackupSets
A BackupChain always starts with a full backup set and continues
with incremental ones.
c C s" || _ d| _g | _d\| _| _dS )zI
Initialize new chain, only backend is required at first
N�NN)r �fullset� incset_listr r )r# r r r r r$ P s zBackupChain.__init__c C s: | j st|t�s
J �|| _ |jsJ �|j|j| _| _dS )z%
Add full backup set
N)r~ �
isinstancer r r r )r# r~ r r r �set_fullY s
zBackupChain.set_fullc C s� | j |jkr
| j�|� n7| jr/|j| jd jkr/|j | jd j kr/t�td�� || jd< nt�td�t�|j�t�| j �f � dS |j | _ t�td�t�|j�t�|j �f � | j s`J �dS )zL
Add incset to self. Return False if incset does not match
���z'Preferring Backupset over previous one!z;Ignoring incremental Backupset (start_time: %s; needed: %s)Fz;Added incremental Backupset (start_time: %s / end_time: %s)T) r r r r> r ri rN r rY )r# �incsetr r r �add_incb s*
��
��
zBackupChain.add_incFc C sJ t t| j�d dd�D ] }| j| �� q | jr!|s#| j�� dS dS dS )z<
Delete all sets in chain, in reverse order
� r� N)r rk r rK r~ )r# � keep_full�ir r r rK z s
�zBackupChain.deletec s � fdd�| j D �}| jg| S )zI
Return a list of sets in chain earlier or equal to time
c s g | ] }|j � kr|�qS r �r �rE �s�r r r rG � � z0BackupChain.get_sets_at_time.<locals>.<listcomp>�r r~ )r# r �
older_incsetsr r� r �get_sets_at_time� s z BackupChain.get_sets_at_timec C s | j r| j d S | jS )z0
Return last BackupSet in chain
r� r� r& r r r �get_last� s
zBackupChain.get_lastc C r% )zF
Return first BackupSet in chain (ie the full backup)
)r~ r& r r r � get_first� r( zBackupChain.get_firstc C s dt �| j�t �| j�f S )zf
Return a short one-line description of the chain,
suitable for log messages.
z [%s]-[%s])r rY r r r& r r r �
short_desc� s
�zBackupChain.short_desc� c C sd g }| � � D ])}|jrd}|j}nd}|j}|jr d}nd}|�d||t�|�t|�|f � q|S )z>
Return summary, suitable for printing to log
r) r* �enc�noencz
%s%s %s %d %s)� get_all_setsr r r r> r � timetostringrk )r# �prefix�lr� �btyper r� r r r � to_log_info� s $zBackupChain.to_log_infoc
C s� d}dt d�t�| j� t d�t�| j� t d�t| j�d f t d�| �� f |t d�t d �t d
�f g}| �� D ]#}|j rGt d �}|j }nt d �}|j}|�
||t�|�t|�f � q:|�
d� d
� |�S )zD
Return string representation, for testing purposes
z%20s %30s %15s�-------------------------zChain start time: zChain end time: z#Number of contained backup sets: %dr� z%Total number of contained volumes: %d�Type of backup set:�Time:z Num volumes:�Full� Incremental�
) rN r rY r r rk r �get_num_volumesr� r r> rV )r# �
set_schemar� r� r� r r r r rX � s* ���
zBackupChain.__str__c C s" d}| � � D ]}|t|�7 }q|S )zA
Return the total number of volumes in the chain
r )r� rk )r# �nr� r r r r� � s zBackupChain.get_num_volumesc C s | j r
| j g| j S | jS )z9
Return list of all backup sets in chain
)r~ r r& r r r r� � s zBackupChain.get_all_setsN�F)r� )r r r r{ r$ r� r� rK r� r� r� r� r� rX r� r� r r r r r| I s
r| c @ sX e Zd ZdZdd� Zdd� Zdd� Zdd � Zdd d �Zdd
d�Z ddd�Z
ddd�Z d
S )�SignatureChainz~
A number of linked SignatureSets
Analog to BackupChain - start with a full-sig, and continue with
new-sigs.
c C s> |r
|d| _ | _nd|| _ | _d| _g | _d\| _| _dS )a�
Return new SignatureChain.
local should be true iff the signature chain resides in
config.archive_dir_path and false if the chain is in
config.backend.
@param local: True if sig chain in config.archive_dir_path
@type local: Boolean
@param location: Where the sig chain is located
@type location: config.archive_dir_path or config.backend
Nr} )r< r �fullsig�inclistr r )r# �local�locationr r r r$ � s zSignatureChain.__init__c C sL | j rtd�}ntd�}g }| jr|�| j� |�| j� d|d�|�f S )z>
Local or Remote and List of files in the set
r� �remotez%s: [%s]rR )r< rN r� r> rS r� rV )r# �placerW r r r rX � s
zSignatureChain.__str__c C s* |D ]}t |�tvrJ d||f ��qdS )z?
Check to make sure times are in whole seconds
r zTime %s in %s wrong typeN)r, �
integer_types)r# � time_listr r r r � check_times s
��zSignatureChain.check_timesc C s | j rdS dS )zQ
Return true if represents a signature chain in archive_dir_path
TF)r< r& r r r �islocal s zSignatureChain.islocalNc C s� |st �|�}|s dS | jr0|jdkrdS |j| jkr dS | j�|� | �|jg� |j| _dS |jdkr7dS || _| �|j |j g� |j |j | _| _dS )zM
Add new sig filename to current chain. Return true if fits
N�new-sigr� �full-sig)
r r+ r� r, r r r� r> r� r r2 r r r r5 s&
zSignatureChain.add_filenamec s> �j sJ ��jr�fdd�� n�jj� � fdd���|�D �S )zt
Return ordered list of signature fileobjs opened for reading,
optionally at a certain time
c s t �� jj| f�}|�d�S )z:Open filename in archive_dir_path, return filtered fileobj�rb)r �DupPathr< rj �
filtered_open)r3 �sig_dpr& r r �filename_to_fileobj> s
z8SignatureChain.get_fileobjs.<locals>.filename_to_fileobjc s g | ]}� |��qS r r rD )r� r r rG D � z/SignatureChain.get_fileobjs.<locals>.<listcomp>)r� r< r �get_fileobj_readrI )r# r r )r� r# r � get_fileobjs7 s
zSignatureChain.get_fileobjsFc C s� | j r+tt| j�d dd�D ]
}| j �| j| ��� q|s)| j �| j��� dS dS | js0J �| jdd� }|�� |sC|�| j� | j�|� dS )z3
Remove all files in signature set
r� r� N) r< r rk r� r> rK r� r rJ )r# r� r� � inclist_copyr r r rK F s �
zSignatureChain.deletec s> | j r| j g}ng }| j}� r� fdd�|D �}|�|� |S )zP
Return ordered list of filenames in set, up to a provided time
c s g | ] }t �|�j� kr|�qS r )r r+ r )rE r� r� r r rG c s z0SignatureChain.get_filenames.<locals>.<listcomp>)r� r� rS )r# r r� r� r r� r rI X s
z SignatureChain.get_filenamesr6 r� ) r r r r{ r$ rX r� r� r5 r� rK rI r r r r r� � s
r� c @ s� e Zd ZdZdd� Zdd� Zdd� Zd2d d
�Zd d � Zd
d� Z dd� Z
dd� Z d3dd�Z dd� Z
dd� Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zd$d%� Zd&d'� Zd(d)� Zd*d+� Zd,d-� Zd.d/� Zd0d1� ZdS )4�CollectionsStatusz:
Hold information about available chains and sets
c C sL || _ || _|| _d| _d| _d| _d| _g | _g | _d| _ d| _
d| _ dS )z7
Make new object. Does not set values
N) r r< r" �matched_chain_pair�all_backup_chains�other_backup_chains�all_sig_chains�local_orphaned_sig_names�remote_orphaned_sig_names�orphaned_backup_sets�incomplete_backup_sets�
values_set)r# r r< r" r r r r$ m s
zCollectionsStatus.__init__c C s� d| j jjf d| jf g}tt| j��D ]}|�d|f � || j| �d�7 }q| j r<|�d� || j d �d�7 }|�dt| j
�f � |�dt| j �f � |S ) zP
Return summary of the collection, suitable for printing to log
z
backend %szarchive-dir %szchain-no-sig %d� zchain-completer� zorphaned-sets-num %dzincomplete-sets-num %d) r � __class__r r< r rk r� r> r� r� r� r� �r# r� r� r r r r� � s
�
z CollectionsStatus.to_log_infoc C sh t d�dt d�| jjjf t d�| jr| jjndf g}|�dtddt| j ��t| j � � t
t| j ��D ]!}|�t d �|d
t| j �f � |�t | j | �� |�d � q6| j ro|�dt d � � |�t | j d
�� n|�t d
�� | j
s|| jr�|�tddt| j
��t| j
�f � |�tddt| j��t| j�f � |�t d�� n|�t d�� d�|�S )z9
Return string summary of the collection
zCollection Statusz-----------------zConnecting with backend: %szArchive dir: %s�Noner� z Found %d secondary backup chain.z!Found %d secondary backup chains.zSecondary chain %d of %d:r� r� z9Found primary backup chain with matching signature chain:z-No backup chains with active signatures foundz/Also found %d backup set not part of any chain,z0Also found %d backup sets not part of any chain,z and %d incomplete backup set.z and %d incomplete backup sets.zEThese may be deleted by running duplicity with the "cleanup" command.z,No orphaned or incomplete backup sets found.)rN r r� r r< �uc_namer> �ngettextrk r� r r r� r� r� rV r� r r r rX � sR
�����
� �
��
�
zCollectionsStatus.__str__r� c
C s d| _ | j�� }t�tddt|��t|� � | jdkr"| j� � }ng }t�tddt|��t|� � g }|D ]}t
� |�}|rH|j rH|�
|� q7| �|| �\}| _| _| �|�}|| _t|�t| j�ksjJ d��| �d�\}| _| jd |d
�\} | _| �|| |� | �|� | S ) a
Set values from archive_dir_path and backend.
Returns self for convenience. If sig_chain_warning is set to None,
do not warn about unnecessary sig chains. This is because there may
naturally be some unecessary ones after a full backup.
r� z%d file exists on backendz%d files exist on backendr; z%d file exists in cachez%d files exist in cachez7get_sorted_chains() did something more than re-orderingTF)rW )r� r rT r rM r� rk r" r< r= r r+ r r> �get_backup_chainsr� r� �get_sorted_chainsr� �get_signature_chainsr� r� �set_matched_chain_pair�warn)
r# �sig_chain_warning�backend_filename_listr@ �partialsrA r4 �
backup_chains�local_sig_chains�remote_sig_chainsr r r �
set_values� sP
��
��
� �
�� �
�
z CollectionsStatus.set_valuesc C s� |o| � |�}|| _|dd� | _d| _|rl|rl|d }tt|�d dd�D ]E}|| j|jkr1n.t|�� �dkr^|| j|�� d jkr^t� t
d�� | j � |j
d � |j
dd� |_
nq&| jdu rk|| |f| _ | jrz| j�| jd � dS dS )a9
Set self.matched_chain_pair and self.other_sig/backup_chains
The latest matched_chain_pair will be set. If there are both
remote and local signature chains capable of matching the
latest backup chain, use the local sig chain (it does not need
to be downloaded).
Nr� r� � ���zGWarning, discarding last backup set, because of missing signature file.)r� r� r� r� r rk r r� r �WarnrN r� r> r �remove)r# �
sig_chainsr� �latest_backup_chainr� r r r r� � s*
�z(CollectionsStatus.set_matched_chain_pairc C s | j sJ �| jr#t�tddt| j��d d�ttj | j�� tj
j � | j rAt�tddt| j ��d d�ttj | j �� tj
j � | j
rS|rS| jsSt�td�tj
j� | jr`t�td�tj
j� | jrt�tdd t| j��d d�tt| j�� tj
j� d
S d
S ) zN
Log various error messages if find incomplete/orphaned files
z;Warning, found the following local orphaned signature file:z<Warning, found the following local orphaned signature files:r� z<Warning, found the following remote orphaned signature file:z=Warning, found the following remote orphaned signature files:z;Warning, found signatures but no corresponding backup fileszIWarning, found incomplete backup sets, probably left from aborted sessionz2Warning, found the following orphaned backup file:z3Warning, found the following orphaned backup files:N)r� r� r r� r� rk rV r r
r1 � WarningCode� orphaned_sigr� r� r� rN �
unmatched_sigr� �incomplete_backupr� r �orphaned_backup)r# r� r r r r� $ sV
��������
�
������zCollectionsStatus.warnc s� t �td�dd� |D � � g ���fdd�}|D ]}||� q����\�}g g � �� ��fdd�}�D ]}||� q6� �|fS )a"
Split given filename_list into chains
Return value will be tuple (list of chains, list of sets, list
of incomplete sets), where the list of sets will comprise sets
not fitting into any chain, and the incomplete sets are sets
missing files.
z/Extracting backup chains from list of files: %sc S rB r rC rD r r r rG W rH z7CollectionsStatus.get_backup_chains.<locals>.<listcomp>c s� t �| �}�D ]}|�| |�r t�td�t�| �f � dS qt�td�t�| �f � t� j � j
�}|�| |�rA�� |� dS t�td�t�| � � dS )zO
Try adding filename to existing sets, or make new one
z File %s is part of known setz4File %s is not part of a known set; creating new setz+Ignoring file (rejected by backup set) '%s'N) r r+ r5 r rM rN r
r1 r r r" r> )r3 r4 �set�new_set)r# �setsr r � add_to_sets[ s
� z8CollectionsStatus.get_backup_chains.<locals>.add_to_setsc s� | j dkr!t�j�}|�| � � �|� t�td�|�� � dS | j dks(J �� D ]}|� | �rCt�td�| �
� |�� f � dS q*t�td�| �
� f � ��| � dS )zL
Try adding set to existing chains, or make new one
r) zFound backup chain %sr* z%Added set %s to pre-existing chain %szFound orphaned set %sN) r, r| r r� r> r rM rN r� r� rZ )r� � new_chain�chain)�chains�
orphaned_setsr# r r �
add_to_chainsr s
��z:CollectionsStatus.get_backup_chains.<locals>.add_to_chains)r rM rN �get_sorted_sets)r# �
filename_listr� rF �incomplete_setsr� r� r )r� r� r# r� r r� M s
�
z#CollectionsStatus.get_backup_chainsc C sv g g }}|D ]"}|� � s|�|� q|jdkr!|�|j|f� q|�|j|f� q|jdd� d� dd� |D �|fS )zM
Sort set list by end time, return (sorted list, incomplete)
r) c S s | d S )Nr r �rr r r r �<lambda>� s z3CollectionsStatus.get_sorted_sets.<locals>.<lambda>��keyc S � g | ]}|d �qS �r� r �rE �pr r r rG � r� z5CollectionsStatus.get_sorted_sets.<locals>.<listcomp>)r' r> r, r r rt )r# �set_list�time_set_pairsr� r� r r r r� � s
z!CollectionsStatus.get_sorted_setsNc
s� � ��fdd�}��fdd�}g g }}|� D ])}t �|�}|r@|jdkr6|� } | �||�s0J �|�| � q|jdkr@|�|� qg }
|jdd� d � |D ]} |D ] } | �| �rZ nqQ|
�| � qM||
fS )
z�
Find chains in archive_dir_path (if local is true) or backend
Use filelist if given, otherwise regenerate. Return value is
pair (list of chains, list of signature paths not in any
chains).
c s2 � d ur� S �r�j dkr�j�� S g S �j�� S )Nr; )r" r< r= r rT r �rW r� r# r r � get_filelist� s
z<CollectionsStatus.get_signature_chains.<locals>.get_filelistc s � rt d�j�S t d�j�S )z:
Return new empty signature chain
TF)r� r< r r )r� r# r r �get_new_sigchain� s z@CollectionsStatus.get_signature_chains.<locals>.get_new_sigchainr� r� c S s t t�| �j�S r6 )�intr r+ r r� r r r r� � s z8CollectionsStatus.get_signature_chains.<locals>.<lambda>r� )r r+ r, r5 r> rt )
r# r� rW r� r� r� �new_sig_filenamesr3 r4 r� �orphaned_filenames� sig_filenamer� r r� r r� � s.
�
�
�z&CollectionsStatus.get_signature_chainsc C s� i }|D ]}|j |v r||j �|� q|g||j < qt|�� �}|�� g }|D ]>}|| }t|�dkr=|�|d � q)t|�dksEJ �|d jrY|�|d � |�|d � q)|�|d � |�|d � q)|S )zL
Return chains sorted by end_time. If tie, local goes last
r� r r� )r r> rT rs rt rk r )r# �
chain_list�endtime_chain_dictr� �sorted_end_times�sorted_chain_listr r r r r� � s&
z#CollectionsStatus.get_sorted_chainsc st | j std��� fdd�| j D �}t|�dkrtd��t|�dkr%|d S � fdd�| j D �}|r5|d S | j d S ) z�
Return backup chain covering specified time
Tries to find the backup chain covering the given time. If
there is none, return the earliest chain before, and failing
that, the earliest chain.
zNo backup chains foundc �, g | ]}|j � kr|jkrn n|�qS r �r r �rE �cr� r r rG � � �z>CollectionsStatus.get_backup_chain_at_time.<locals>.<listcomp>r� z Two chains cover the given timer c � g | ] }|j � k r|�qS r r� r r� r r rG � r� r� )r� r rk )r# r �covering_chains�
old_chainsr r� r �get_backup_chain_at_time� s
z*CollectionsStatus.get_backup_chain_at_timec s� | j std��� fdd�| j D �}|r|d S � fdd�| j D �}|r'|d S | j d }� |jk rFt�td�t�|j� tjj t�
|j�� |S )z�
Return signature chain covering specified time
Tries to find the signature chain covering the given time. If
there is none, return the earliest chain before, and failing
that, the earliest chain.
zNo signature chains foundc r r r r r� r r rG
r zACollectionsStatus.get_signature_chain_at_time.<locals>.<listcomp>r� c r r r� r r� r r rG r� r z]No signature chain for the requested time. Using oldest available chain, starting at time %s.) r� r r r r� rN r rY r� �no_sig_for_timer� )r# r r
r �oldestr r� r �get_signature_chain_at_time s"
�
�z-CollectionsStatus.get_signature_chain_at_timec C sh | j sJ �g }g }| j| j }|D ]}|jr |�|�� � q|�|�� � q|| j7 }|| j7 }||fS )z�
Return list of the names of extraneous duplicity files
A duplicity file is considered extraneous if it is
recognizable as a duplicity file, but isn't part of some
complete backup set, or current signature chain.
)r� r� r� r rS rI r� r� )r# �local_filenames�remote_filenames�ext_containers� set_or_chainr r r �get_extraneous s
z CollectionsStatus.get_extraneousc C s$ dd� |D �}|� � dd� |D �S )z@Return new list containing same elems of setlist, sorted by timec S s g | ]}|� � |f�qS r �rw r� r r r rG 7 s z/CollectionsStatus.sort_sets.<locals>.<listcomp>c S r� r� r r� r r r rG 9 r� )rt )r# �setlist�pairsr r r � sort_sets5 s zCollectionsStatus.sort_setsc C �F | j sJ �g }| jD ]}|j|k r | jr|| jd ur |�|� q
|S )a�
Returns a list of backup chains older than the given time t
All of the times will be associated with an intact chain.
Furthermore, none of the times will be of a chain which a newer
set may depend on. For instance, if set A is a full set older
than t, and set B is an incremental based on A which is newer
than t, then the time of set A will not be returned.
r� )r� r� r r� r> �r# �tr r� r r r �get_chains_older_than; �
�
�z'CollectionsStatus.get_chains_older_thanc C r )a�
Returns a list of signature chains older than the given time t
All of the times will be associated with an intact chain.
Furthermore, none of the times will be of a chain which a newer
set may depend on. For instance, if set A is a full set older
than t, and set B is an incremental based on A which is newer
than t, then the time of set A will not be returned.
r )r� r� r r� r> r r r r � get_signature_chains_older_thanO r z1CollectionsStatus.get_signature_chains_older_thanc C �
| � d�S )zY
Return the time of the last full backup,
or 0 if there is none.
r� )� get_nth_last_full_backup_timer& r r r �get_last_full_backup_timec �
z+CollectionsStatus.get_last_full_backup_timec C s | � |�}|du r dS |�� jS )z`
Return the time of the nth to last full backup,
or 0 if there is none.
Nr )�get_nth_last_backup_chainr� r )r# r� r� r r r r j s
z/CollectionsStatus.get_nth_last_full_backup_timec C r )zr
Return the last full backup of the collection,
or None if there is no full backup chain.
r� )r# r& r r r �get_last_backup_chainu r" z'CollectionsStatus.get_last_backup_chainc C sZ | j sJ �|dks J �t| j�|k rdS | jdd� }|jdd� d� |�� ||d S )a!
Return the nth-to-last full backup of the collection,
or None if there is less than n backup chains.
NOTE: n = 1 -> time of latest available chain (n = 0 is not
a valid input). Thus the second-to-last is obtained with n=2
rather than n=1.
r Nc S s
| � � jS r6 )r� r r� r r r r� � s
z=CollectionsStatus.get_nth_last_backup_chain.<locals>.<lambda>r� r� )r� rk r� rt rJ )r# r� �sortedr r r r# | s
z+CollectionsStatus.get_nth_last_backup_chainc C s, g }| � |�D ] }|�|�� � q| �|�S )a�
Returns a list of backup sets older than the given time t
All of the times will be associated with an intact chain.
Furthermore, none of the times will be of a set which a newer
set may depend on. For instance, if set A is a full set older
than t, and set B is an incremental based on A which is newer
than t, then the time of set A will not be returned.
)r rS r� r )r# r �old_setsr� r r r �get_older_than� s
z CollectionsStatus.get_older_thanc sV | j sJ �� fdd�| jD �}g }|D ]}� fdd�|�� D �}|�|� q| �|�S )a
Returns list of old backup sets required by new sets
This function is similar to the previous one, but it only
returns the times of sets which are old but part of the chains
where the newer end of the chain is newer than t.
c s g | ] }|j � kr|�qS r r� r �r r r rG � r� z=CollectionsStatus.get_older_than_required.<locals>.<listcomp>c s g | ]
}|� � � k r|�qS r r r� r( r r rG � s )r� r� r� rS r )r# r �
new_chains� result_setsr� r& r r( r �get_older_than_required� s
z)CollectionsStatus.get_older_than_requiredc C s� |}d|v rd|� dd� d }| jsdS | jd �� }g }g }t�|�}|D ]$}dd� |�� D �}||v rK|�|� |�|�}|�|�� | d � q't|t t
||���S ) z=
Returns time line of specified file changed
r� �"z\x20r� r� c S r� r� r )rE �fileinfor r r rG � r� z=CollectionsStatus.get_file_changed_record.<locals>.<listcomp>r ) �replacer� r� r
�fsencoder8 r> �index�FileChangedStatusrT r ) r# �filepath�modified_filepath�all_backup_set�specified_file_backup_set�specified_file_backup_type�bsrW r0 r r r �get_file_changed_record� s"
�z)CollectionsStatus.get_file_changed_recordr� r6 )r r r r{ r$ r� rX r� r� r� r� r� r� r� r r r r r r r! r r$ r# r' r+ r8 r r r r r� i s2
-5&)<
3 r� c @ s e Zd Zdd� Zdd� ZdS )r1 c C s || _ || _d S r6 )r2 �
fileinfo_list)r# r2 r9 r r r r$ � s
zFileChangedStatus.__init__c C s� d}dt d�| j t d�t| j� |t d�t d�t d�f g}| jD ]'}|d }|d }|jr4t d
�}nt d �}|�||t�|�� �|� � f � q"|�d� d �
|�S )
Nz%20s %30s %20sr� zFile: %szTotal number of backup: %dr� r� zType of file change:r r� r� r� r� ) rN r2 rk r9 r r> r rY rw �titlerV )r# r� r� r� � backup_type�
backup_setr, r r r rX � s �
$
zFileChangedStatus.__str__N)r r r r$ rX r r r r r1 � s r1 ) r{ �builtinsr r r r r �sys� duplicityr r r r
r r r
�
duplicity.gpgr � version_infor� r� rL r r r| r� r� r1 r r r r �<module> sB
f