|
Server : Apache System : Linux iad1-shared-b8-43 6.6.49-grsec-jammy+ #10 SMP Thu Sep 12 23:23:08 UTC 2024 x86_64 User : dh_edsupp ( 6597262) PHP Version : 8.2.26 Disable Function : NONE Directory : /lib/python3/dist-packages/mercurial/__pycache__/ |
Upload File : |
o
�]Lb�z � @ s� d dl mZ d dlZd dlZd dlZd dlZddlmZ ddlm Z ddl
m Z ddl m
Z
mZmZmZmZmZmZmZmZmZ ddlmZ dd lmZ d
d � Zd d
� Z dDdd�Z dd� Z dd� Z dEdd�Z dd� Z!dd� Z"dFd d �Z#d d � Z$d d!� Z%d"d#� Z&G d$d%� d%e'�Z(d Z)dZ*d&Z+d'Z,d(d)� Z-d*d+� Z.ej/d,d-� �Z0d.d/� Z1d0d1� Z2d2d3� Z3d4d5� Z4d6d7� Z5d8d9� Z6ej/d:d;� �Z7d<d=� Z8d>d?� Z9d@dA� Z:dBdC� Z;dS )G� )�absolute_importN� )�_)�open)�
repository)
� bookmarks� cacheutil�error�
narrowspec�phases�pycompat� requirements�scmutil�store�util)�nodemap)�
stringutilc C s t | �}|tj8 }|�|� |S )a determine the final set of requirement for a new stream clone
this method combine the "default" requirements that a new repository would
use with the constaint we get from the stream clone content. We keep local
configuration choice when possible.
)�set�requirementsmod�STREAM_FIXED_REQUIREMENTS�update)�default_requirements�streamed_requirementsr
� r �7/usr/lib/python3/dist-packages/mercurial/streamclone.py� new_stream_clone_requirements& s
r c C s | j tj@ }|S )z�the set of requirement the new clone will have to support
This is used for advertising the stream options and to generate the actual
stream content.)r
r r )�repo�requiredformatsr r r r 3 s
�r Fc C s | j }| j}d}| jrd| j�dg �v rd}|r |s dS |r"|s"dS t|�r(dS | jr-dS | j}|du r9|�d�}|s=dS t � }|�d�rO|�
t j � d|fS |�d�}|sa| j j
�td �� dS t |�d
��}||j }|r�| j j
�td �d �t|�� � | j j
�td
�� dS |}d|fS )a� Whether it is possible to perform a streaming clone as part of pull.
``bundle2`` will cause the function to consider stream clone through
bundle2 and only through bundle2.
Returns a tuple of (supported, requirements). ``supported`` is True if
streaming clone is supported and False otherwise. ``requirements`` is
a set of repo requirements from the remote, or ``None`` if stream clone
isn't supported.
Fs v2s streamT)FNNs stream-preferreds
streamreqss= warning: stream clone requested but server has them disabled
� ,sG warning: stream clone requested but client is missing requirements: %s
� , sQ (see https://www.mercurial-scm.org/wiki/MissingRequirement for more information)
)r �remote�
canusebundle2�remotebundle2caps�get�len�heads�streamclonerequested�capabler �addr �REVLOGV1_REQUIREMENT�ui�warnr �split� supported�join�sorted) �pullop�bundle2r r �bundle2supported�streamrequestedr
�
streamreqs� missingreqsr r r �canperformstreamclone> sb
!
���
� ����r6 c
C s ddl m} t| �\}}|sdS | j}| j}d}|�d�r9|�� �}|�di ��� }W d � n1 s4w Y |j �
t d�� |�� �}|�di ��� }W d � n1 sXw Y |� � } zt
| �}
W n tyv t�t d�| ��w |
dkr�t�t d���|
d kr�t�t d
���|
d kr�t�t d ���|� � } z
tt
| �d
d��\} } W n ttfy� t�t d�| ��w |�� �: t||| | � t|j|�|_|�|j |j|j�|j_ t � |� t � |� |r�|j!�"||� |�#� W d � dS 1 s�w Y dS )z�Possibly perform a legacy stream clone operation.
Legacy stream clones are performed as part of pull but before all other
operations.
A legacy stream clone will not be performed if a bundle2 stream clone is
supported.
r �� localrepoNs branchmaps streaming all changes
s
stream_out�' unexpected response from remote server:s operation forbidden by server� s$ locking the remote repository failedr s% the server sent an unknown error code� )$� r8 r6 r r r' �commandexecutor� callcommand�resultr* �statusr �readline�int�
ValueErrorr �
ResponseError�Abort�mapr, � TypeError�lock� consumev1r r
�resolvestorevfsoptions�features�svfs�optionsr �writereporequirementsr �post_stream_cleanup�
_branchcaches�replace�
invalidate)
r0 r8 r- r
r r �
rbranchmap�e�fp�l�resp� filecount� bytecountr r r � maybeperformlegacystreamclone� sh
�
� ����
� �
"�rZ c C sF t j| jvrdS | jjdddd�sdS t�| �}|r!| j�dd�S dS )z5Whether streaming clones are allowed from the server.Fs servers uncompressedT)� untrusteds uncompressedallowsecret)r �REPO_FEATURE_STREAM_CLONErK r* �
configboolr � hassecret)r �secretr r r �allowservergeneration� s
r` c C s | j �|�S �N)r �walk)r �matcherr r r �_walkstreamfiles� � rd c s� g �d}�� � �) �j�d� t��D ]\}}}|r%��||f� ||7 }qt�� W d � n1 s4w Y t�� �j�dt��|f � �j��jj � � ���fdd�}t��||� fS )a� Emit content for version 1 of a streaming clone.
This returns a 3-tuple of (file count, byte size, data iterator).
The data iterator consists of N entries for each file being transferred.
Each file entry starts as a line with the file name and integer size
delimited by a null byte.
The raw file data follows. Following the raw file data is the next file
entry, or EOF.
When used on the wire protocol, an additional line indicating protocol
success will be prepended to the stream. This function is not responsible
for adding it.
This function will obtain a repository lock to ensure a consistent view of
the store is captured. It therefore may raise LockError.
r � scanning
Ns %d files, %d bytes to transfer
c 3 s� � �D ]I\} }� r�j �d| |f � dt�| �|f V �| ddd�� }|dkr0|�|�V n
tj||d�D ]}|V q7W d � n1 sGw Y qd S )Ns sending %s (%d bytes)
s %s %d
� rbF)� auditpath� ��limit)r* �debugr � encodedir�readr �
filechunkiter)�name�sizerU �chunk�� debugflag�entriesr rL r r �emitrevlogdata" s � � ���z"generatev1.<locals>.emitrevlogdata)
rH r* rl rd �append�_test_sync_point_walk_1�_test_sync_point_walk_2r$ rL rt )r � total_bytes� file_typerp rq rv r rs r �
generatev1� s&
�
��r| c c sl � t | �s
dV dS z t| �\}}}W n tjy! dV Y dS w dV d||f V |D ]}|V q.dS )a� Emit content for version 1 of streaming clone suitable for the wire.
This is the data output from ``generatev1()`` with 2 header lines. The
first line indicates overall success. The 2nd contains the file count and
byte size of payload.
The success line contains "0" for success, "1" for stream generation not
allowed, and "2" for error locking the repository (possibly indicating
a permissions error for the server process).
s 1
Ns 2
s 0
s %d %d
)r` r| r � LockError)r rX rY �itrr r r r �generatev1wireproto4 s � ��r � UNc s@ � dkrt d��t��}d�t|���� ��fdd�}||� fS )a@ Emit content for version 1 of a stream clone bundle.
The first 4 bytes of the output ("HGS1") denote this as stream clone
bundle version 1.
The next 2 bytes indicate the compression type. Only "UN" is currently
supported.
The next 16 bytes are two 64-bit big endian unsigned integers indicating
file count and byte count, respectively.
The next 2 bytes is a 16-bit big endian unsigned short declaring the length
of the requirements string, including a trailing . The following N bytes
are the requirements string, which is ASCII containing a comma-delimited
list of repo requirements that are needed to support the data.
The remaining content is the output of ``generatev1()`` (which may be
compressed in the future).
Returns a tuple of (requirements, data generator).
r� s. we do not support the compression argument yetr c 3 s� � dV � V t ��\} }}�j�td�|| f � t�d| |�V t�dt��d �V �d V � dks8J ��jjtd�|td �d
�}|�d � |D ]
}|j t|�d � |V qL|�
� d S )
Ns HGS1s writing %d bytes for %d files
� >QQ� >Hr � r� � bundle� bytes��total�unitr ��step) r| r* r@ r �struct�packr$ � makeprogressr � increment�complete)rX rY r~ �progressrr �� compressionr �requiresr r �genl s& ��
�
z generatebundlev1.<locals>.gen)rC r r. r/ )r r� r
r� r r� r �generatebundlev1P s
r� c
C s | � � �� | j�td�|t�|�f � | jjtd�|td�d�}|�d� t�� }| � d��� | j
j | j|d��y t �
|�D ]k}|�� }z|�dd�\}} t| �} W n ttfyd t�td �|��w | jjrv| j�d
|t�| �f � t�|�}
| j
|
d d d
�� } tj|| d�D ]} |jt| �d� | � | � q�W d � n1 s�w Y q?W d � n1 s�w Y | j d d� W d � n1 s�w Y t�� | }
|
dkr�d}
|� � | j�td�t�|�|
t�||
�f � W d � dS 1 s�w Y dS )a
Apply the contents from version 1 of a streaming clone file handle.
This takes the output from "stream_out" and applies it to the specified
repository.
Like "stream_out," the status line added by the wire protocol is not
handled by this function.
�! %d files to transfer, %s of data
� cloner� r� r )�
expectedcountr� r r9 s adding %s (%s)
� wT)�backgroundcloserj r� N��clearfilecache���MbP?�( transferred %s in %.1f seconds (%s/sec)
) rH r* r@ r r rY r� r �timer� transactionrL �backgroundclosingr �xrangerA r, rB rC rG r rD rt rl r � decodedirro r� r$ �writerR r� )r rU rX rY r� �start�irV rp rq �path�ofprr �elapsedr r r rI � sh
���
���
� ��� � � ���"�rI c C s� | � d�}|dkrt�td�| ��t�d| � d��\}}t�d| � d��d }| � |�}|�d�s9t�td ���t|�d�� d
��}|||fS ) Nr: r� s< only uncompressed stream clone bundles are supported; got %sr� � r� r r� s@ malformed stream clone bundle: requirements not properly encodedr )
rn r rE r r� �unpack�endswithr �rstripr, )rU r� rX rY � requireslenr� r
r r r �readbundle1header� s(
���
��
r� c C sj t | �r t�td���t|�\}}}|| j }|r't�td�d�t|�� ��t| |||� t �
| � dS )z�Apply the content from a stream clone bundle version 1.
We assume the 4 byte header has been read and validated and the file handle
is at the 2 byte compression identifier.
s2 cannot apply stream clone bundle on non-empty repo�4 unable to apply stream clone: unsupported format: %sr N) r$ r rE r r� r- r. r/ rI r rO )r rU rX rY r
r5 r r r �
applybundlev1� s �
��r� c @ s e Zd ZdZdd� Zdd� ZdS )�streamcloneapplierz�Class to manage applying streaming clone bundles.
We need to wrap ``applybundlev1()`` in a dedicated type to enable bundle
readers to perform bundle type-specific functionality.
c C s
|| _ d S ra )�_fh)�self�fhr r r �__init__ s
zstreamcloneapplier.__init__c C s t || j�S ra )r� r� )r� r r r r �apply re zstreamcloneapplier.applyN)�__name__�
__module__� __qualname__�__doc__r� r� r r r r r� s r� � s� cc C s g }| � � s |�d� |S )z!list snapshot file from the stores
phaseroots)�
publishingrw )r �fnamesr r r �_walkstreamfullstorefiles s
r� c C s2 | \}}}}|t kr | S |||||| �|��fS )z actually copy the snapshot files)� _filefullr. )�entry�copy�vfsmap�srcrp �ftype�datar r r � _filterfull' s r� c
# sJ � g � z� fdd�} | V W � D ]}t �|� qdS � D ]}t �|� q w )z(return a function to temporary copy filec s4 t �� \}}t�|� � �|� tj| |dd� |S )NT)�hardlink)r �mkstemp�os�closerw r � copyfiles)r� �fd�dst��filesr r r� 5 s
z maketempcopies.<locals>.copyN)r � tryunlink)r� �tmpr r� r �maketempcopies/ s � � �r� c C s& t | jt| ji}| j|�� vsJ �|S )z$make a (src -> vfs) map for the repo)� _srcstorerL � _srccache�cachevfs�vfs�values)r r� r r r �_makemapB s
�r� c # s� � t | ��| j��� v rt�d��| jjtd�|td�d�}|�d� t � ��� |�� � �fdd�|D �}dV d}|D ]�\}}}}�| } |V t
� t |��V |t
kr[| |�}
|} n|tkrjt|d �}
t
�|
�j} d} zJt
� | �V |V | d
kr�|
�| �f}
nt
j|
| d �}
|
D ]}| t |�7 } |t |�7 }|�|� |V q�| | kr�t�td �| || f ��W |
�� q;|
�� w W d � n1 s�w Y W d � dS W d � dS 1 s�w Y dS )
z actually emit the stream bundle�9 repo.vfs must not be added to vfsmap for security reasonsr� r� r� r c s g | ]}t |� ���qS r )r� )�.0rT �r� r� r r �
<listcomp>b s z_emit2.<locals>.<listcomp>Nrg ri rj s= clone could only read %d bytes from %s, but expected %d bytes)r� r� r� r �ProgrammingErrorr* r� r r r� r �
uvarintencoder$ � _fileappendr� r �fstat�st_sizern ro rE r� )r ru �
totalfilesizer� �totalbytecountr� rp r� r� r� rU rq rY �chunksrr r r� r �_emit2O s` ���
���� �P�r� c C � dS �z+a function for synchronisation during testsNr �r r r r rx � � rx c C r� r� r r� r r r ry � r� ry c C s8 | � | j�dus
J �g }d}d}|s|r t�| j||�}t| |�D ] \}}} | r>t}
|tj@ r1t }
|�
t ||
| f� || 7 }q!t | �D ]}| j
�|�r]|| j
�|�j7 }|�
t |t df� qC|rx| j
�d�rx|| j
�d�j7 }|�
t dt df� t�| �D ]}| j�|�r�|| j�|�j7 }|�
t|t df� q}||fS )a� emit a seris of files information useful to clone a repo
return (entries, totalfilesize)
entries is a list of tuple (vfs-key, file-path, file-type, size)
- `vfs-key`: is a key to the right vfs to write the file (see _makemap)
- `name`: file path of the file to copy (to be feed to the vfss)
- `file-type`: do this file need to be copied with the source lock ?
- `size`: the size of the file (or None)
Nr s obsstore)� _currentlock�_lockrefr
�match�rootrd r� r �FILEFLAGS_VOLATILEr� rw r� r� rL �exists�lstatr� r � cachetocopyr� r� ) r �includes�excludes�includeobsmarkersru r� rc �rl_typerp rq �ftr r r �_v2_walk� s8
� � �r� c C s� | � � �, | j�d� t| |||d�\}}t| ||�}t|�}|du s%J �t| � W d � n1 s3w Y t| � t|�||fS )a� Emit content for version 2 of a streaming clone.
the data stream consists the following entries:
1) A char representing the file destination (eg: store or cache)
2) A varint containing the length of the filename
3) A varint containing the length of file data
4) N bytes containing the filename (the internal, store-agnostic form)
5) N bytes containing the file data
Returns a 3-tuple of (file count, file size, data iterator).
rf �r� r� r� N) rH r* rl r� r� �nextrx ry r$ )r r� r� r� ru r� r� �firstr r r �
generatev2� s
�
�r� c g s� � | d }| dd � }|�. |r(t |� � d V W d � n1 s"w Y n d V W d � d S W d � d S 1 s>w Y d S )Nr r )�nested)�ctxs�this�restr r r r� � s �
����" r� c s � � � �� � j�td�|t�|�f � t�� }� jjtd�|td�d�}|�d� t � �}� j
|� � v r:t �
d��� �d��� � fdd�|� � D �}t|� �g t|�D ]Z}t�|d �} || }
t�|�} t�|�} t�|| �}
� jjr�� j�d
| |
t�| �f � |
|
d �� }tj|| d �D ]}|jt|�d
� |�|� q�W d � n1 s�w Y qTW d � n1 s�w Y � jdd� W d � n1 s�w Y t�� | }|dkr�d}� j�td�t�|j�|t�|j| �f � |�� W d � dS 1 �sw Y dS )z�Apply the contents from a version 2 streaming clone.
Data is read from an object that only needs to provide a ``read(size)``
method.
r� r� r� r� r r� c 3 s � | ] }|� � j�V qd S ra )r� r* )r� r� r� r r � <genexpr> s � z consumev2.<locals>.<genexpr>r s adding [%s] %s (%s)
r� rj r� NTr� r� r� ) rH r* r@ r r rY r� r� r r� r� r� r r� r� r� �range� readexactly�uvarintdecodestreamrt rl ro r� r$ r� rR �posr� )r rU rX �filesizer� r� r� r� r� r� r� �namelen�datalenrp r� rr r� r r� r � consumev2� sn
���
�
�� � ��� � �
���
$�r
c s� ddl m} � fdd�|D �}|r t�td�d�t|�� ��t� |||� t� j |�� _ |�
� j � j � j �� j
_t�� � t�� � d S )Nr r7 c s g | ] }|� j vr|�qS r )r- �r� �rr� r r r� 1 s z!applybundlev2.<locals>.<listcomp>r� r )r< r8 r rE r r. r/ r
r r
rJ r* rK rL rM r rN r rO )r rU rX r r
r8 r5 r r� r �
applybundlev2. s$ ��� �
r
c
s� dg� � �fdd�}|D ]=\}}}| | }|| } |� |�}
| � |�} tj�| �} tj�| �s4t�| � | �|� tj|
| � d |dd� �� � q � d S )NTc s d� d< t d��_d S )NFr s copying)r �topicr �r� r� r r � copy_usedH s z _copy_files.<locals>.copy_usedr F)r� �no_hardlink_cb�check_fs_hardlink)
r. r� r� �dirnamer� r �makedirs�
register_file�copyfiler� )
� src_vfs_map� dst_vfs_mapru r� r �kr� rq �src_vfs�dst_vfs�src_path�dst_pathr r r r � _copy_filesE s(
�
r c C s2 dd� | j D �}dd� |j D �}||ksJ �|�� �� | �� �_ t�| �}|�d�}d}tj�|�r4d}t| dddd �\}}t | �} t |�}
| j
j t d
�t
|�| t d �d �} d
d� |D �} t| |
| | �}
|rwt�|�}|�d�}t�||� W d � n1 s�w Y | �� |
r�d}nd}| j
�|t
|�| � |�d��}|j�|� W d � n1 s�w Y |jdfg}|�|�� � |D ]>\}}z|�|� W q� t�y } z&|jtj kr�t d�}|�|�}t � |�}|||f; }|j
� |� W Y d}~q�d}~ww W d � dS 1 �sw Y dS )zYcopy all content from one local repository to another
This is useful for local clonec S � h | ] }|t jvr|�qS r �r �WORKING_DIR_REQUIREMENTSr r r r � <setcomp>g �
�z local_copy.<locals>.<setcomp>c S r r r r r r r r" l r# s bookmarksr r NTr� s linkings files)r r� r� c s s" � | ] \}}}}|||fV qd S ra r )r� r r� r� rq r r r r � s � z local_copy.<locals>.<genexpr>s linked %d files
s copied %d files
s
localclones undo.backupfiless error removing %s: %s
) r
rH r � bookmarksvfsr. r� r� r� r� r� r* r� r r$ r r r r� rl r� r r� rL �extend� undofiles�unlink�OSError�errno�ENOENTr � forcebytestrr+ )�src_repo� dest_repo�src_store_requirements�dest_store_requirements� src_book_vfs� srcbookmarks�bm_countru r� r � dest_vfs_mapr� r� r� � dst_book_vfs� dstbookmarks�msg�tr�
undo_files�undovfs�undofilerT r� �e_msgr r r �
local_copyc sv ��
�
�
� �' �
���$�r< )Fra )r� )<�
__future__r �
contextlibr) r� r� �i18nr r r �
interfacesr r< r r r r
r r
r r r r � revlogutilsr �utilsr r r r6 rZ r` rd r| r r� rI r� r� �objectr� r� r� r� r� r� r� �contextmanagerr� r� r� rx ry r� r� r� r
r
r r< r r r r �<module> sX 0
]K
8
:K
<)!
E