|
Server : Apache System : Linux iad1-shared-b8-43 6.6.49-grsec-jammy+ #10 SMP Thu Sep 12 23:23:08 UTC 2024 x86_64 User : dh_edsupp ( 6597262) PHP Version : 8.2.26 Disable Function : NONE Directory : /lib/python3/dist-packages/boto/s3/__pycache__/ |
Upload File : |
o
ckF[�g � @ s, d dl Zd dlZd dlmZmZ d dlZd dlmZ d dl Z
d dl m Z d dl
m
Z
d dlmZ d dlmZ d dlmZ d d lmZmZ d
d � Zd d
� ZG dd� de�ZG dd� de�ZG dd� de�Z G dd� de�Z G dd� de �Z G dd� de�Z G dd� de�Z G d d � d e�Z!G d d � d e �Z"dS ) � N)�six�urllib)�detect_potential_s3sigv4)�AWSAuthConnection)�handler)�Bucket)�Key)� ResultSet)�BotoClientError�S3ResponseErrorc C s | d � � s
td��dS )aJ
Bucket names must not contain uppercase characters. We check for
this by appending a lowercase character and testing with islower().
Note this also covers cases like numeric bucket names with dashes.
>>> check_lowercase_bucketname("Aaaa")
Traceback (most recent call last):
...
BotoClientError: S3Error: Bucket names cannot contain upper-case
characters when using either the sub-domain or virtual hosting calling
format.
>>> check_lowercase_bucketname("1234-5678-9123")
True
>>> check_lowercase_bucketname("abcdefg1234")
True
�azuBucket names cannot contain upper-case characters when using either the sub-domain or virtual hosting calling format.T)�islowerr
)�n� r �4/usr/lib/python3/dist-packages/boto/s3/connection.py�check_lowercase_bucketname( s r c s � fdd�}|S )Nc s( t | �dkr
t| d �r
� | i |��S )N� � )�lenr )�args�kwargs��fr r �wrapperB s z(assert_case_insensitive.<locals>.wrapperr )r r r r r �assert_case_insensitiveA s r c @ s: e Zd Zdd� Zd
dd�Zdd� Zd
dd �Zd
d
d �Zd S )�_CallingFormatc C s dS �N� r ��self�server�bucketr r r �get_bucket_serverK � z _CallingFormat.get_bucket_serverr c C s2 d| }|| � ||�7 }||�| �||��7 }|S )Nz%s://��
build_host�get_path�build_path_base�r �
connection�protocolr r! �key�url_baser r r �build_url_baseN s z _CallingFormat.build_url_basec C s |dkr|S | � ||�S r )r" r r r r r% T s z_CallingFormat.build_hostc C s4 t j�|�}d}|dkrd| }|dtj�|� S )Nr �/�/%s��boto�utils�get_utf8_valuer �parse�quote)r r! r+ �pathr r r �build_auth_pathZ s
z _CallingFormat.build_auth_pathc C s t j�|�}dtj�|� S )Nr/ r0 )r r! r+ r r r r' a s z _CallingFormat.build_path_baseN�r )�__name__�
__module__� __qualname__r" r- r% r7 r' r r r r r I s
r c @ � e Zd Zedd� �ZdS )�SubdomainCallingFormatc C s d||f S )Nz%s.%sr r r r r r" h s z(SubdomainCallingFormat.get_bucket_serverN�r9 r: r; r r" r r r r r= f � r= c @ r< )�VHostCallingFormatc C s |S �Nr r r r r r" o s z$VHostCallingFormat.get_bucket_serverNr> r r r r r@ m r? r@ c @ s e Zd Zdd� Zddd�ZdS )�OrdinaryCallingFormatc C s |S rA r r r r r r" v r# z'OrdinaryCallingFormat.get_bucket_serverr c C s0 t j�|�}d}|r|d| 7 }|tj�|� S )Nr. z%s/r0 )r r! r+ � path_baser r r r' y s
z%OrdinaryCallingFormat.build_path_baseNr8 )r9 r: r; r" r' r r r r rB t s rB c @ s e Zd Zddd�ZdS )�(ProtocolIndependentOrdinaryCallingFormatr c C s. d}|| � ||�7 }||�| �||��7 }|S )Nz//r$ r( r r r r- � s z7ProtocolIndependentOrdinaryCallingFormat.build_url_baseNr8 )r9 r: r; r- r r r r rD � s rD c @ s4 e Zd ZdZdZdZdZdZdZdZ dZ
d Z d
Z d S ) �Locationr �EUz eu-central-1z us-west-1z us-west-2z sa-east-1zap-northeast-1zap-southeast-1zap-southeast-2z
cn-north-1N)
r9 r: r; �DEFAULTrF �
EUCentral1�USWest�USWest2�SAEast� APNortheast� APSoutheast� APSoutheast2�CNNorth1r r r r rE � s rE c @ � e Zd ZdS )�NoHostProvidedN�r9 r: r; r r r r rQ � s rQ c @ rP )�HostRequiredErrorNrR r r r r rS � s rS c s$ e Zd ZdZej�ddd�ZdZdddddddde dded d
e
ddd ddf� fd d
� Z e dd� �Z
dd� Zdd� Zdd� Zdd� Z d2dd �Z d3d d �Z d4d d!�Zd5d"d#�Zd5d$d%�Zd6d&d'�Zd5d(d)�Zd6d*d+�Zdejdfd,d-�Z d5d.d/�Z d7� fd0d1� Z � Z S )8� S3Connectionzs3.amazonaws.com�s3�calling_formatz)boto.s3.connection.SubdomainCallingFormatz)Signature=%s&Expires=%d&AWSAccessKeyId=%sNTr r. �awsFc s� d}| t u rtj�dd�} | d u r| j} d}t| tj�r#tj� | �� } | | _
|| _ || _ t
t| �j| |||||||||
| |
|||||d� |rQd| �� v rStd��d S d S )NFrU �hostT)�debug�https_connection_factoryr6 �provider�security_token�suppress_consec_slashes�validate_certs� profile_name�
hmac-v4-s3z6When using SigV4, you must specify a 'host' parameter.)rQ r1 �config�get� DefaultHost�
isinstancer � string_typesr2 �
find_classrV � bucket_class�anon�superrT �__init__�_required_auth_capabilityrS )r �aws_access_key_id�aws_secret_access_key� is_secure�port�proxy�
proxy_port�
proxy_user�
proxy_passrX rY rZ rV r6 r[ rg r\ r] rh r^ r_ �no_host_provided�� __class__r r rj � s4 � ��zS3Connection.__init__c C s | j rdgS dgS )Nrh rU )rh )r r r r rk � s z&S3Connection._required_auth_capabilityc c s � | � � D ]}|V qd S rA )�get_all_buckets)r r! r r r �__iter__� s � �zS3Connection.__iter__c C s | � |�d uS rA )�lookup)r � bucket_namer r r � __contains__� s zS3Connection.__contains__c C s
|| _ dS )aX
Set the Bucket class associated with this bucket. By default, this
would be the boto.s3.key.Bucket class but if you want to subclass that
for some reason this allows you to associate your new class.
:type bucket_class: class
:param bucket_class: A subclass of Bucket that can be more specific
N)rg )r rg r r r �set_bucket_class� s
z S3Connection.set_bucket_classc C s2 t |tj�s
J d��dt�tjj|�d�|�f S )zX
Taken from the AWS book Python examples and modified for use with boto
z;Policy document must include a valid expiration Time objectz({"expiration": "%s",
"conditions": [%s]}�,)rd �time� struct_time�strftimer1 r2 �ISO8601�join)r �expiration_time�
conditionsr r r �build_post_policy� s ��z S3Connection.build_post_policy�p �http�STANDARDc C s� |du rg }| du r g } t �tt � � | ��} | �d| � |�d�r2| �d|dtd� � � n| �d| � |rJ| �d| � |�d|d�� |r[| �d | � |�d
|d�� |rd| �d | � | jjr{|�d | jjd�� | �d
| jj � |
r�|�d|
d�� | �d|
� | r�|�d| d�� | �d| � | �| | �}
t �
|
�}|�d|d�� |�d| j d�� | j �
|�}|�d|d�� |�d|d�� d|| j�| �� |�f }||d�S )a�
Taken from the AWS book Python examples and modified for use with boto
This only returns the arguments required for the post form, not the
actual form. This does not return the file input field which also
needs to be added
:type bucket_name: string
:param bucket_name: Bucket to submit to
:type key: string
:param key: Key name, optionally add ${filename} to the end to
attach the submitted filename
:type expires_in: integer
:param expires_in: Time (in seconds) before this expires, defaults
to 6000
:type acl: string
:param acl: A canned ACL. One of:
* private
* public-read
* public-read-write
* authenticated-read
* bucket-owner-read
* bucket-owner-full-control
:type success_action_redirect: string
:param success_action_redirect: URL to redirect to on success
:type max_content_length: integer
:param max_content_length: Maximum size for this file
:type http_method: string
:param http_method: HTTP Method to use, "http" or "https"
:type storage_class: string
:param storage_class: Storage class to use for storing the object.
Valid values: STANDARD | REDUCED_REDUNDANCY
:type server_side_encryption: string
:param server_side_encryption: Specifies server-side encryption
algorithm to use when Amazon S3 creates an object.
Valid values: None | AES256
:rtype: dict
:return: A dictionary containing field names/values as well as
a url to POST to
.. code-block:: python
Nz{"bucket": "%s"}z ${filename}z ["starts-with", "$key", "%s"]z
{"key": "%s"}z
{"acl": "%s"}�acl)�name�valuez!{"success_action_redirect": "%s"}�success_action_redirectz ["content-length-range", 0, %i]�x-amz-security-tokenz {"x-amz-security-token": "%s"}zx-amz-storage-classz {"x-amz-storage-class": "%s"}z x-amz-server-side-encryptionz&{"x-amz-server-side-encryption": "%s"}�policy�AWSAccessKeyId� signaturer+ z%s://%s/)�action�fields)r~ �gmtime�int�append�endswithr r[ r\ r� �base64� b64encoderl �
_auth_handler� sign_stringrV r% � server_name)r rz r+ �
expires_inr� r� �max_content_length� http_methodr� r� �
storage_class�server_side_encryption�
expirationr� �
policy_b64r� �urlr r r �build_post_form_args� s^ :
���
� ��
z!S3Connection.build_post_form_argsr c
C s� | j �||�}
| j �||�} | j �| �� |�} | �d�r"| d d� } i }
|d ur,||
d< |d ur5|
�|� | j||
| || |
d�}| jj ||| d�S )Nz:443���� VersionId)�headersrX �params)�iso_date)
rV r' r7 r% r� r� �update�build_base_http_requestr� �presign)r r� �methodr! r+ r� �
force_http�response_headers�
version_idr� r6 � auth_pathrX r� � http_requestr r r �generate_url_sigv4e s"
�
�z S3Connection.generate_url_sigv4c
C s� | j jd dkr|r| j||||||||
d�S |pi }| r"t|�} ntt�� | �} | j�||�} | �| �} g }
|
d urC|
�d|
� |r[|� � D ]\}}|
�d|t
j � |�f � qI| j
jre| j
j|d< |
rxd| vrmdnd}| |d�|
� 7 } | j�||� |r�| js�tj�|| || | j
�}| j �|�}t
j j |d d
�}d| j|| | jf }nd }|r�| j
j}|� � D ]\}}|�|�r�|
�d|t
j � |�f � q�|
r�|s�dnd}||d�|
� 7 }|r�d }d }n| j}| j}| j� | || � |�||�| S )
Nr r` )r! r+ r� r� r� r� z versionId=%sz%s=%sr� �?�&r )�safer� �P ) r� �
capabilityr� r� r~ rV r7 r& r� �itemsr r4 r5 r[ r\ r� r' rh r1 r2 �canonical_stringr� � QueryStringrl �
header_prefix�
startswithr* ro r- r� )r r� r� r! r+ r� �
query_authr� r� �expires_in_absoluter� �expiresr� �extra_qp�k�v� delimiter�c_string�b64_hmac�encoded_canonical�
query_part�
hdr_prefixr* ro r r r � generate_url sj
�
�
�
�
��zS3Connection.generate_urlc C sv | j d|d�}|�� }|jdkr| j�|j|j|��td| jfg�}t� || �}t
|t �s2|� d�}t
j�||� |S )N�GET�r� i, r zutf-8)� make_request�read�statusr[ �storage_response_error�reasonr rg r �
XmlHandlerrd �bytes�encode�xml�sax� parseString)r r� �response�body�rs�hr r r rw � s
�
z S3Connection.get_all_bucketsc C s | j |d�}|jjS )a
Convenience method that returns the "CanonicalUserID" of the
user who's credentials are associated with the connection.
The only way to get this value is to do a GET request on the
service which returns all buckets associated with the account.
As part of that response, the canonical userid is returned.
This method simply does all of that and then returns just the
user id.
:rtype: string
:return: A string containing the canonical user id.
r� )rw �owner�id)r r� r� r r r �get_canonical_user_id� s
z"S3Connection.get_canonical_user_idc C s |r | j ||d�S | �| |�S )a�
Retrieves a bucket by name.
If the bucket does not exist, an ``S3ResponseError`` will be raised. If
you are unsure if the bucket exists or not, you can use the
``S3Connection.lookup`` method, which will either return a valid bucket
or ``None``.
If ``validate=False`` is passed, no request is made to the service (no
charge/communication delay). This is only safe to do if you are **sure**
the bucket exists.
If the default ``validate=True`` is passed, a request is made to the
service to ensure the bucket exists. Prior to Boto v2.25.0, this fetched
a list of keys (but with a max limit set to ``0``, always returning an empty
list) in the bucket (& included better error messages), at an
increased expense. As of Boto v2.25.0, this now performs a HEAD request
(less expensive but worse error messages).
If you were relying on parsing the error message before, you should call
something like::
bucket = conn.get_bucket('<bucket_name>', validate=False)
bucket.get_all_keys(maxkeys=0)
:type bucket_name: string
:param bucket_name: The name of the bucket
:type headers: dict
:param headers: Additional headers to pass along with the request to
AWS.
:type validate: boolean
:param validate: If ``True``, it will try to verify the bucket exists
on the service-side. (Default: ``True``)
r� )� head_bucketrg )r rz �validater� r r r �
get_bucket� s % zS3Connection.get_bucketc C s� | j d||d�}|�� }|jdkr| �| |�S |jdkr.| j�|j|j|�}d|_d|_|�|jdkrE| j�|j|j|�}d|_d |_|�| j�|j|j|��)
a|
Determines if a bucket exists by name.
If the bucket does not exist, an ``S3ResponseError`` will be raised.
:type bucket_name: string
:param bucket_name: The name of the bucket
:type headers: dict
:param headers: Additional headers to pass along with the request to
AWS.
:returns: A <Bucket> object
�HEADr� �� i� � AccessDeniedz
Access Deniedi� � NoSuchBucketz#The specified bucket does not exist) r� r� r� rg r[ r� r� �
error_code�
error_message)r rz r� r� r� �errr r r r� s2
�
�
�zS3Connection.head_bucketc C s( z | j |||d�}W |S d}Y |S )aR
Attempts to get a bucket from S3.
Works identically to ``S3Connection.get_bucket``, save for that it
will return ``None`` if the bucket does not exist instead of throwing
an exception.
:type bucket_name: string
:param bucket_name: The name of the bucket
:type headers: dict
:param headers: Additional headers to pass along with the request to
AWS.
:type validate: boolean
:param validate: If ``True``, it will try to fetch all keys within the
given bucket. (Default: ``True``)
r� N)r� )r rz r� r� r! r r r ry . s �zS3Connection.lookupc C s� t |� |r|r||| jj< n| jj|i}|tjkr d}nd| d }| jd|||d�}|�� }|jdkr?| j�|j|j |��|jdkrJ| �
| |�S | j� |j|j |��)a
Creates a new located bucket. By default it's in the USA. You can pass
Location.EU to create a European bucket (S3) or European Union bucket
(GCS).
:type bucket_name: string
:param bucket_name: The name of the new bucket
:type headers: dict
:param headers: Additional headers to pass along with the request to AWS.
:type location: str
:param location: The location of the new bucket. You can use one of the
constants in :class:`boto.s3.connection.Location` (e.g. Location.EU,
Location.USWest, etc.).
:type policy: :class:`boto.s3.acl.CannedACLStrings`
:param policy: A canned ACL policy that will be applied to the
new key in S3.
r z/<CreateBucketConfiguration><LocationConstraint>z1</LocationConstraint></CreateBucketConfiguration>�PUT)r� �datai� r� ) r r[ �
acl_headerrE rG r� r� r� �storage_create_errorr� rg r� )r rz r� �locationr� r� r� r� r r r �
create_bucketG s2
��
�
�
�zS3Connection.create_bucketc C s: | j d||d�}|�� }|jdkr| j�|j|j|��dS )a�
Removes an S3 bucket.
In order to remove the bucket, it must first be empty. If the bucket is
not empty, an ``S3ResponseError`` will be raised.
:type bucket_name: string
:param bucket_name: The name of the bucket
:type headers: dict
:param headers: Additional headers to pass along with the request to
AWS.
�DELETEr� �� N)r� r� r� r[ r� r� )r r! r� r� r� r r r �
delete_bucketv s
��zS3Connection.delete_bucketc
s� t || j�r |j}t |t�r|j}| j�||�}
tj�d|
� | j� ||�} tj�d| � | j�
| � � |�} |rV|
d| 7 }
tj�d|
� | d| 7 } tj�d| � t t
| �j||
||| | ||| d� S )Nzpath=%sz auth_path=%sr� )�override_num_retries�
retry_handler)rd rg r� r rV r' r1 �logrY r7 r% r� ri rT r� )
r r� r! r+ r� r� �
query_args�senderr� r� r6 r� rX ru r r r� � s(
�zS3Connection.make_request) r� NNNr� NNr� N)r r NFNNN)r r NTFNFNrA )TN)r r Nr NNNN) r9 r: r; rc r1 ra rb �DefaultCallingFormatr� rQ r rj r rk rx r{ r| r� r� r� r� rw r� r� r� ry rE rG r� r� r� �
__classcell__r r ru r rT � s` �#
�u
�
�
;
*
-
�
/�rT )#�xml.saxr� r� � boto.compatr r r~ � boto.authr �
boto.utilsr1 �boto.connectionr r �boto.s3.bucketr � boto.s3.keyr �boto.resultsetr �boto.exceptionr
r r r �objectr r= r@ rB rD rE rQ rS rT r r r r �<module> s.