|
Server : Apache System : Linux iad1-shared-b8-43 6.6.49-grsec-jammy+ #10 SMP Thu Sep 12 23:23:08 UTC 2024 x86_64 User : dh_edsupp ( 6597262) PHP Version : 8.2.26 Disable Function : NONE Directory : /lib/python3/dist-packages/S3/__pycache__/ |
Upload File : |
o
�Qaj � @ s� d dl mZ d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl
Z
d dlm Z m Z ddl
mZ z
d dlZd dlZW n ey[ ej�d� ej�� e�e� Y nw zd dlZW n eyq d dlmZ Y nw zd dlmZm Z m Z m Z m Z W n ey� d dl mZm Z m Z m Z m Z Y nw ddl!m"Z" dd l#m#Z# dd
l$m%Z%m&Z&m'Z'm(Z(m)Z) ze* W n e+y� e,Z*Y nw d d � Z-d
d� Z.dd� Z/G dd� de0�Z1G dd� de0�Z G dd� de0�Z2dS )� )�absolute_importN)�debug�warning� )� EX_OSFILEa:
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
ImportError trying to import dateutil.parser and dateutil.tz.
Please install the python dateutil module:
$ sudo apt-get install python-dateutil
or
$ sudo yum install python-dateutil
or
$ pip install python-dateutil
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
)�
NoOptionError�NoSectionError�MissingSectionHeaderError� ParsingError� ConfigParser)�Progress)�
SortedDict)�s3_quote�getTreeFromXml�getDictFromTree�base_unicodise�dateRFC822toPythonc C s4 t | �tkr | �� dv S t | �tkr| dkrdS dS )zsCheck to see if a string is true, yes, on, or 1
value may be a str, or unicode.
Return True if it is
)�true�yes�on�1TF��type�unicode�lower�bool��value� r �+/usr/lib/python3/dist-packages/S3/Config.py� is_bool_trueI �
r c C s4 t | �tkr | �� dv S t | �tkr| dkrdS dS )ztCheck to see if a string is false, no, off, or 0
value may be a str, or unicode.
Return True if it is
)�false�no�off�0FTr r r r r �
is_bool_falseX r! r& c C s t | �pt| �S )z)Check a string value to see if it is bool)r r& r r r r �is_boolg s r' c @ s, e Zd ZdZg Zi ZdZdZdZdZ dZ
dZ dZ dZ
dZdZdZejZej�� ZejZdZdZ d Z d Z d Z e dd
�Z!d Z"d Z#dZ$d Z%d Z&dZ'd Z(d Z)d Z*d Z+dZ,g Z-g Z.dZ/d
Z0d Z1d Z2dZ3dZ4g d�Z5d Z6d Z7d Z8dZ9dZ:ded< d Z;dZ<dZ=dZ>dZ?dZ@dZAdZBdZCdZDdZEdZFdZGdZHdZIdZJdZKdZLdZMdZNddgZOg ZPg ZQi ZRi ZSeT�U� p�dZVd ZWdZXd ZYdZZd Z[d Z\d Z]d Z^dZ_d Z`dZad Zbg Zcg ZddZedZfg ZgdZhdZidZjd Zkd Zld Zmd ZndZodZpd Zqd Zrd Zsd!Ztd ZudZvd"Zwd5d#d$�Zxd5d%d&�Zyd'd(� Zzd)d*� Z{d+d,� Z|d-d.� Z}d/d0� Z~d1d2� Zd3d4� Z�dS )6�ConfigN� Tzs3.amazonaws.comz%(bucket)s.s3.amazonaws.comzsdb.amazonaws.comzcloudfront.amazonaws.comi F)� ignore_caser �Standardi8 ) �uname�uid�gname�gid�atime�mtime�ctime�mode�md5���z@[sync] Remove remote S3 objects when local file has been deleted�delete_removedz}%(gpg_command)s -c --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)sz}%(gpg_command)s -d --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s�USzbinary/octet-stream� i i' �sizer4 �UTF-8�normali, z
index.htmlz8http://%(bucket)s.s3-website-%(location)s.amazonaws.com/r �d � c C s | j d u r t�| �| _ | j S �N)� _instance�object�__new__)�self�
configfile�
access_key�
secret_key� access_tokenr r r rA � s
zConfig.__new__c C s. |r�z| � |� W n ty dtjv sdtjv r | �� Y nw |r+|r+|| _|| _|r3|| _d| _t | j�dkryt�
d�pCt�
d�}t�
d�pMt�
d�}t�
d �pWt�
d
�}|ru|s`t d ��t |�| _t |�| _|rtd| _t |�| _n| �
� | jr�| jd kr�td
� | jr�| jd kr�td��d S d S d S )N�AWS_CREDENTIAL_FILE� AWS_PROFILEFr �AWS_ACCESS_KEY�AWS_ACCESS_KEY_ID�AWS_SECRET_KEY�AWS_SECRET_ACCESS_KEY�AWS_SESSION_TOKEN�AWS_SECURITY_TOKENzRAWS_ACCESS_KEY environment variable is used but AWS_SECRET_KEY variable is missingTz�Cannot have server_side_encryption (S3 SSE) and KMS_key set (S3 KMS). KMS encryption will be used. Please set server_side_encryption to FalsezFKMS encryption requires signature v4. Please set signature_v2 to False)�read_config_file�IOError�os�environ�aws_credential_filerD rE rF �_access_token_refresh�len�getenv�
ValueErrorr � role_config�kms_key�server_side_encryptionr � signature_v2� Exception)rB rC rD rE rF �env_access_key�env_secret_key�env_access_tokenr r r �__init__� sH ���
��'zConfig.__init__c C s� �zSt j�d�}|r�dtt�� � }dd||d�}t j�d�}|rAt|�� }|�� }W d � n1 s4w Y d|d < ||d
< d �d d
� |�� D ��}t j
ddd�}|� dd| � |� � } | �� }
| j
dkr�t|
�dkr�t|
�} t| �} | jdkr�| d d }
n| jdkr�| d d }
ntd| j ��t� �d|
d � t� �d |
d � t� �d |
d � tt|
d! ��}|tjd"d#� | _tj�tj � � �| _ W dS t�t j d$dd�}|� d%d&� |� � } | �� }| j
dk�rSt|�dk�rS|� d%d'|� d(� � |� � } | j
dk�rQt| �� �}
t!�"|
�}
t� �dt|
d �� t� �d t|
d �� t� �d t|
d) �� tt|
d! ��}|tjd"d#� | _tt|
d* ��| _ W dS t�t� � )+zL
Get credentials from IAM authentication and STS AssumeRole
� AWS_ROLE_ARNzrole-session-%s�
AssumeRolez
2011-06-15)�Action�Version�RoleArn�RoleSessionName�AWS_WEB_IDENTITY_TOKEN_FILEN�AssumeRoleWithWebIdentityrc �WebIdentityToken�&c S s$ g | ]\}}d |t |dd�f �qS )z%s=%sT)�unicode_output)r )�.0�k�vr r r �
<listcomp>= s ��z&Config.role_config.<locals>.<listcomp>zsts.amazonaws.com� )�host�timeout�POSTz/?�� r �AssumeRoleResponse�AssumeRoleResult� Credentials�!AssumeRoleWithWebIdentityResponse� AssumeRoleWithWebIdentityResultz.Unexpected XML message from STS server: <%s />rD � AccessKeyIdrE �SecretAccessKeyrF � SessionToken�
Expirationr8 )�minutesz169.254.169.254�GETz+/latest/meta-data/iam/security-credentials/z-/latest/meta-data/iam/security-credentials/%szutf-8�Token� LastUpdated)#rQ rR �get�int�time�open�read�join�items�httplib�HTTPSConnection�request� getresponse�statusrU r r �tagrP r( �
update_optionr r �datetime� timedelta�_access_token_expiration�now�dateutil�tz�tzutc�_access_token_last_update�HTTPConnection�decode�json�loads)rB �role_arn�role_session_name�params�web_identity_token_file�f�web_identity_token�encoded_params�conn�resp� resp_content�tree� result_dict�creds�
expiration�filesr r r rX ) s| �
�
��
�
zConfig.role_configc C sl | j r4tj�tj�� �}| jr || jk r | jr | j|kr d S z| �� W d S t y3 t
d� Y d S w d S )NzCould not refresh role) rT r� r� r� r� r� r� r� rX r\ r )rB r� r r r � role_refreshu s
�
��zConfig.role_refreshc
s z�t j�d�� t j�d�}|rt j�|�rt|�� n t j�� �s#W d S t� �td� � t j
� dt | dd�d�� }|� � }W d � n1 sGw Y z"z
��
t �|�� W n tyl d| }��
t �|�� Y nw W n ty� } z
td � t|�f ��d }~ww tt j�d
d ��}td | � d� �fdd� }||dd�}|r�t� �dt|�� ||dd�}|r�t� �dt|�� ||dd d�} | r�t� �dt| �� W d S W d S ty� }
ztd|
j� � W Y d }
~
d S d }
~
w t�y }
z
td|� � W Y d }
~
d S d }
~
ww ) Nz~/.aws/credentialsrG z Reading AWS credentials from %s�r�encodingr: �r� z
[default]
z*Error reading aws_credential_file (%s): %srH �defaultzUsing AWS profile '%s'Tc
s� d }z�� | |�}W nC tyM } z7|r td|j|j� � |rCz|}d} �� | |�}td|� W n tyB } zW Y d }~nd }~ww W Y d }~nd }~ww |rWtd|| � � |S )NzLCouldn't find key '%s' for the AWS Profile '%s' in the credentials file '%s'r� z�Legacy configuratin key '%s' used, please use the standardized config format as described here: https://aws.amazon.com/blogs/security/a-new-and-standardized-way-to-manage-credentials-in-the-aws-sdks/zWFound the configuration option '%s' for the AWS Profile '%s' in the credentials file %s)r� r r �option�sectionr )�profile�key�
legacy_key�
print_warning�result�e�rS �configr r �get_key� s8
� � �����z+Config.aws_credential_file.<locals>.get_key�aws_access_key_id�AWSAccessKeyIdrD �aws_secret_access_key� AWSSecretKeyrE �aws_session_tokenFrF z&Errno %d accessing credentials file %sz;Couldn't find AWS Profile '%s' in the credentials file '%s')T)rQ �path�
expanduserrR r� �isfiler �PyConfigParserr �ior� �getattrr� �readfp�StringIOr r
rW �strr( r� rP r �errnor ) rB �credential_file_from_env�fp�
config_string�excr� r� �profile_access_key�profile_secret_key�profile_access_tokenr� r r� r rS � s�
�
�
� ��
���� �����
�������zConfig.aws_credential_filec C sT g }t | �D ]!}ttt|��}|�d�s!|td�td�td�fvr"q|�|� q|S )N�_�string�* T)�dirr r� r( �
startswith�append)rB �retvalr� � option_typer r r � option_list� s
� zConfig.option_listc C s� t |�}| �� D ]}|�|�}|d ur|�� }| �||� q|�d�r,| �d|�d�� |�d�rM|�d��d�D ]}|�dd�\}}|�� | j|�� < q9| j�|� d S )N�
acl_public� add_headers�,�:r ) r r� r� �stripr� �split�
extra_headers�
_parsed_filesr� )rB rC �cpr� �_optionr� r r r r rO � s
zConfig.read_config_filec C s t |��d| � d S )Nr� )� ConfigDumper�dump�rB �streamr r r � dump_config s zConfig.dump_configc C s |d u rd S t |��d�r| �|t�|dd � ��S |dkrTzt|�}W n� tyS zztj| }W n t yA tj
| }Y nw W n
t yP td| ��w Y n�w |dkr�|� d�sb|� d�red}n|� d �so|� d
�rrd }nd }z|r�t|d d
� �|> p�t|�}W nw t
y� td||f ��w ttt|��td�u s�tt|�d u r�t|�r�t|�r�d}nKt|�r�d}nDtd||f ��ttt|��td�u r�zt|�}W n* ty� td||f ��w |dv r�|�d�r�|dd � }n |�d�r�|dd � }tt||� d S )N�$r � verbosityz)Config: verbosity level '%s' is not valid� limitraterm �K�
�m�M� r r5 zFConfig: value of option %s must have suffix m, k, or nothing, not '%s'TFz8Config: value of option '%s' must be Yes or No, not '%s'r� z9Config: value of option '%s' must be an integer, not '%s')� host_base� host_bucket�cloudfront_hostzhttp://� zhttps://� )r r� r� rQ rV r� rW �logging� _levelNames�AttributeError� _nameToLevel�KeyError�endswithr\ r r� r( r' r r& �setattr)rB r� r �shiftr r r r� sd �� ��� $ � �
zConfig.update_option)NNNN)��__name__�
__module__� __qualname__r? r� �_docrD rE rF rT r� r� r� r� rY �
simpledb_hostr� r� �WARNINGr� �sys�stdout�isatty�progress_meterr �
ProgressCR�progress_class�
send_chunk�
recv_chunk�list_md5� long_listing�human_readable_sizesr
r� �forcerZ �enable� get_continue� put_continue� upload_id�
skip_existing� recursive� restore_days�restore_priorityr� �
acl_grants� acl_revokes�
proxy_host�
proxy_port�encrypt�dry_run�add_encoding_exts�preserve_attrs�preserve_attrs_listr6 � delete_after�delete_after_fetch�
max_delete�limit�
delay_updates�gpg_passphrase� gpg_command� gpg_encrypt� gpg_decrypt� use_https�
ca_certs_file�ssl_client_key_file�ssl_client_cert_file�check_ssl_certificate�check_ssl_hostname�bucket_location�default_mime_type�guess_mime_type�use_mime_magic� mime_type�enable_multipart�multipart_chunk_size_mb� multipart_copy_chunk_size_mb�multipart_max_chunks� sync_checks�exclude�include�
debug_exclude�
debug_include�locale�getpreferredencodingr� �urlencoding_mode�log_target_prefix�reduced_redundancy�
storage_class�follow_symlinks�socket_timeout�invalidate_on_cf� invalidate_default_index_on_cf�#invalidate_default_index_root_on_cf�
website_index�
website_error�website_endpoint�additional_destinations�
files_from�
cache_filer� �remove_headers� expiry_days� expiry_date�
expiry_prefixr[ r� �requester_pays�
stop_on_error�content_disposition� content_type�stats�use_http_expect�signurl_use_https� throttle_max�public_url_use_https�connection_pooling�connection_max_agerA r` rX r� rS r� rO r� r� r r r r r( l s�
+La r( c @ s> e Zd Zg fdd�Zg fdd�Zdd� Zdd� Zd d
d �Zd S )
r c C s i | _ | �||� d S r> )�cfg�
parse_file)rB �file�sectionsr r r r` J s zConfigParser.__init__c C s� t d| � t|�tg �kr|g}d}t�d�}t�d�}t�d�}t�d�}t�d�}tj|d| �d d
�d ���} | D ]�}
|�|
�sG|�|
�rHq;|�|
�} | r`| �� d } | |v p^t |�d k}q;|�|
�}
|
r�|r�|
�
� }|�|d
�r~|d
dd� |d
< | � |d |d
� |d dv r�d|d
d d� t |d
�d |d
dd � f }n|d
}t d|d |f � q;t d||
f � q;W d � d S 1 s�w Y d S )Nz ConfigParser: Reading file '%s'Tz^\s*#.*z^\s*$z
^\[([^\]]+)\]z$^\s*(?P<key>\w+)\s*=\s*(?P<value>.*)z ^"(.*)"\s*$r� r� r: r� r r r r5 r� )rD rE r& z%s...%d_chars...%srp � zConfigParser: %s->%sz!Ignoring invalid line in '%s': %s)
r r �re�compiler� r� r� �match�groupsrU � groupdict� __setitem__r )rB r` ra �in_our_section� r_comment�r_empty� r_section�r_data�r_quotesr� �line�
is_sectionr� �is_data�data� print_valuer r r r_ N s@
4�"�zConfigParser.parse_filec C s
| j | S r> �r^ )rB �namer r r � __getitem__o �
zConfigParser.__getitem__c C s || j |< d S r> rt )rB ru r r r r rh r s zConfigParser.__setitem__Nc C s || j v r
| j | S |S r> rt )rB ru r� r r r r� u s
zConfigParser.getr> )r� r� r r` r_ rv rh r� r r r r r I s !r c @ s e Zd Zdd� Zdd� ZdS )r� c C s
|| _ d S r> )r� r� r r r r` { rw zConfigDumper.__init__c C s� | j �d| � |�� D ]<}t||�}|dkr>t|t�r>zztj| }W n ty2 tj | }Y nw W n t
y= Y nw | j �d||f � q d S )Nz[%s]
r� z%s = %s
) r� �writer� r� �
isinstancer� r� r� r� � _levelToNamer� )rB r� r� r� r r r r r� ~ s"
�� ��zConfigDumper.dumpN)r� r� r r` r� r r r r r� z s r� )3�
__future__r r� r� r> rc rQ r� r r� r� r r � ExitCodesr �dateutil.parserr� � dateutil.tz� ImportError�stderrrx �flush�exitr� � http.client�client� configparserr r r r
r r� r) r r
� BaseUtilsr r r r r r � NameErrorr� r r& r' r@ r( r� r r r r �<module> s^
� � � � `1