|
Server : Apache System : Linux iad1-shared-b8-43 6.6.49-grsec-jammy+ #10 SMP Thu Sep 12 23:23:08 UTC 2024 x86_64 User : dh_edsupp ( 6597262) PHP Version : 8.2.26 Disable Function : NONE Directory : /lib/python3/dist-packages/jmespath/__pycache__/ |
Upload File : |
o
� �^�J � @ sp d Z ddlZddlmZ ddlmZ ddlmZ ddlmZ ddlmZ G dd � d e �Z
eG d
d � d e ��Z dS ) a� Top down operator precedence parser.
This is an implementation of Vaughan R. Pratt's
"Top Down Operator Precedence" parser.
(http://dl.acm.org/citation.cfm?doid=512927.512931).
These are some additional resources that help explain the
general idea behind a Pratt parser:
* http://effbot.org/zone/simple-top-down-parsing.htm
* http://javascript.crockford.com/tdop/tdop.html
A few notes on the implementation.
* All the nud/led tokens are on the Parser class itself, and are dispatched
using getattr(). This keeps all the parsing logic contained to a single
class.
* We use two passes through the data. One to create a list of token,
then one pass through the tokens to create the AST. While the lexer actually
yields tokens, we convert it to a list so we can easily implement two tokens
of lookahead. A previous implementation used a fixed circular buffer, but it
was significantly slower. Also, the average jmespath expression typically
does not have a large amount of token so this is not an issue. And
interestingly enough, creating a token list first is actually faster than
consuming from the token iterator one token at a time.
� N)�lexer)�with_repr_method)�ast)�
exceptions)�visitorc @ sB e Zd Zi dd�dd�dd�dd�dd�dd�dd�d d�d
d�d d�d d�d
d�dd�dd�dd�dd�dd�dddddddddd d d d � �Zd Zi Zd!Zd�d"d#�Zd$d%� Zd&d'� Z d(d)� Z
d�d*d+�Z d,d-� Z d.d/� Z
d0d1� Zd2d3� Zd4d5� Zd6d7� Zd8d9� Zd:d;� Zd<d=� Zd>d?� Zd@dA� ZdBdC� ZdDdE� ZdFdG� ZdHdI� ZdJdK� ZdLdM� Z dNdO� Z dPdQ� Z dRdS� Z dTdU� Z dVdW� Z!dXdY� Z"dZd[� Z#d\d]� Z$d^d_� Z%d`da� Z&dbdc� Z'ddde� Z(dfdg� Z)dhdi� Z*djdk� Z+dldm� Z,dndo� Z-dpdq� Z.drds� Z/d�dudv�Z0dwdx� Z1dydz� Z2d{d|� Z3d}d~� Z4dd�� Z5d�d�� Z6d�d�� Z7d�d�� Z8e9d�d�� �Z:dtS )��Parser�eofr �unquoted_identifier�quoted_identifier�literal�rbracket�rparen�comma�rbrace�number�current�expref�colon�pipe� �or� �and� �eq� �gt� � � �( �- �2 �7 �< ) �lt�gte�lte�ne�flatten�star�filter�dot�not�lbrace�lbracket�lparen�
� c C s" d | _ d g| | _|| _d| _d S �Nr )� tokenizer�_tokens� _buffer_size�_index)�self� lookahead� r: �1/usr/lib/python3/dist-packages/jmespath/parser.py�__init__N s
zParser.__init__c C sH | j �|�}|d ur |S | �|�}|| j |< t| j �| jkr"| �� |S �N)�_CACHE�get� _do_parse�len� _MAX_SIZE�_free_cache_entries)r8 �
expression�cached�
parsed_resultr: r: r; �parseT s
z Parser.parsec
C st z| � |�W S tjy } z||_� d }~w tjy) } z|�|� � d }~w tjy9 } z||_� d }~ww r= )�_parser �
LexerErrorrD �IncompleteExpressionError�set_expression�
ParseError)r8 rD �er: r: r; r@ ^ s �
���zParser._do_parsec C sr t �� �|�| _t| j�| _d| _| jdd�}| �� dks4| � d�}t
� |d |d |d d|d ��t ||�S )Nr )�
binding_powerr �start�value�typezUnexpected token: %s)
r �Lexer�tokenizer4 �listr5 r7 � _expression�_current_token�_lookahead_tokenr rL � ParsedResult)r8 rD �parsed�tr: r: r; rH k s
�
z
Parser._parsec C s� | � d�}| �� t| d|d | j�}||�}| �� }|| j| k rMt| d| d �}|d u r:| � d�}| �|� n | �� ||�}| �� }|| j| k s#|S )Nr z
_token_nud_%srQ z
_token_led_%s)rW �_advance�getattr�_error_nud_tokenrV �
BINDING_POWER�_error_led_token)r8 rN �
left_token� nud_function�left�
current_token�led� error_tokenr: r: r; rU v s$
�
� zParser._expressionc C � t �|d �S �NrP )r r �r8 �tokenr: r: r; �_token_nud_literal� � zParser._token_nud_literalc C rf rg )r �fieldrh r: r: r; � _token_nud_unquoted_identifier� rk z%Parser._token_nud_unquoted_identifierc C s@ t �|d �}| �� dkr | �d�}t�d|d |d d��|S )NrP r0 r rQ z1Quoted identifier not allowed for function names.)r rl rV rW r rL )r8 ri rl rZ r: r: r; � _token_nud_quoted_identifier� s
�z#Parser._token_nud_quoted_identifierc C s: t �� }| �� dkrt �� }n| �| jd �}t �||�S )Nr r* )r �identityrV �_parse_projection_rhsr^ �value_projection�r8 ri rb �rightr: r: r; �_token_nud_star� s
zParser._token_nud_starc C s | � t�� �S r= )�_token_led_filterr ro rh r: r: r; �_token_nud_filter� rk zParser._token_nud_filterc C s | � � S r= )�_parse_multi_select_hashrh r: r: r; �_token_nud_lbrace� � zParser._token_nud_lbracec C s | � � }| �d� |S )Nr
)rU �_match�r8 ri rD r: r: r; �_token_nud_lparen� s
zParser._token_nud_lparenc C s* t �t �� �}| �| jd �}t �||�S �Nr) )r r) ro rp r^ �
projectionrr r: r: r; �_token_nud_flatten� s
� zParser._token_nud_flattenc C � | � | jd �}t�|�S )Nr- )rU r^ r �not_expression)r8 ri �exprr: r: r; �_token_nud_not� �
zParser._token_nud_notc C sv | � � dv r| �� }| �t�� |�S | � � dkr7| �d�dkr7| �� | �� | �| jd �}t� t�� |�S | �
� S )N�r r r* r r ) rV �_parse_index_expression�_project_if_slicer ro �
_lookaheadr[ rp r^ r~ �_parse_multi_select_list)r8 ri rs r: r: r; �_token_nud_lbracket� s zParser._token_nud_lbracketc C sN | � d�dks| � d�dkr| �� S t�| �d�d �}| �� | �d� |S )Nr r r rP r )r� �_parse_slice_expressionr �indexrW r[ rz )r8 �noder: r: r; r� � s
z Parser._parse_index_expressionc C s� g d�}d}| � � }|dksS|dk rS|dkr,|d7 }|dkr'| �| �d�d� | �� n|dkr>| �d�d ||< | �� n | �| �d�d� | � � }|dksS|dk s| �d� tj|� S )
N)NNNr r r r r � syntax errorr rP )rV � _raise_parse_error_for_tokenrW r[ rz r �slice)r8 �partsr� rc r: r: r; r� � s*
�
��
z Parser._parse_slice_expressionc C s t �� S r= )r � current_noderh r: r: r; �_token_nud_current� ry zParser._token_nud_currentc C r� )Nr )rU r^ r r r{ r: r: r; �_token_nud_expref� r� zParser._token_nud_exprefc C sl | � � dks$| �| jd �}|d dkr |d �|� |S t�||g�S | �� | �| jd �}t�||�S )Nr* r, rQ �
subexpression�children) rV �_parse_dot_rhsr^ �appendr r� r[ rp rq �r8 rb rs r: r: r; �_token_led_dot� s � zParser._token_led_dotc C � | � | jd �}t�||�S )Nr )rU r^ r r r� r: r: r; �_token_led_pipe � zParser._token_led_pipec C r� )Nr )rU r^ r �
or_expressionr� r: r: r; �
_token_led_or r� zParser._token_led_orc C r� )Nr )rU r^ r �and_expressionr� r: r: r; �_token_led_and
r� zParser._token_led_andc C s� |d dkr | � d�}t�|d |d |d d|d ��|d }g }| �� dksC| �� }| �� dkr8| �d� |�|� | �� dkr)| �d� t�||�}|S ) NrQ rl ���rO rP zInvalid function name '%s'r
r ) rW r rL rV rU rz r� r �function_expression)r8 rb �prev_t�name�argsrD �
function_noder: r: r; �_token_led_lparen s"
�
�
zParser._token_led_lparenc C sH | � d�}| �d� | �� dkrt�� }n| �| jd �}t�|||�S )Nr r r) r+ )rU rz rV r ro rp r^ �filter_projection)r8 rb � conditionrs r: r: r; ru % s
zParser._token_led_filterc C � | � |d�S )Nr ��_parse_comparator�r8 rb r: r: r; �
_token_led_eq/ � zParser._token_led_eqc C r� )Nr( r� r� r: r: r; �
_token_led_ne2 r� zParser._token_led_nec C r� )Nr r� r� r: r: r; �
_token_led_gt5 r� zParser._token_led_gtc C r� )Nr& r� r� r: r: r; �_token_led_gte8 r� zParser._token_led_gtec C r� )Nr% r� r� r: r: r; �
_token_led_lt; r� zParser._token_led_ltc C r� )Nr' r� r� r: r: r; �_token_led_lte> r� zParser._token_led_ltec C s& t �|�}| �| jd �}t �||�S r} )r r) rp r^ r~ r� r: r: r; �_token_led_flattenA s
� zParser._token_led_flattenc C sx | � d�}|d dv r$| �� }|d dkr |d �|� |S | �||�S | �d� | �d� | �| jd �}t�||�S )Nr rQ r� �index_expressionr� r* r ) rW r� r� r� rz rp r^ r r~ )r8 rb ri rs r: r: r; �_token_led_lbracketG s
zParser._token_led_lbracketc C s6 t �||g�}|d dkrt �|| �| jd ��S |S )NrQ r� r* )r r� r~ rp r^ )r8 rb rs �
index_exprr: r: r; r� Z s �zParser._project_if_slicec C s | � | j| �}t�|||�S r= )rU r^ r �
comparator)r8 rb r� rs r: r: r; r� c s zParser._parse_comparatorc C sF g } | � � }|�|� | �� dkrn| �d� q| �d� t�|�S )NTr r )rU r� rV rz r �multi_select_list)r8 � expressionsrD r: r: r; r� g s
�
z Parser._parse_multi_select_listc C s� g } | � d�}| jddgd� |d }| �d� | �d�}tj||d�}|�|� | �� d kr6| �d � n | �� d
krB| �d
� nqtj|d �S ) NTr r
r )� token_typesrP r )�key_namer� r r )�nodes) rW �_match_multiple_tokensrz rU r � key_val_pairr� rV �multi_select_dict)r8 �pairs� key_tokenr� rP r� r: r: r; rw s s$
�
� z Parser._parse_multi_select_hashc C s� | j | �� | jk rt�� }|S | �� dkr | �|�}|S | �� dkr*| �|�}|S | �� dkr<| �d� | �|�}|S | �| � d�d� |S )Nr/ r+ r, r r� )
r^ rV �_PROJECTION_STOPr ro rU rz r� r� rW )r8 rN rs r: r: r; rp � s" �
�
�
��z Parser._parse_projection_rhsc C s� | � � }|dv r
| �|�S |dkr| �d� | �� S |dkr'| �d� | �� S | �d�}g d�}d||d f }| �||� d S )N)r
r r* r/ r. r )r
r r/ r. �Expecting: %s, got: %srQ )rV rU rz r� rw rW r� )r8 rN r9 rZ �allowed�msgr: r: r; r� � s
�zParser._parse_dot_rhsc C s6 |d dkrt �|d |d |d ��| �|d� d S )NrQ r rO rP �
invalid token)r rJ r� rh r: r: r; r] � s
�zParser._error_nud_tokenc C s | � |d� d S )Nr� )r� rh r: r: r; r_ � � zParser._error_led_tokenNc C s. | � � |kr | �� d S | �|| �d�� d S r3 )rV r[ � _raise_parse_error_maybe_eofrW )r8 �
token_typer: r: r; rz � s
�z
Parser._matchc C s* | � � |vr| �|| �d�� | �� d S r3 )rV r� rW r[ )r8 r� r: r: r; r� � s
� z Parser._match_multiple_tokensc C s | j d7 _ d S )Nr )r7 �r8 r: r: r; r[ � s zParser._advancec C s | j | j d S �NrQ �r5 r7 r� r: r: r; rV � r� zParser._current_tokenc C s | j | j| d S r� r� �r8 r r: r: r; r� � s zParser._lookaheadc C s | j | j| S r= r� r� r: r: r; rW � r� zParser._lookahead_tokenc C s( |d }|d }|d }t �||||��)NrO rP rQ )r rL )r8 ri �reason� lex_position� actual_value� actual_typer: r: r; r� � s �z#Parser._raise_parse_error_for_tokenc C sJ |d }|d }|d }|dkrt �|||��d||f }t �||||��)NrO rP rQ r r� )r rJ rL )r8 �
expected_typeri r� r� r� �messager: r: r; r� � s ���z#Parser._raise_parse_error_maybe_eofc C s4 t �| j�� t| jd ��D ] }| j�|d � qd S )Nr )�random�sampler> �keys�intrB �pop)r8 �keyr: r: r; rC � s �zParser._free_cache_entriesc C s | j �� dS )z'Clear the expression compilation cache.N)r> �clear)�clsr: r: r; �purge� s z Parser.purge)r )r r= );�__name__�
__module__� __qualname__r^ r� r> rB r< rG r@ rH rU rj rm rn rt rv rx r| r r� r� r� r� r� r� r� r� r� r� r� ru r� r� r� r� r� r� r� r� r� r� r� rw rp r� r] r_ rz r� r[ rV r� rW r� r� rC � classmethodr� r: r: r: r; r % s� �������� �
� � �
������"
r c @ s. e Zd Zdd� Zd
dd�Zdd� Zdd � ZdS ) rX c C s || _ || _d S r= )rD rY )r8 rD rY r: r: r; r< � s
zParsedResult.__init__Nc C s t �|�}|�| j|�}|S r= )r �TreeInterpreter�visitrY )r8 rP �options� interpreter�resultr: r: r; �search� s
zParsedResult.searchc C s t �� }|�| j�}|S )af Render the parsed AST as a dot file.
Note that this is marked as an internal method because
the AST is an implementation detail and is subject
to change. This method can be used to help troubleshoot
or for development purposes, but is not considered part
of the public supported API. Use at your own risk.
)r �GraphvizVisitorr� rY )r8 �renderer�contentsr: r: r; �_render_dot_file s
z ParsedResult._render_dot_filec C s
t | j�S r= )�reprrY r� r: r: r; �__repr__ s
zParsedResult.__repr__r= )r� r� r� r< r� r� r� r: r: r: r; rX � s
rX ) �__doc__r� �jmespathr �jmespath.compatr r r r �objectr rX r: r: r: r; �<module> s S