B
A[VD @ s\ d Z ddlmZmZmZmZmZmZ ddlm Z m
Z
ddl m Z
mZ ddl mZ ddlm
Z
mZmZm
Z
mZmZ ddlZdd Zd4d
d Zd5d d
Zd6ddZdd Zdd Zdd Zdd Zd7ddZ e
j e
j e
j e
j e
j!fZ"e
j#e
j$fZ%dd Z&d8d d Z'd d Z(d d! Z)d"d# Z*d$d% Z+d&d' Z,d(d) Z-d*d+ Z.d,Z/d-Z0d.d/ Z1d0d1 Z2d9d2d3Z3dS ):z
Utility functions from 2to3, 3to2 and python-modernize (and some home-grown
ones).
Licences:
2to3: PSF License v2
3to2: Apache Software License (from 3to2/setup.py)
python-modernize licence: BSD (from python-modernize/LICENSE)
)
FromImportNewline is_import find_rootdoes_tree_importComma)LeafNode)python_symbolspython_grammar)token)r CallNamesymsr NumberNc s~ d kr S dr" dd fdd|D }t|dkr^tdd d
d |D nt|d krrtd
|d S dS )al
Examples:
>>> canonical_fix_name('fix_wrap_text_literals')
'libfuturize.fixes.fix_wrap_text_literals'
>>> canonical_fix_name('wrap_text_literals')
'libfuturize.fixes.fix_wrap_text_literals'
>>> canonical_fix_name('wrap_te')
ValueError("unknown fixer name")
>>> canonical_fix_name('wrap')
ValueError("ambiguous fixer name")
z.fix_Zfix_ Nc s g | ]}| d r|qS )zfix_{0})endswithformat).0f)fix G/opt/alt/python37/lib/python3.7/site-packages/libfuturize/fixer_util.py
( s z&canonical_fix_name.. zOAmbiguous fixer name. Choose a fully qualified module name instead from these:
c s s | ]}d | V qdS )z Nr )r Zmyfr r r - s z%canonical_fix_name..r z1Unknown fixer. Use --list-fixes or -l for a list.)
startswithlen
ValueErrorjoin)r Z avail_fixesfoundr )r r canonical_fix_name s
r" c C s t tjd| dS )N*)prefix)r r STAR)r$ r r r Star6 s r& c C s t tjd| dS )Nz**)r$ )r r
DOUBLESTAR)r$ r r r
DoubleStar9 s r( c C s t tjd| dS )N-)r$ )r r MINUS)r$ r r r Minus< s r+ c C s2 g }x"| D ]}| | | t q
W |d= |S )z{
Accepts/turns: (Name, Name, ..., Name, Name)
Returns/into: (Name, Comma, Name, Comma, ..., Name, Comma, Name)
)appendr )ZleafsZ new_leafsZleafr r r commatize? s
r. c C s| x"| j dk r"| j jtjkr"| j } qW | j dkr2dS | jtjkrD| jS | jdk rd| jjtjkrd| jjS | jdkrrdS | jS dS )zf
Returns the indentation for this node
Iff a node is in a suite, then it has indentation.
N ) parenttyper suiter INDENTvalueZ prev_siblingr$ )noder r r indentationK s
r6 c C s2 t | }tdd | D }|s&dS t|S dS )a
Dirty little trick to get the difference between each indentation level
Implemented by finding the shortest indentation string
(technically, the "least" of all of the indentation strings, but
tabs and spaces mixed won't get this far, so those are synonymous.)
c s s | ]}|j tjkr|jV qd S )N)r1 r r3 r4 )r ir r r r i s z#indentation_step..z N)r setZ pre_ordermin)r5 rZ all_indentsr r r indentation_step` s
r; c C s x | j D ]}|jtjkrdS qW x,t| j D ]\}}|jtjkr,P q,W tdttjt t
tj t |t
| g}| j |d }| d|_|| | | dS )zj
Turn the stuff after the first colon in parent's children
into a suite, if it wasn't already
NzNo class suite and no ':'!r r/ )childrenr1 r r2 enumerater COLONr r r r r3 r6 r; remover$ Z append_child)r0 r5 r7 r2 Zone_noder r r suitifyp s &
r@ c C sN |dkr d}t d|d| g}|dk rB|t dddt |ddg ttj|S )z
Accepts a package (Name node), name to import it as (string), and
optional prefix and returns a node:
import [as ]
Nr/ import)r$ as )r extendr r import_name)packageas_namer$ r< r r r
NameImport s rH c c s | j tkst| j}x2|j tjkrF|j}|j tjkr8P n|V |j}qW | j}|j tj ks^t|j}x|dk r||V |j}qfW |j}|j t
kr|}x |jdk r|jV |j}qW |j}|j}|dkrdS xF|j t
kr|j tj kr|V |j}|dkr|j}|j}|dkrP qW dS )z
Generator yields all nodes for which a node (an import_stmt) has scope
The purpose of this is for a call to _find() on each of them
N) r1
_import_stmtsAssertionError next_siblingr SEMINEWLINEr0 r simple_stmt_compound_stmtsr2 )r5 testZnxtr0 contextcpr r r import_binding_scope sB
rT c C sD t | }t ddd}t |dd}ttj|||g}|d k r@||_|S )NrB rC )r$ )r r r import_as_namer$ )namerG r$ new_nameZnew_asZ new_as_namenew_noder r r ImportAsName s rY c C s, | j tjko*t| jdko*| jd j tjkS )z<
Returns True if the node appears to be a docstring
r )r1 r rN r r< r STRING)r5 r r r is_docstring s r[ c C s t |}td| |rdS d}xNt|jD ]@\}}t|s@t|rD|}t|rNq(t|}|s\P | |kr(dS q(W tdt t
j | ddg}|dkr|dkr|jd j |_ d|jd _ |t
g}||ttj| dS )z
This seems to work
__future__NrC )r$ r r/ )r r r= r< is_shebang_commentis_encoding_commentr[ check_future_importr r r NAMEr$ r insert_childr r rN )featurer5 rootZshebang_encoding_idxidxnamesimport_r< r r r
future_import s(
rg c C s t |}td| |rdS d}xDt|jD ]6\}}|jtjkr(|jr(|jd jtjkr(|d }P q(W x>|j|d D ](}|jtj kr|d7 }qr|j
}d|_
P qrW d}t dt tj
| ddg}|t g}||ttj||d dS )zD
An alternative to future_import() which might not work ...
r\ Nr r r/ rC )r$ )r r r= r< r1 r rN r rZ rM r$ r r r` r ra r ) rb r5 rc
insert_posrd Z thing_afterr$ rf r< r r r future_import2 s(
ri c C s dd | D } t dd |D }x^t| D ]R\}}|jtjkrl|jd jtjkrl|jd j}|jd ||< q*|| }|||< q*W |S )z/
Parse a list of arguments into a dict
c S s g | ]}|j tjkr|qS r )r1 r COMMA)r r7 r r r r 2 s z parse_args..c S s g | ] }|d fqS )Nr )r kr r r r 4 s r r ) dictr= r1 r Zargumentr< r EQUALr4 )ZarglistschemeZ ret_mappingr7 argZslotr r r
parse_args. s rq c C s | j tjko | jo t| jd S )Nr )r1 r rN r< r )r5 r r r is_import_stmtH s rr c C s t |}t| ||rdS d}x dD ]}td||r"d}P q"W |rd\}}xNt|jD ]@\}}t|rT|}|} x$|r|j}| d7 } t|sn| }P qnW P qTW |dk st|dk st|}
n4x.t|jD ] \}}|jtj krP t
|sP qW |}
| dkrt tj t
tjdt
tj|d d
g} nt| t
tj|d d
g} |d krt tj t tjt
tjd t tjt
tjd t
tjd
gt tjt
tjdt
tjdggg} | t g}
ng }
| t g}|j|
j}d|j|
_||
t tj ||d
t|
dkr||
d t tj |
dS )a Works like `does_tree_import` but adds an import statement at the
top if it was not imported (but below any __future__ imports) and below any
comments such as shebang lines).
Based on lib2to3.fixer_util.touch_import()
Calling this multiple times adds the imports in reverse order.
Also adds "standard_library.install_aliases()" after "from future import
standard_library". This should probably be factored into another function.
NF)absolute_importdivisionprint_functionunicode_literalsr\ T)NNr rA rC )r$ Zstandard_library.Zinstall_aliases()r/ r )r r r= r< r_ rK rJ r1 r rN r[ r rE r r r` r ZpowertrailerDOTLPARRPARr r$ ra r )rF Zname_to_importr5 rc r! rV startendrd Zidx2rh rf Z
install_hooksZchildren_hooksZchildren_importZ
old_prefixr r r touch_import_topM sf
r c C sX | }| j tjkr| js t S | jd } | j tjkrRt| jd drR| jd jdksXt S | jd j tj krv| jd } n
| jd } | j tj
krt }xZ| jD ]P}|j tj kr| |j q|j tj
kr|jd }|j tj kst| |j qW |S | j tj
kr(| jd } | j tj ks tt| jgS | j tj krBt| jgS dsTtd| d S )
zZIf this is a future import, return set of symbols that are imported,
else return None.r r r4 r\ r Fzstrange import: %sN)r1 r rN r< r8 import_fromhasattrr4 r r| Zimport_as_namesr` addrU rJ )r5 Zsavenoderesultnr r r r_ s8
r_ z ^#!.*pythonz^#.*coding[:=]\s*([-\w.]+)c C s t tt| jS )z
Comments are prefixes for Leaf nodes. Returns whether the given node has a
prefix that looks like a shebang line or an encoding line:
#!/usr/bin/env python
#!/usr/bin/python3
)boolrematch
SHEBANG_REGEXr$ )r5 r r r r] s r] c C s t tt| jS )a
Comments are prefixes for Leaf nodes. Returns whether the given node has a
prefix that looks like an encoding line:
# coding: utf-8
# encoding: utf-8
# -*- coding: -*-
# vim: set fileencoding= :
)r r r ENCODING_REGEXr$ )r5 r r r r^ s
r^ c C sH t |dkstt |dkr2|\}}|t |g}n|}tt| ||dS )z
Example:
>>> wrap_in_fn_call("oldstr", (arg,))
oldstr(arg)
>>> wrap_in_fn_call("olddiv", (arg1, arg2))
olddiv(arg1, arg2)
>>> wrap_in_fn_call("olddiv", [arg1, comma, arg2, comma, arg3])
olddiv(arg1, arg2, arg3)
r rl )r$ )r rJ r r
r )Zfn_nameargsr$ Zexpr1Zexpr2Znewargsr r r wrap_in_fn_call s r )N)N)N)NN)N)N)4__doc__Zlib2to3.fixer_utilr r r r r r Zlib2to3.pytreer r Zlib2to3.pygramr
r r r r
r r r r" r& r( r+ r. r6 r; r@ rH Zif_stmtZ
while_stmtZfor_stmtZtry_stmtZ with_stmtrO rE r rI rT rY r[ rg ri rq rr r r_ r r r] r^ r r r r r s> "
;
( c*