e44PdZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z m Z m Z mZejdk\rddl mZnddlmZddlmZdd lmZed Zed Zed Zej4Zej8d GddZededefdZde dee effdZ!de dede fdZ"de dee e effdZ#de de de fdZ$de dee e effdZ%de dee e effdZ&de de ede fdZ'dejPdeejRfd Z*d!e ejPde e fd"Z+ej8d Gd#d$Z,Gd%d&ejZZ.ej8d Gd'd(Z/Gd)d*ejZZ0y)+z)Functions to process IPython magics with.N) lru_cache) find_spec)DictListOptionalTuple) ) TypeGuard)out)NothingChanged)zget_ipython().run_cell_magiczget_ipython().systemzget_ipython().getoutputzget_ipython().run_line_magic) ENDMARKERNLNEWLINECOMMENTDEDENTUNIMPORTANT_WS ESCAPED_NL)captureprunpypypythonpython3timetimeitT)frozenc"eZdZUeed<eed<y) ReplacementmasksrcN)__name__ __module__ __qualname__str__annotations__;/usr/lib/python3/dist-packages/black/handle_ipynb_magics.pyrr/s I Hr'rwarnreturnc`tdduxr tddu}|s|r d}t||S)N tokenize_rtIPythonz}Skipping .ipynb files as Jupyter dependencies are not installed. You can fix this by running ``pip install "black[jupyter]"``)rr )r) installedmsgs r("jupyter_dependencies_are_installedr05sF - ,Q91ET1Q  K  C r'r cddlm}m}m}||}d}||D]<\}}|jt vr|jdk(r|j dk(r||=d}n|s|dfS||dfS)aRemove trailing semicolon from Jupyter notebook cell. For example, fig, ax = plt.subplots() ax.plot(x_data, y_data); # plot data would become fig, ax = plt.subplots() ax.plot(x_data, y_data) # plot data Mirrors the logic in `quiet` from `IPython.core.displayhook`, but uses ``tokenize_rt`` so that round-tripping works fine. rreversed_enumerate src_to_tokens tokens_to_srcFOP;T)r,r3r4r5nameTOKENS_TO_IGNOREr )r r3r4r5tokenstrailing_semicolonidxtokens r(remove_trailing_semicolonr>Cs ML 3 F(0 U ::) )  :: %))s"2s !%   Ez  $ &&r'has_trailing_semicolonc|s|Sddlm}m}m}||}||D];\}}|jt vr|j |jdz||<n tddt||S)zPut trailing semicolon back if cell originally had it. Mirrors the logic in `quiet` from `IPython.core.displayhook`, but uses ``tokenize_rt`` so that round-tripping works fine. rr2r7)r z{INTERNAL ERROR: Was not able to reinstate trailing semicolon. Please report a bug on https://github.com/psf/black/issues. N) r,r3r4r5r8r9_replacer AssertionErrorr$)r r?r3r4r5r:r<r=s r(put_trailing_semicolon_backrCcs " LL 3 F(0  U ::) ) nnSn9s    L   }V$ %%r'c|g} tj|||fS#t$rYnwxYwddlm}|}|j |}t |\}}||z }|j |}t|\}}t|jt|jk7rt||z }||fS)zMask IPython magics so content becomes parseable Python code. For example, %matplotlib inline 'foo' becomes "25716f358c32750e" 'foo' The replacements are returned, along with the transformed code. r)TransformerManager) astparse SyntaxErrorIPython.core.inputtransformer2rEtransform_cellreplace_cell_magicsreplace_magicslen splitlinesr )r replacementsrEtransformer_manager transformedcell_magic_replacementsmagic_replacementss r( mask_cellrT{s')L! # L     B,.%44S9K+>{+K(K(++L%44[AK&4[&A#K# ; ! ! #$CNN,<(==&&L  $$s  ))magicc|sJtt|dzdz d}t|}d}||vr)t|}|dz }|dkDrtd|d||vr)t|dzt|kr|d}d|dS) aDReturn randomly generated token to mask IPython magic with. For example, if 'magic' was `%matplotlib inline`, then a possible token to mask it with would be `"43fdd17f7e5ddc83"`. The token will be the same length as the magic, and we make sure that it was not already present anywhere else in the cell. rdzINTERNAL ERROR: Black was not able to replace IPython magic. Please report a bug on https://github.com/psf/black/issues. The magic might be helpful: N.")maxrM TOKEN_HEXrB)r rUnbytesr=counters r( get_tokenr`s L5 Uq1$a (F f EG 3,&!1  S= //4g7   3, 5zA~E "'  ugQ<r'c<g}tj|}t}|j||j||fS|jj }t ||}|jt|||d|jj|fS)aNReplace cell magic with token. Note that 'src' will already have been processed by IPython's TransformerManager().transform_cell. Example, get_ipython().run_cell_magic('t', '-n1', 'ls =!ls\n') becomes "a794." ls =!ls The replacement, along with the transformed code, is returned. rr  ) rFrGCellMagicFindervisit cell_magicheaderr`appendrbody)r rOtreecell_magic_finderrgrs r(rKrKs"')L 99S>D')D!##+L   ) ) 0 0F S& !D 6:;V2'22778 9< GGr'cg}t}|jtj|g}t |j dD]\}}||j vrz|j |}t|dk7rtd|d|dj|dj}}t||} |jt| ||d|| z}|j|dj||fS) aoReplace magics within body of cell. Note that 'src' will already have been processed by IPython's TransformerManager().transform_cell. Example, this get_ipython().run_line_magic('matplotlib', 'inline') 'foo' becomes "5e67db56d490fd39" 'foo' The replacement, along with the transformed code, are returned. rX)startz#Expecting one magic per line, got: z< Please report a bug on https://github.com/psf/black/issues.rrbNrc) MagicFinderrerFrG enumeraterNmagicsrMrB col_offsetrUr`rhrjoin) r rO magic_findernew_srcsilineoffsets_and_magicsrqrUrs r(rLrLs$L=Lsyy~&HS^^-Q74 ## #!-!4!4Q!7 %&!+$9:L9MNRR #1%00"1%++JS%(D    5 A B $t+D 99X  ,,r'rOc`|D](}|j|j|j}*|S)zRemove replacements from cell. For example "9b20" foo = bar becomes %%time foo = bar )replacerr )r rO replacements r( unmask_cellr{s2$= kk+**KOO<= Jr'nodec,t|tjxryt|jtjxrSt|jj tj xr#|jj jdk(S)zCheck if attribute is IPython magic. Note that the source of the abstract syntax tree will already have been processed by IPython's TransformerManager().transform_cell. get_ipython) isinstancerF AttributevalueCallfuncNameid)r|s r(_is_ipython_magicrsf 4' 0 tzz388 , 0 tzz 1 0 JJOO  - / r'argscg}|D]9}t|tjsJ|j|j;|SN)rrFStrrhs)rstr_argsargs r( _get_str_argsr&sAH#sww''' Or'cHeZdZUeed<eeed<eed<edefdZy) CellMagicr8paramsrir*cp|jrd|jd|jSd|jS)Nz%% )rr8selfs r(rgzCellMagic.header4s5 ;; {!DKK=1 1DII;r'N)r!r"r#r$r%rpropertyrgr&r'r(rr.s/ I SM I    r'rcLeZdZdZddeeddfdZdejddfdZ y) rdagFind cell magics. Note that the source of the abstract syntax tree will already have been processed by IPython's TransformerManager().transform_cell. For example, %%time foo() would have been transformed to get_ipython().run_cell_magic('time', '', 'foo()\n') and we look for instances of the latter. Nrfr*c||_yr)rf)rrfs r(__init__zCellMagicFinder.__init__Os $r'r|cht|jtjr}t |jj r^|jj j dk(r;t|jj}t|d|d|d|_ |j|y)z)Find cell magic, extract header and body.run_cell_magicrrXrW)r8rriN) rrrFrrrattrrrrrf generic_visit)rr|rs r( visit_ExprzCellMagicFinder.visit_ExprRsz tzz388 ,!$**//2 $$(88 1D'T!WT!W4PQ7SDO 4 r'r) r!r"r#__doc__rrrrFExprrr&r'r(rdrd<s6$%8I#6%$% !sxx !D !r'rdc"eZdZUeed<eed<y)OffsetAndMagicrqrUN)r!r"r#intr%r$r&r'r(rr^s O Jr'rc`eZdZdZddZdej ddfdZdejddfdZ y) rnaVisit cell to look for get_ipython calls. Note that the source of the abstract syntax tree will already have been processed by IPython's TransformerManager().transform_cell. For example, %matplotlib inline would have been transformed to get_ipython().run_line_magic('matplotlib', 'inline') and we look for instances of the latter (and likewise for other types of magics). r*Nc@tjt|_yr) collections defaultdictlistrprs r(rzMagicFinder.__init__ys7B7N7Nt7T r'r|ct|jtjr%t |jj rt |jj}|jj jdk(r d|d}nj|jj jdk(rd|d}|dr:|d|dz }n.td|jj jd d |j|jjjt|jj||j|y ) a{Look for system assign magics. For example, black_version = !black --version env = %env var would have been (respectively) transformed to black_version = get_ipython().getoutput('black --version') env = get_ipython().run_line_magic('env', 'var') and we look for instances of any of the latter. getoutput!rrun_line_magic%rXrzUnexpected IPython magic zC found. Please report a bug on https://github.com/psf/black/issues.N)rrrFrrrrrrrBrplinenorhrrqrrr|rr s r( visit_AssignzMagicFinder.visit_Assign|s djj#(( +0A$**//0R 1Dzz##{2$q'm%%)99$q'm7QtAwi=(C$/ 0D0D/GHRR KK )) * 1 1tzz44c:  4 r'ct|jtjrKt |jj r+t |jj}|jj jdk(r;|ddk(r d|d}n|ddk(r d|d}nwd|d}|drj|d |dz }n^|jj jd k(r d |d}n2|jj jd k(r d |d}nt|j|jjjt|jj||j|y)aLook for magics in body of cell. For examples, !ls !!ls ?ls ??ls would (respectively) get transformed to get_ipython().system('ls') get_ipython().getoutput('ls') get_ipython().run_line_magic('pinfo', 'ls') get_ipython().run_line_magic('pinfo2', 'ls') and we look for instances of any of the latter. rrpinfo?rXpinfo2z??rrsystemrrz!!N)rrrFrrrrrrr rprrhrrqrrs r(rzMagicFinder.visit_ExprsD& djj#(( +0A$**//0R 1Dzz##'777g%d1gY-C!W(tAwi.Cd1gY-CAw47)},%%1$q'm%%447)n$$ KK )) * 1 1tzz44c:  4 r')r*N) r!r"r#rrrFAssignrrrr&r'r(rnrnfs<$U!!!B'!sxx'!D'!r'rn)1rrFr dataclassessecretssys functoolsrimportlib.utilrtypingrrrr version_infor typing_extensions black.outputr black.reportr frozensetTRANSFORMED_MAGICSr9PYTHON_CELL_MAGICS token_hexr] dataclassrboolr0r$r>rCrTr`rKrLr{exprrrrr NodeVisitorrdrrnr&r'r(rsO/  $..w +'       d#  $       '3'5d+;'@&S&$&3&0%%3%%5d;&7!78%%P3ss4HSHU3[0A+A%BH>&-&-c4 +<&< =&-RS[(9c$ CHH 3==)A SXX49d#   $  !coo!Dd#$^!#//^!r'