e] XddlZddlZddlmZmZddlmZmZmZm Z m Z m Z m Z m Z mZmZddlmZmZmZddlmZmZddlmZmZmZmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(ddl)m*Z*ddl+m,Z,dd l-m.Z.m/Z/e d Z0e1Z2e1Z3ee.e/fZ4eGd d Z5eGd dZ6eGddZ7eGddZ8de e0dee e2e0ffdZ9 d*de5de5de e.de:ddf dZ;ddde5deded"e6d#e1de:fd$Z?de5d%e.d#e1de:fd&Z@de5d'e.d#e1de:fd(ZAde5derrJ)rKr7r8s rM append_safezLine.append_safecsr  & &! +##::< !GHH{{tyy,>> K D| 4rNcvt|jdk(xr |jdjtk(S)z"Is this line a standalone comment?r)lenr1r>rrKs rMrRzLine.is_commentws14;;1$RQ)<)<@R)RRrNcpt|xr*|jdjtjk(S)zIs this line a decorator?r)r?r1r>r&ATrXs rM is_decoratorzLine.is_decorator|s*Dz=dkk!n11UXX==rNcLt|xrt|jdS)zIs this an import line?r)r?rr1rXs rMrzLine.is_imports Dz7i A77rNcLt|xrt|jdS)zIs this a with_stmt line?r)r?r r1rXs rMr zLine.is_with_or_async_with_stmts!DzH8QHHrNct|xrH|jdjtjk(xr|jdj dk(S)z Is this line a class definition?rclass)r?r1r>r&NAMEr@rXs rMis_classz Line.is_classsJ J 0 A##uzz1 0 A$$/ rNc|jxrA|jddtdDcgc]}ttj dc}k(Scc}w)zEIs this line a class definition with a body consisting only of "..."?N.)rar1ranger'r&DOTrK_s rM is_stub_classzLine.is_stub_classsN}} RS!1*/(6 %&DC 6 "  6 s!Ac |jd} |jd}|jtjk(xr|j dk(xsS|jtj k(xr4|duxr.|jtjk(xr|j dk(S#t$rYywxYw#t$rd}YwxYw)zBIs this a function definition? (Also returns True for async defs.)rFrVNdef)r1 IndexErrorr>r&r`r@ASYNC)rK first_leaf second_leafs rMis_defz Line.is_defs QJ *.++a.K5::-K*2B2Be2K OOu{{ * +4' +  EJJ. +!!U*      K s"B$B3$ B0/B03 CCc |jxr]|jddttjdgt dDcgc]}ttj dc}zk(Scc}w)zHIs this line a function definition with a body consisting only of "..."?N:rdre)rqr1r'r&rBrfrgrhs rM is_stub_defzLine.is_stub_defsf{{ t{{23/Dc4J3K*/(O %&DC O 4   O s!A,ct|xrt|jdk(xr|jxr|jdjt j k(xrf|jdjdk(xrH|jdjt jk(xr|jdjdk(S)zzIs this a class with no base classes but using parentheses? Those are unnecessary and should be removed. (rd)) r?rWr1rar>r&LPARr@RPARrXs rMrCzLine.is_class_paren_emptys J ,DKK A% ,  , A##uzz1 , A$$+  ,  A##uzz1  ,  A$$+ rNc|r*|jdjtjk7ry|jdj}|j dry|j dryy)z#Is the line a triple quoted string?rF)z"""z'''T)zr'''zr"""zR'''zR""")r1r>r&STRINGr@ startswith)rKr@s rM_is_triple_quoted_stringzLine._is_triple_quoted_strings\t{{1~**ell: A$$   N +   < =rNctj|jvr |jSt |xr#t |j d|jS)zIs the line a docstring?r)runify_docstring_detectionr-rr?rr1rXs rMrzLine.is_docstringsD  , ,DII =00 0DzEl4;;q>499EErNc|jDcgc]}|jc}jtjdkDScc}w)z Is the line a chained assignmentrV)r1r>countr&EQUALrKr7s rMis_chained_assignmentzLine.is_chained_assignments4'+kk2d 288EII2sAct|jdk(ry|jdjtjk(S)z/Does this line open a new level of indentation.rF)rWr1r>r&rBrXs rM opens_blockzLine.opens_blocks5 t{{ q {{2##u{{22rNfirst_leaf_matchesrct|jdk7ry|jd}|jtk7s |jy|duxs||jS)zIs this line converted from fmt off/skip code? If first_leaf_matches is not None, it only returns True if the first leaf of converted code matches. rVFrN)rWr1r>rfmt_pass_converted_first_leaf)rKrr7s rMis_fmt_pass_convertedzLine.is_fmt_pass_convertedsd t{{ q {{1~ II+ +119!T) -?  . ..  rNcP|jD]}|jtk(syy)z)If so, needs to be split before emitting.TF)r1r>rrs rMcontains_standalone_commentsz!Line.contains_standalone_commentss*KK Dyy.. rNctj|jdD]N\}}|tjk7rt |}t |dk(r4|D]}|j|syPy)zFChck if we have an implicit multiline string with comments on the linec|jSN)r>)r7s rMzGLine.contains_implicit_multiline_string_with_comments..s diirNrVTF) itertoolsgroupbyr1r&r~listrWcomments_after)rK leaf_typeleaf_group_iterator leaf_listr7s rM0contains_implicit_multiline_string_with_commentsz5Line.contains_implicit_multiline_string_with_commentss|.7.?.? KK// *I*ELL(01I9~"! &&t,  rNct} |jd}|jt||jt j k(s)|jt jk(r5|js)|jd}|jt|d}|jjD]-\}}|D]#}t|r|st|s||vryd}%/y#t$rYywxYw)Nrr<FT)setr1addidr>r&COMMAr|r@rmr2itemsrr)rK ignored_ids last_leaf comment_seenleaf_idr2comments rM$contains_uncollapsable_type_commentsz)Line.contains_uncollapsable_type_commentsse   BI OOByM *~~,%**,Y__ !KKO 9 . !%!4!4!6 $ GX# $"7+#27;#;6##  $ $)  sBC11 C=<C=cF|jsytd|jDd}tdt|jDd}||k(rL|jddD]:}|jj t |gD]}t |sy<y)NFc3TK|] }|jdk7s|j"ywrNlineno.0r7s rM z9Line.contains_unsplittable_type_ignore..Ds S4$++QRBR4;;S((rc3TK|] }|jdk7s|j"ywrrrs rMrz9Line.contains_unsplittable_type_ignore..Fs OTdkkQ>NT[[ Orr<T)r1nextreversedr2getrr)rK first_line last_linenoders rM!contains_unsplittable_type_ignorez&Line.contains_unsplittable_type_ignore3s{{S4;;SUVW  OXdkk%: OQR   " BC( $#}}00D2>$G-g6#$ $ rNc:td|jDS)Nc32K|]}t|ywr)rrs rMrz2Line.contains_multiline_strings..UsE&t,Es)anyr1rXs rMcontains_multiline_stringszLine.contains_multiline_stringsTsEEEErNclosingc|jtvr6|jr*|jdjtjk(sy|jtj k(ry|jtj k(r|j|jjtjk(r|jyt|j||jtjtj fr8|jJ|jjtjk(sJyy|jry|j"t|j||jsyy)zReturn True if we have a magic trailing comma, that is when: - there's a trailing comma here - it's not from single-element square bracket indexing - it's not a one-tuple rFT)brackets)r>rr1r&rRBRACERSQBparentr#traileropening_bracketrLSQB prev_sibling subscriptlistr)rKrs rMrGzLine.has_magic_trailing_commaWs  LL, ,  B$$ 3 <<5<< ' <<5:: %*NN''4<<7++7+++KK#jj%**5 ++777++00D4F4FFFF >>  " " .7N  # #Wdkk8 rNrc|jtk(r"|jjrd|_y|jt j k7ry|jst|_d|_y|jd}|jt jk(r|js|jrttt|jjdkrEt|s:t|jdkrt|_d|_y|jd}|jjt!|gj#|y)z0Add an inline or standalone comment to the line.Frrdrxr<T)r>rr3any_open_bracketsrDr&COMMENTr1r|r@rrWrrr2 setdefaultrrJ)rKrrs rMrIzLine.append_comments LL. .$$668GN <<5== ({{-GLGNKKO NNejj (OO  D))002349#G, 4;;!#1 !# BI   I3::7CrNcL|jjt|gS)z;Generate comments that should appear directly after `leaf`.)r2rrrs rMrzLine.comments_afters}}  D2..rNc|jj}|jjt|g}|jj t|jdgj |y)z@Remove the trailing comma and moves the comments attached to it.rN)r1popr2rrextend)rKtrailing_commatrailing_comma_commentss rMrHzLine.remove_trailing_commas]*"&--"3"3B~4F"K   DKKO!4b9@@ # rNcN|jj}|y|j}t|trG|j t jk(ry|j t jk(r t||}|duxr td|jDS)zAReturn True iff `leaf` is part of a slice with non-trivial exprs.NFc3@K|]}|jtvywr)r>r)rns rMrz,Line.is_complex_subscript..s3 +,AFF& &3 s) r3 get_open_lsqb next_sibling isinstancer(r>r# listmakerrrr pre_order)rKr7 open_lsqbsubscript_starts rMrEzLine.is_complex_subscripts((668  #00 ot ,##t~~5##t'9'99"/"Fd* s3 0?0I0I0K3 0  rN is_reversedc#Kttttgtt t tff|rtnt}||jD]u\}}t|jt|jz}d|jvry|j|D]}|t|jz }|||fwyw)zReturn an enumeration of leaves with their length. Stops prematurely on multiline strings and standalone comments.  N)rrr r'rr Indexenumerate_reversed enumerater1rWrDr@r)rKropindexr7lengthrs rMenumerate_with_lengthzLine.enumerate_with_lengths htn%xeTk0B'CC D"- 9 dkk? &KE4%DJJ7Ftzz!..t4 -#gmm,, -v% % &sCCct|j|j|j|j|j S)N)r-r.r4r5r6)r+r-r.r4r5r6rXs rMclonez Line.clones8** 00!22!%!:!:   rNcf|syd|jz}t|j}t|}|j||j }|D]}|t |z }tjj|jjD]}|t |z }|dzS)zRender the line.rz ) r.iterr1rrDr@strrchain from_iterabler2values)rKindentr1firstresr7rs rM__str__z Line.__str__s$**$dkk"V vhu{{m4 D 3t9 C  44T]]5I5I5KL G 3w< C TzrNcHt|jxs |jS)z/Return True if the line has leaves or comments.)r?r1r2rXs rM__bool__z Line.__bool__sDKK04==11rN)FFF)r:N)r:r+)=__name__ __module__ __qualname____doc__rr-r__annotations__r.intrr1rr'dictr2rLeafIDrr3r4r?r5r6r rJrTpropertyrRr[rr rarjrqrurCrrrrrrrrrrrrGrIrrHrErr rrrrrrrNrMr+r+1s=EE"D$"E3Nt4FDJ4).t)DHd64:%&D&+N&KO^K!OT!"d"+/(4./MR"%"%(,"%EI"% "%H55D5T5(SDSS>d>>8488IDII $   t     $ T    d     $  FdFF JtJJ3T33IM %-hvt|.D%E  (d $ "d"H4BFDF***X#d#t#J/4/DJ/   $ (#(&& %tS() *&*  2$2rNr+cDeZdZUdZeed<eed<eed<eed<eed<y) RHSResultz2Intermediate split result from a right hand split.headbodytailrclosing_bracketN)rrrrr+rr'rrNrMrrs < J J JrNrceZdZUdZeed<eded<eed<dZe ed<e e Z e eed<dZe ed <d Zeed <d e efd Zy) LinesBlockzClass that holds information about a block of formatted lines. This is introduced so that the EmptyLineTracker can look behind the standalone comments and adjust their empty lines for class or def lines. r-previous_block original_linerbeforer/ content_linesafterF form_feedr:ctt|j}t|j|j |}|g|j z||jzgzS)N)r-)rr+r-r!r rr r)rK empty_linerDs rM all_lineszLinesBlock.all_linessO499-. #DKKLx$,,, TZZ0G/HHHrNN)rrrrrrr r+r rrrr rrrrr?rrrNrMr r s` J\**FCO$T:M49:E3NItI49IrNr c eZdZUdZeed<dZeeed<dZ ee ed<e e Z eeed<dZee ed<d ed e fd Zd ed eeeffd Zd ed eded eeeffdZy)EmptyLineTrackera{Provides a stateful method that returns the number of potential extra empty lines needed before and after the currently processed line. Note: this tracker works on lines that haven't been split yet. It assumes the prefix of the first leaf consists of optional newlines. Those newlines are consumed by `maybe_empty_lines()` and included in the computation. r-N previous_liner r/ previous_defssemantic_leading_comment current_liner:cr|jdk(xr2t|jxrd|jdjv}|j |\}}|j r|j j nd}td||z }|j r||j j ft|j jjdk(r:|j jjr|js|jsd}t|j|j ||||}|jrP|j <|j j"sC|j jr|r+|j$|r||_n|j"r|rd|_||_||_|S)zReturn the number of extra empty lines before and after the `current_line`. This is for separating `def`, `async def` and `class` with extra empty lines (two on module-level). rz NrV)r-r r r rr)r.r?r1rD_maybe_empty_linesr rmaxrWr rrarqr r-rRrr[r)rKrrr rprevious_afterblocks rMmaybe_empty_linesz"EmptyLineTracker.maybe_empty_lines+s   ! # 8\(() 8,--a0777  // = 6:6I6I,,22qQ/0   ##22:D''55<<=B##11>>!**l.A.AF..&    " "!!)&&33++66&22:f05-**f,0D ))# rNcd}|jdk(r|jjrdnd}|jr>|jd}|jj d}t ||}d|_nd}t|}|j}d}|jr_|jdj|k\rC|jj}|jr|jdj|k\rC|js |jr|jj||jy|jrD|jjry|jjr|jjry||jJ|jjrN|jr|j sd}n|r)|js|jjr|rdnd}ne|rd}n`d}n]|rd}nX|sT|jrH|jdj"t$j&k(r|jdj(d vrd}nd}|j*s|js |jr|j-|||S|jj.rC|j.s7|j1t. s!||jjk(r|xsddfS|dfS) NrVrrxrrrrrrrV)withtryforwhileifmatchr)r.r-is_pyir1rDrminr?rrrqrarJrrrrjr>r&rBr@r[#_maybe_empty_lines_for_class_or_defrr)rKr max_allowedror user_had_newliner. previous_defs rMrz#EmptyLineTracker._maybe_empty_lines]s    "#yy//!QK   %,,Q/J&&,,T2F-F "J F<""   T%7%7%;%A%AU%J--113L  T%7%7%;%A%AU%J   ,"7"7    % %l 3    %  $ $!!**!!--$2D2D2K2K  #%%1 11yy((1K1KF<#6#64;M;M;T;T"2QFFFF$**$++B/44 C$++A.44MNFF  $ $ (;(;|?T?T;;f&6     ( ( ** 66)6T++111Ka!# #qyrNr r,c|jJ|jjr$|jjr |jryy|jj |j krM|jj s|jjr!|jjry|rddfSddfSd}|jjr|jj |j k(rr|dk(rm|j}|^|jR|jjj s2|jjjs|jdkr|}ny|jjr |j s|jj rt|jj |j krd}n|jj |j kDrd}n|jr|jjrd}nd}n|jj |j kDrd}nw|js |jr2|jjs|j r td|}n0d}n-d}n*|j rdnd}|jjr|sd}|8|j}|*t!|j||j"z |_ d}|dfS)Nr!r rVrrx)rr[r-r(rjr.rarqrRrr r rr r)rurr)rKrr r,comment_to_add_newlinesslcnewlinesr s rMr*z4EmptyLineTracker._maybe_empty_lines_for_class_or_defs!!---    * *yyL$>$>    # #l&8&8 8    ' '4+=+=+D+Dyy(12 2a2 28<    ) )""((L,>,>>! //C&&2**88AA**88DDJJ!O*-' 99  $$(:(:(C(C%%++l.@.@@ H''-- 0B0BB H!//D4F4F4T4T H H##))L,>,>>##|'@'@((//%% #1f~H !H(..qAH!!--6F " .4CCN)/66ANDXDXX(.{rN)rrrrrrrr r+r r rrrrrrr rrr?r*rrNrMrrs J$(M8D>(+/NHZ(/ %d ;M4:;59hz290d0z0dRtRc3hRhN N*-NAEN sCxNrNrsequencer:c#^Kt|dz }t|D] }||f|dz}yw)z;Like `reversed(enumerate(sequence))` if that were possible.rVN)rWr)r2relements rMrrs< MA EH%g  s+-new_lineold_liner1r8c|D]j}t|j|j}t|||j |||j |D]}|j |dly)a Append leaves (taken from @old_line) to @new_line, making sure to fix the underlying Node structure where appropriate. All of the leaves in @leaves are duplicated. The duplicates are then appended to @new_line and used to replace their originals in the underlying Node structure. Any comments attached to the old leaves are reattached to the new leaves. Pre-conditions: set(@leaves) is a subset of set(@old_line.leaves). rPTN)r'r>r@r"rJr)r5r6r1r8old_leafnew_leaf comment_leafs rM append_leavesr; sk= x~~6h)|<$33H= =L OOLtO < = =rNr)line_strliner-r<c|s t|}tj|vr1t||jkxrd|vxr|j S|j ryd|vrt||jkS|j d^}}}t||jkDst||jkDryg}d}g}tj} t|jD]\} } | tjk(rd} | jdzt|kDr|jdn+| jdzt|kr|j} | 1|/|j| jdzk(r| j} | dkDry| j| kre| jt j"k(rHdg} | |z } | j$| vr| t|jdz k(s|| jxxdz cc<| tjk7rt'| | j} t)| sQt|dkDry| }| }t+||vst|j||j,|j,}t+||vr9t|dk(ryt/d|DS)aFor non-multiline strings, return True if `line` is no longer than `line_length`. For multiline strings, looks at the context around `line` to determine if it should be inlined or split up. Uses the provided `line_str` rendering, if any, otherwise computes a new one. rFNrVrTc3&K|] }|dk( ywrr)rvals rMrz'is_line_short_enough..xs*Csax*s)line_to_stringrmultiline_string_handlingr% line_lengthrsplitmathinfrr1 bracket_depthrWrJrr>r&rrr)rrrall)r=r-r<rrilastcommasmultiline_stringmultiline_string_contextsmax_level_to_updateir7 had_comma ignore_ctxsctxs rMis_line_short_enoughrR"s !$'((4 h 4#3#3 3 8H$ 85577  ((* 8"d&6&666nnT*OEAt$***io@P@P.PF'+*,-1XXT[[)'!4 $(( *'+I!!A%F 3 a ##a'#f+5"JJL %$0$22d6H6H16LL'+&8&8#q=   !4 4ekk9Q04fK 4 4K%%4c$++>NQR>R9Rt))*a/* $(( *"%&94;M;M"N  t $,-1# Cc(h&)005::%jj c(h&G'!V $%* *6* **rNcb|j}t|dkry|djtjk(r|djtj k(rd}d}|d}|dddD]}|jt vr|jtvry|dz }n|jtj k(r|dz }nb|jtjk(r1|jtj k(s(|jt vsy|jtvry|dkDs|dkDsyy) zReturn False if the line cannot be split *for sure*. This is not an exhaustive search but a cheap heuristic that we can use to avoid some unfortunate formattings (mostly around wrapping unsplittable code in unnecessary parentheses). rxFrrVrr<NT) r1rWr>r&r~rgrrr`)r=r1 call_count dot_countrr7s rM can_be_splitrV{s[[F 6{Q ay~~%&)..EII*E  bz26r6N Dyy,,99$44 a eii'Q ejj( UYY.$))?O2O "221}a! $ rNrhsrCc|j}d}t|jD]i}|r||jurd}|jt k(r|sy|r/|jt vsB|j|jvs[|jsh|}k|j}|jsy|j}|j|}|dkDry|dk(r |tk(r|jjry|tk(ryt!|jdk\sJd|jd}|jd} |jt"vr!| jt vrt%|||ry|jd } |jd } | jt&j(k(sm| jt&j*k(sP| jt&j,k(ra| j.rU| j.jt0j2k7r.| jt"vryt5|ryt7|| | ryy) aDoes `rhs.body` have a shape safe to reformat without optional parens around it? Returns True for only a subset of potentially nice looking formattings but the point is to not return false positives that end up producing lines that are too long. NFTrVrxzStranded delimiterr)rrCr<r)rIrC)rrr1rr>rrr@r3 delimitersmax_delimiter_prioritydelimiter_count_with_priorityrrr rrWr_can_omit_opening_parenr&r|rrrr#rr_can_omit_closing_paren) rWrCr=rr7bt max_prioritydelimiter_countrsecond penultimaterIs rMcan_omit_invisible_parensrcs 88D'+O% # t'F'FF"O 99* *? --$$ 3 "O #   B ==,,.L66|DO! > )chh.Q.Q  |# t{{ q 6"66  KKNE [[^F zz%%&++=M*M "4u+ N ++b/K ;;r?D UZZ 99 $ II #    DLL0   / / u % "4d L rNrc d}d|jz}d}|jD]L\}}}|jtvr|j|urd}|s,||z }||kDry|jt vsKd}Nt |j|dzk(ryy) See `can_omit_invisible_parens`.FrwrTrV)r.rr>rrrrWr1)r=rrC remainderr_indexr7 leaf_lengths rMr\r\sI ^F F%)%?%?%A!k 99( (T-A-AU-JI  k !F # yy,,!  t{{ vz ) rNrIcd|jz}d}|jD]8\}}}||z }||jur |s||ks"y|jtvs7d}:y)rerwFT)r.rrr>r)r=rIrCrseen_other_bracketsrgr7rhs rMr]r]sq ^F%)%?%?%A'!k+ 4'' '"f &; YY* *"& ' rNc6t|jdS)zmReturns the string representation of @line. WARNING: This is known to be computationally expensive. r)rrA)r=s rMrArA*s t9??4  rNr)CrrE dataclassesrrtypingrrrrr r r r r rblack.bracketsrrr black.moderr black.nodesrrrrrrrrrrrrr r!r"r#r$ black.stringsr%blib2to3.pgen2r&blib2to3.pytreer'r(r)rrrLNr+rr rrr?r;rrRrVrcr\r]rArrNrMrus (   HG$&$ & CL   4: E2E2 E2P   II I* cc cL!%q/1JNS=="=,0J=FJ= =202V+ V+V+),V+ V+r!t!!H^ ^^ ^B$$ST2$CD"!!#!rN