dd8dZddlmZ ddlZddlmZddlmZdZgdZ Gd d eZ Gd d Z Gd dZ y#e $rdZY-wxYw)z@Lexical analysis of formal languages (i.e. code) using Pygments.)ApplicationErrorN)get_lexer_by_name)_get_ttype_classTF)tokentextc eZdZy) LexerErrorN)__name__ __module__ __qualname__>/usr/lib/python3/dist-packages/docutils/utils/code_analyzer.pyr r srr c$eZdZdZddZdZdZy)LexeraParse `code` lines and yield "classified" tokens. Arguments code -- string of source code to parse, language -- formal language the code is written in, tokennames -- either 'long', 'short', or 'none' (see below). Merge subsequent tokens of the same token-type. Iterating over an instance yields the tokens as ``(tokentype, value)`` tuples. The value of `tokennames` configures the naming of the tokentype: 'long': downcased full token type name, 'short': short name defined by pygments.token.STANDARD_TYPES (= class argument used in pygments html output), 'none': skip lexical analysis. c||_||_||_d|_|dvs|dk(ryts t d t |j|_y#tjj$rt d|zwxYw)zE Set up a lexical analyzer for `code` in `language`. N)rrnonez0Cannot analyze code. Pygments package not found.z6Cannot analyze code. No Pygments lexer found for "%s".) codelanguage tokennameslexer with_pygmentsr rpygmentsutil ClassNotFound)selfrrrs r__init__zLexer.__init__/s   $ | #zV'; ;< < M*4==9DJ}}** MACKLM M Ms A,Bc#Kt|}t|\}}|D]\}}||ur||z }||f||}}|jdr|dd}|r||fyyw)zrMerge subsequent tokens of same token-type. Also strip the final newline (added by pygments).  N)iternextendswith)rtokenslasttypelastvalttypevalues rmergez Lexer.mergeJs f"6l7" 5LE5 5 ''',e7  5   D !crlG G# # sAAc#K|jg|jfytj|j|j}|j |D]g\}}|j dk(r)t |jjd}n t|g}|Dcgc] }|tvs |}}||fiycc}ww)z7Parse self.code and yield "classified" tokens. Nlong.) rrrlexr*rstrlowersplitrunstyled_tokens)rr% tokentyper)classesclss r__iter__zLexer.__iter__\s :: dii-  dii4 $ 6 2 ! Iu&(i...066s;+I67&-LsO1KsLGL5.  ! MsB'C ) C7C;C N)short)r r r __doc__rr*r6rrrrrs&M6$$ !rrceZdZdZdZdZy) NumberLinesaqInsert linenumber-tokens at the start of every code line. Arguments tokens -- iterable of ``(classes, value)`` tuples startline -- first line number endline -- last line number Iterating over an instance yields the tokens with a ``(['ln'], '')`` token added for every code line. Multi-line tokens are split.cX||_||_dtt|z|_y)Nz%%%dd )r% startlinelenr/fmt_str)rr%r<endlines rrzNumberLines.__init__ys% "#c'l"33 rc#K|j}dg|j|zf|jD]K\}}|jd}|ddD]$}||dzf|dz }dg|j|zf&||dfMyw)Nlnr r!)r<r>r%r1)rlinenor(r)lineslines rr6zNumberLines.__iter__sfdllV+++ KK #LE5KK%Ecr  4TD[((! fdllV333 4r" "  #sAN)r r r r8rr6rrrr:r:ls $4 #rr:)r8docutilsrrpygments.lexersrpygments.formatters.htmlrr ImportErrorr2r rr:rrrrJsc G%19M   ! N!N!b##MsAA  A