jasy.style.tokenize package

Submodules

jasy.style.tokenize.Tokenizer module

class jasy.style.tokenize.Tokenizer.Token

Bases: builtins.object

assignOp

end

line

quote

start

type

unit

value

class jasy.style.tokenize.Tokenizer.Tokenizer(source, fileId='', line=1)

Bases: builtins.object

done()

find(anyOf)

get(scanOperand=False)

It consumes input only if there is no lookahead. Dispatches to the appropriate lexing function depending on the input.

getComments()

input_

lexDot(ch)

lexIdent(ch)

lexNumber(ch)

lexOp(ch)

lexString(ch)

lexUnit()

Parses units like %, cm, inch, px, etc.

lexZeroNumber(ch)

match(tokenType, scanOperand=False)

mustMatch(tokenType)

peek(scanOperand=False)

peekOnSameLine(scanOperand=False)

rewind(point)

save()

skip()

Eats comments and whitespace.

token

unget()

Match depends on unget returning undefined.

exception jasy.style.tokenize.Tokenizer.TokenizerError(message, fileId, line)

Bases: builtins.Exception

Module contents