Package | Description |
---|---|
parsii.tokenizer |
Modifier and Type | Method and Description |
---|---|
protected Char |
LookaheadReader.endOfInput() |
protected Char |
LookaheadReader.fetch() |
Modifier and Type | Method and Description |
---|---|
Token |
Token.addToContent(Char ch)
Adds the given Char to the content (and the source) but not to the trigger
|
Token |
Token.addToSource(Char ch)
Adds the given Char to the source of this token, but neither to the trigger nor to the content.
|
Token |
Token.addToTrigger(Char ch)
Adds the given Char to the trigger (and the source) but not to the content
|
static Token |
Token.createAndFill(Token.TokenType type,
Char ch)
Creates a new token with the given type, using the Char a initial trigger and content.
|
protected boolean |
Tokenizer.isIdentifierChar(Char current)
Determines if the given Char is a valid identifier part.
|
protected boolean |
Tokenizer.isSymbolCharacter(Char ch)
Determines if the given Char is a symbol character.
|
Copyright © 2020. All rights reserved.