Package com.yahoo.vespa.indexinglanguage.parser

Class IndexingParserTokenManager

java.lang.Object

com.yahoo.vespa.indexinglanguage.parser.IndexingParserTokenManager

All Implemented Interfaces:

IndexingParserConstants

public class IndexingParserTokenManager
extends Object
implements IndexingParserConstants

Token Manager.

Field Summary

Fields

Modifier and Type	Field	Description
protected int	curChar
protected CharStream	input_stream
static final int[]	jjnewLexState	Lex State array.
static final String[]	jjstrLiteralImages	Token literal values.
static final String[]	lexStateNames	Lexer state names.

Fields inherited from interface com.yahoo.vespa.indexinglanguage.parser.IndexingParserConstants

ADD, ATTRIBUTE, BASE64_DECODE, BASE64_ENCODE, BINARIZE, BUSY_WAIT, CASE, CASE_DEFAULT, CHOICE, CHUNK, CLEAR_STATE, COLON, COMMA, COMMENT, CREATE_IF_NON_EXISTENT, DEFAULT, DIV, DOT, DOUBLE, ECHO, ELSE, EMBED, EOF, EQ, EXACT, FALSE, FLATTEN, FLOAT, FOR_EACH, GE, GENERATE, GET_FIELD, GET_VAR, GT, GUARD, HASH, HEX_DECODE, HEX_ENCODE, HOST_NAME, IDENTIFIER, IF, INDEX, INPUT, INTEGER, JOIN, KEEP_CASE, LCURLY, LE, LONG, LOWER_CASE, LPAREN, LT, MAX_LENGTH, MAX_OCCURRENCES, MAX_TOKEN_LENGTH, MOD, MUL, NE, NGRAM, NL, NORMALIZE, NOW, OPTIMIZE_PREDICATE, PACK_BITS, PASSTHROUGH, PIPE, RANDOM, RCURLY, REMOVE_IF_ZERO, RPAREN, SCOLON, SELECT_INPUT, SET_LANGUAGE, SET_VAR, SLEEP, SPLIT, STEM, STRING, SUB, SUBSTRING, SUMMARY, SWITCH, THIS, TO_ARRAY, TO_BOOL, TO_BYTE, TO_DOUBLE, TO_EPOCH_SECOND, TO_FLOAT, TO_INT, TO_LONG, TO_POS, TO_STRING, TO_URI, TO_WSET, tokenImage, TOKENIZE, TRIM, TRUE, UNDERSCORE, ZCURVE

Constructor Summary

Constructors

Constructor	Description
IndexingParserTokenManager(CharStream stream)	Constructor.
IndexingParserTokenManager(CharStream stream, int lexState)	Constructor.

Method Summary

Modifier and Type	Method	Description
Token	getNextToken()	Get the next Token.
protected Token	jjFillToken()
void	ReInit(CharStream stream)	Reinitialise parser.
void	ReInit(CharStream stream, int lexState)	Reinitialise parser.
void	SwitchTo(int lexState)	Switch to specified lex state.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

jjstrLiteralImages

public static final String[] jjstrLiteralImages

Token literal values.

lexStateNames

public static final String[] lexStateNames

Lexer state names.

jjnewLexState

public static final int[] jjnewLexState

Lex State array.

input_stream

protected CharStream input_stream

curChar

protected int curChar

Constructor Details

IndexingParserTokenManager

public IndexingParserTokenManager(CharStream stream)

Constructor.

IndexingParserTokenManager

public IndexingParserTokenManager(CharStream stream,
 int lexState)

Constructor.

Method Details

jjFillToken

protected Token jjFillToken()

getNextToken

public Token getNextToken()

Get the next Token.

ReInit

public void ReInit(CharStream stream)

Reinitialise parser.

ReInit

public void ReInit(CharStream stream,
 int lexState)

Reinitialise parser.

SwitchTo

public void SwitchTo(int lexState)

Switch to specified lex state.