Uses of Class
net.sf.okapi.core.simplifierrules.Token
-
Packages that use Token Package Description net.sf.okapi.core.simplifierrules -
-
Uses of Token in net.sf.okapi.core.simplifierrules
Fields in net.sf.okapi.core.simplifierrules declared as Token Modifier and Type Field Description TokenParseException. currentTokenThis is the last token that has been consumed successfully.TokenSimplifierRules. jj_ntNext token.TokenToken. nextA reference to the next regular (non-special) token from the input stream.TokenToken. specialTokenThis field is used to access special tokens that occur prior to this token, but after the immediately preceding regular (non-special) token.TokenSimplifierRules. tokenCurrent token.Methods in net.sf.okapi.core.simplifierrules that return Token Modifier and Type Method Description TokenSimplifierRules. getNextToken()Get the next Token.TokenSimplifierRulesTokenManager. getNextToken()Get the next Token.TokenSimplifierRules. getToken(int index)Get the specific Token.protected TokenSimplifierRulesTokenManager. jjFillToken()static TokenToken. newToken(int ofKind)static TokenToken. newToken(int ofKind, String image)Returns a new Token object, by default.Constructors in net.sf.okapi.core.simplifierrules with parameters of type Token Constructor Description ParseException(Token currentTokenVal, int[][] expectedTokenSequencesVal, String[] tokenImageVal)This constructor is used by the method "generateParseException" in the generated parser.
-