Package net.sf.okapi.steps.tokenization

Class Token

java.lang.Object

net.sf.okapi.steps.tokenization.Token

public class Token
extends Object

TokenType generated by the RbbiTokenizer

Field Summary

Fields

Modifier and Type	Field	Description
int	id

Constructor Summary

Constructors

Constructor	Description
Token(int id, String value, String name, String description, int start, int end)

Method Summary

Modifier and Type	Method	Description
String	getDescription()
int	getId()
String	getName()
Range	getRange()
String	getValue()
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

id

public int id

Constructor Detail

Token

public Token(int id,
             String value,
             String name,
             String description,
             int start,
             int end)

Method Detail

getRange

public Range getRange()

getId

public int getId()

getValue

public String getValue()

getName

public String getName()

getDescription

public String getDescription()

toString

public String toString()

Overrides:

toString in class Object