com.parc.chat.tokenizer

Class LabeledToken

java.lang.Object

com.parc.chat.tokenizer.LabeledToken

All Implemented Interfaces:

Serializable

public class LabeledToken
extends Object
implements Serializable

Java bean class to hold a token that has been tagged with its lexical category and has been stemmed.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static String	POS_ATTRIBUTE
static String	STEM_ATTRIBUTE
static String	TOKEN_ELEMENT

Constructor Summary

Constructors

Constructor and Description
LabeledToken() Creates a new labeled token with none of its features set.
LabeledToken(String originalWord) Creates a new labeled token with its original word value set.

Method Summary

Modifier and Type	Method and Description
int	getCharacterPosition() Get character position where this token starts in the sentence.
int	getIndex() Get the index of this token into its sentence.
String	getOriginalWord() Gets the token in its original form.
String	getStem() Gets the stemmed form (lemma) for this token.
TokenType	getTokenType() Get the token type assigned to this token (see the TokenType enum).
Node	makeXML(Document doc)
void	setCharacterPosition(int charPos) Set the character position where this token starts in the sentence.
void	setIndex(int index) Set the index of this token into its sentence.
void	setOriginalWord(String token) Sets the token.
void	setStem(String stem) Sets the stemmed form of this token.
void	setTokenType(TokenType tokenType) Set the token type on this token (see the TokenType enum).
String	toString() Returns a string representation showing the original token and its part-of-speech separated by a slash.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

TOKEN_ELEMENT

public static final String TOKEN_ELEMENT

See Also:

Constant Field Values

POS_ATTRIBUTE

public static final String POS_ATTRIBUTE

See Also:

Constant Field Values

STEM_ATTRIBUTE

public static final String STEM_ATTRIBUTE

See Also:

Constant Field Values

Constructor Detail

LabeledToken

public LabeledToken()

Creates a new labeled token with none of its features set.

LabeledToken

public LabeledToken(String originalWord)

Creates a new labeled token with its original word value set.

Parameters:

originalWord - the original form of the token

Method Detail

getOriginalWord

public String getOriginalWord()

Gets the token in its original form.

Returns:

the token

setOriginalWord

public void setOriginalWord(String token)

Sets the token. You should use this to store the token in its original form.

Parameters:

token - the token in its original form

getStem

public String getStem()

Gets the stemmed form (lemma) for this token.

Returns:

the stemmed form of the token

setStem

public void setStem(String stem)

Sets the stemmed form of this token.

Parameters:

stem - the stemmed form of the token

getTokenType

public TokenType getTokenType()

Get the token type assigned to this token (see the TokenType enum).

Returns:

the type assigned to this token

setTokenType

public void setTokenType(TokenType tokenType)

Set the token type on this token (see the TokenType enum).

Parameters:

tokenType - the type to assign to this token

getIndex

public int getIndex()

Get the index of this token into its sentence.

Returns:

the index of this token in its sentence

setIndex

public void setIndex(int index)

Set the index of this token into its sentence.

Parameters:

index - the index of this token in its sentence

getCharacterPosition

public int getCharacterPosition()

Get character position where this token starts in the sentence.

Returns:

the character position where this token starts in the sentence

setCharacterPosition

public void setCharacterPosition(int charPos)

Set the character position where this token starts in the sentence.

Parameters:

charPos - the integer that indicates the token's starting point

toString

public String toString()

Returns a string representation showing the original token and its part-of-speech separated by a slash.

Overrides:

toString in class Object

makeXML

public Node makeXML(Document doc)