Uses of Package com.parc.chat.tokenizer (com.github.parc:MicroTextTokenizer 1.0.2 API)

Classes in com.parc.chat.tokenizer used by com.parc.chat.tokenizer
Class and Description
LabeledToken Java bean class to hold a token that has been tagged with its lexical category and has been stemmed.
LexicalFSA.Alphabet
LexicalFSA.State
TokenType This enum defines the types of tokens according to their use in text.

Uses of Packagecom.parc.chat.tokenizer