com.github.chen0040.data.text

Interface Tokenizer

All Known Implementing Classes:

BasicTokenizer

public interface Tokenizer

Created by xschen on 9/10/15.

Method Summary

Modifier and Type	Method and Description
List<String>	tokenize(String text)

Method Detail

tokenize

List<String> tokenize(String text)