Package opennlp.uima.tokenize

package opennlp.uima.tokenize

Package related to finding tokens or word segments.

Class	Description
AbstractTokenizer
SimpleTokenizer	OpenNLP Simple Tokenizer annotator.
Tokenizer	OpenNLP Tokenizer annotator.
TokenizerModelResource	A TokenizerModel which can be shared between AnalysisEngines and loaded via the UIMA resource model.
TokenizerModelResourceImpl
WhitespaceTokenizer	OpenNLP Whitespace Tokenizer annotator.