Package opennlp.uima.tokenize

package opennlp.uima.tokenize

Package related to finding tokens or word segments.

Class	Description
AbstractTokenizer
SimpleTokenizer	An OpenNLP-based Simple Tokenizer annotator.
Tokenizer	An OpenNLP-based Tokenizer annotator.
TokenizerModelResource	A resource encapsulating an OpenNLP TokenizerModel which can be shared between analysis engines and loaded via the UIMA resource model.
TokenizerModelResourceImpl	A default implementation of TokenizerModelResource.
WhitespaceTokenizer	An OpenNLP-based Whitespace Tokenizer annotator.