Skip navigation links

Package opennlp.tools.tokenize

Contains classes related to finding token or words in a string.

See: Description

Package opennlp.tools.tokenize Description

Contains classes related to finding token or words in a string. All tokenizer implement the Tokenizer interface. Currently there is the learnable TokenizerME, the WhitespaceTokenizer and the SimpleTokenizer which is a character class tokenizer.
Skip navigation links

Copyright © 2020 The Apache Software Foundation. All rights reserved.