Uses of Class
opennlp.tools.tokenize.TokenizerModel

Packages that use TokenizerModel

Package	Description
opennlp.tools.cmdline.tokenizer
opennlp.tools.formats.brat
opennlp.tools.tokenize	Contains classes related to finding token or words in a string.

Uses of TokenizerModel in opennlp.tools.cmdline.tokenizer

Methods in opennlp.tools.cmdline.tokenizer that return TokenizerModel

Modifier and Type	Method and Description
protected TokenizerModel	TokenizerModelLoader.loadModel(InputStream modelIn)

Uses of TokenizerModel in opennlp.tools.formats.brat

Constructors in opennlp.tools.formats.brat with parameters of type TokenizerModel

Constructor and Description
BratNameSampleStream(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples)

Uses of TokenizerModel in opennlp.tools.tokenize

Methods in opennlp.tools.tokenize that return TokenizerModel

Modifier and Type	Method and Description
static TokenizerModel	TokenizerME.train(ObjectStream<TokenSample> samples, TokenizerFactory factory, TrainingParameters mlParams) Trains a model for the TokenizerME.
static TokenizerModel	TokenizerME.train(String languageCode, ObjectStream<TokenSample> samples, boolean useAlphaNumericOptimization) Deprecated. Use TokenizerME.train(ObjectStream, TokenizerFactory, TrainingParameters) and pass in a TokenizerFactory
static TokenizerModel	TokenizerME.train(String languageCode, ObjectStream<TokenSample> samples, boolean useAlphaNumericOptimization, TrainingParameters mlParams) Deprecated. Use TokenizerME.train(ObjectStream, TokenizerFactory, TrainingParameters) and pass in a TokenizerFactory
static TokenizerModel	TokenizerME.train(String languageCode, ObjectStream<TokenSample> samples, Dictionary abbreviations, boolean useAlphaNumericOptimization, TrainingParameters mlParams) Deprecated. Use TokenizerME.train(ObjectStream, TokenizerFactory, TrainingParameters) and pass in a TokenizerFactory

Constructors in opennlp.tools.tokenize with parameters of type TokenizerModel

Constructor and Description
TokenizerME(TokenizerModel model)
TokenizerME(TokenizerModel model, Factory factory) Deprecated. use TokenizerFactory to extend the Tokenizer functionality