Package | Description |
---|---|
opennlp.tools.tokenize |
Contains classes related to finding token or words in a string.
|
Modifier and Type | Method and Description |
---|---|
static TokenizerFactory |
TokenizerFactory.create(String subclassName,
String languageCode,
Dictionary abbreviationDictionary,
boolean useAlphaNumericOptimization,
Pattern alphaNumericPattern)
Factory method the framework uses create a new
TokenizerFactory . |
TokenizerFactory |
TokenizerModel.getFactory() |
Modifier and Type | Method and Description |
---|---|
static TokenizerModel |
TokenizerME.train(ObjectStream<TokenSample> samples,
TokenizerFactory factory,
TrainingParameters mlParams)
Trains a model for the
TokenizerME . |
Constructor and Description |
---|
TokenizerCrossValidator(TrainingParameters params,
TokenizerFactory factory,
TokenizerEvaluationMonitor... listeners) |
TokenizerModel(MaxentModel tokenizerModel,
Map<String,String> manifestInfoEntries,
TokenizerFactory tokenizerFactory)
Initializes the current instance.
|
Copyright © 2017 The Apache Software Foundation. All rights reserved.