Package | Description |
---|---|
opennlp.tools.formats |
Experimental package related to converting various corpora to OpenNLP Format.
|
opennlp.tools.formats.ad | |
opennlp.tools.formats.convert | |
opennlp.tools.tokenize |
Contains classes related to finding token or words in a string.
|
opennlp.tools.tokenize.lang.en |
Modifier and Type | Method and Description |
---|---|
ObjectStream<TokenSample> |
ConllXTokenSampleStreamFactory.create(String[] args) |
ObjectStream<TokenSample> |
TokenSampleStreamFactory.create(String[] args) |
Modifier and Type | Method and Description |
---|---|
ObjectStream<TokenSample> |
ADTokenSampleStreamFactory.create(String[] args) |
Modifier and Type | Method and Description |
---|---|
TokenSample |
POSToTokenSampleStream.read() |
TokenSample |
NameToTokenSampleStream.read() |
Modifier and Type | Method and Description |
---|---|
ObjectStream<TokenSample> |
NameToTokenSampleStreamFactory.create(String[] args) |
ObjectStream<TokenSample> |
POSToTokenSampleStreamFactory.create(String[] args) |
ObjectStream<TokenSample> |
ParseToTokenSampleStreamFactory.create(String[] args) |
Modifier and Type | Method and Description |
---|---|
static TokenSample |
TokenSample.parse(String sampleString,
String separatorChars) |
protected TokenSample |
TokenizerEvaluator.processSample(TokenSample reference) |
TokenSample |
TokenizerStream.read() |
TokenSample |
TokenSampleStream.read() |
Modifier and Type | Method and Description |
---|---|
protected Iterator<Event> |
TokSpanEventStream.createEvents(TokenSample tokenSample)
Adds training events to the event stream for each of the specified tokens.
|
protected TokenSample |
TokenizerEvaluator.processSample(TokenSample reference) |
Modifier and Type | Method and Description |
---|---|
void |
TokenizerCrossValidator.evaluate(ObjectStream<TokenSample> samples,
int nFolds)
Starts the evaluation.
|
static TokenizerModel |
TokenizerME.train(ObjectStream<TokenSample> samples,
TokenizerFactory factory,
TrainingParameters mlParams)
Trains a model for the
TokenizerME . |
Constructor and Description |
---|
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples,
boolean skipAlphaNumerics)
Initializes the current instance.
|
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples,
boolean skipAlphaNumerics,
Pattern alphaNumeric,
TokenContextGenerator cg)
Initializes the current instance.
|
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples,
boolean skipAlphaNumerics,
TokenContextGenerator cg)
Initializes the current instance.
|
WhitespaceTokenStream(ObjectStream<TokenSample> tokens) |
Modifier and Type | Method and Description |
---|---|
TokenSample |
TokenSampleStream.next() |
Copyright © 2017 The Apache Software Foundation. All rights reserved.