opennlp.tools.tokenize

Class TokenizerCrossValidator

java.lang.Object

opennlp.tools.tokenize.TokenizerCrossValidator

public class TokenizerCrossValidator
extends Object

Constructor Summary

Constructors

Constructor and Description
TokenizerCrossValidator(String language, boolean alphaNumericOptimization) Deprecated. use TokenizerCrossValidator(TrainingParameters, TokenizerFactory, TokenizerEvaluationMonitor...) instead and pass in a TokenizerFactory
TokenizerCrossValidator(String language, boolean alphaNumericOptimization, TrainingParameters params, TokenizerEvaluationMonitor... listeners) Deprecated. use TokenizerCrossValidator(TrainingParameters, TokenizerFactory, TokenizerEvaluationMonitor...) instead and pass in a TokenizerFactory
TokenizerCrossValidator(String language, Dictionary abbreviations, boolean alphaNumericOptimization, TrainingParameters params, TokenizerEvaluationMonitor... listeners) Deprecated. use TokenizerCrossValidator(TrainingParameters, TokenizerFactory, TokenizerEvaluationMonitor...) instead and pass in a TokenizerFactory
TokenizerCrossValidator(TrainingParameters params, TokenizerFactory factory, TokenizerEvaluationMonitor... listeners)

Method Summary

Methods

Modifier and Type	Method and Description
void	evaluate(ObjectStream<TokenSample> samples, int nFolds) Starts the evaluation.
FMeasure	getFMeasure()

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TokenizerCrossValidator

public TokenizerCrossValidator(TrainingParameters params,
                       TokenizerFactory factory,
                       TokenizerEvaluationMonitor... listeners)

TokenizerCrossValidator

public TokenizerCrossValidator(String language,
                       Dictionary abbreviations,
                       boolean alphaNumericOptimization,
                       TrainingParameters params,
                       TokenizerEvaluationMonitor... listeners)

Deprecated. use TokenizerCrossValidator(TrainingParameters, TokenizerFactory, TokenizerEvaluationMonitor...) instead and pass in a TokenizerFactory

TokenizerCrossValidator

public TokenizerCrossValidator(String language,
                       boolean alphaNumericOptimization)

Deprecated. use TokenizerCrossValidator(TrainingParameters, TokenizerFactory, TokenizerEvaluationMonitor...) instead and pass in a TokenizerFactory

TokenizerCrossValidator

public TokenizerCrossValidator(String language,
                       boolean alphaNumericOptimization,
                       TrainingParameters params,
                       TokenizerEvaluationMonitor... listeners)

Deprecated. use TokenizerCrossValidator(TrainingParameters, TokenizerFactory, TokenizerEvaluationMonitor...) instead and pass in a TokenizerFactory

Method Detail

evaluate

public void evaluate(ObjectStream<TokenSample> samples,
            int nFolds)
              throws IOException

Starts the evaluation.

Parameters:

samples - the data to train and test

nFolds - number of folds

Throws:

IOException

getFMeasure

public FMeasure getFMeasure()