Package opennlp.tools.cmdline.tokenizer

Class Summary

Class	Description
DetokenEvaluationErrorListener	A default implementation of EvaluationMonitor that prints to an output stream.
DictionaryDetokenizerTool
SimpleTokenizerTool
TokenEvaluationErrorListener	A default implementation of EvaluationMonitor that prints to an output stream.
TokenizerConverterTool	Tool to convert multiple data formats into native OpenNLP sentence detector training format.
TokenizerCrossValidatorTool
TokenizerMEEvaluatorTool	A default TokenSample-centric implementation of AbstractEvaluatorTool that prints to an output stream.
TokenizerMETool
TokenizerModelLoader	Loads a TokenizerModel for the command line tools.
TokenizerTrainerTool