Uses of Interface
opennlp.tools.tokenize.TokenContextGenerator

Packages that use TokenContextGenerator

Package	Description
opennlp.tools.tokenize	Contains classes related to finding token or words in a string.
opennlp.tools.tokenize.lang

Uses of TokenContextGenerator in opennlp.tools.tokenize

Classes in opennlp.tools.tokenize that implement TokenContextGenerator

Modifier and Type	Class and Description
class	DefaultTokenContextGenerator Generate events for maxent decisions for tokenization.

Methods in opennlp.tools.tokenize that return TokenContextGenerator

Modifier and Type	Method and Description
TokenContextGenerator	TokenizerFactory.getContextGenerator() Gets the context generator

Constructors in opennlp.tools.tokenize with parameters of type TokenContextGenerator

Constructor and Description
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, Pattern alphaNumeric, TokenContextGenerator cg) Initializes the current instance.
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, TokenContextGenerator cg) Initializes the current instance.

Uses of TokenContextGenerator in opennlp.tools.tokenize.lang

Methods in opennlp.tools.tokenize.lang that return TokenContextGenerator

Modifier and Type	Method and Description
TokenContextGenerator	Factory.createTokenContextGenerator(String languageCode, Set<String> abbreviations)