Class DefaultTokenContextGenerator

java.lang.Object

opennlp.tools.tokenize.DefaultTokenContextGenerator

All Implemented Interfaces:

opennlp.tools.tokenize.TokenContextGenerator

public class DefaultTokenContextGenerator
extends Object
implements opennlp.tools.tokenize.TokenContextGenerator

A default TokenContextGenerator which produces events for maxent decisions for tokenization.

Constructor Summary

Constructors

Constructor	Description
DefaultTokenContextGenerator()	Initializes a plain DefaultTokenContextGenerator instance.
DefaultTokenContextGenerator(Set<String> inducedAbbreviations)	Initializes a customized DefaultTokenContextGenerator instance via a set of inducedAbbreviations.

Method Summary

Modifier and Type	Method	Description
String[]	getContext(String sentence, int index)

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

DefaultTokenContextGenerator

public DefaultTokenContextGenerator()

Initializes a plain DefaultTokenContextGenerator instance.

DefaultTokenContextGenerator

public DefaultTokenContextGenerator(Set<String> inducedAbbreviations)

Initializes a customized DefaultTokenContextGenerator instance via a set of inducedAbbreviations.

Parameters:

inducedAbbreviations - The induced abbreviations to be used for this instance.

Method Details

getContext

public String[] getContext(String sentence,
 int index)

Specified by:

getContext in interface opennlp.tools.tokenize.TokenContextGenerator