Package opennlp.tools.tokenize
Klasse DefaultTokenContextGenerator
java.lang.Object
opennlp.tools.tokenize.DefaultTokenContextGenerator
- Alle implementierten Schnittstellen:
TokenContextGenerator
A default
TokenContextGenerator which produces events for maxent decisions
for tokenization.-
Konstruktorübersicht
KonstruktorenKonstruktorBeschreibungInitializes a plainDefaultTokenContextGeneratorinstance.DefaultTokenContextGenerator(Set<String> inducedAbbreviations) Initializes a customizedDefaultTokenContextGeneratorinstance via a set ofinducedAbbreviations. -
Methodenübersicht
-
Konstruktordetails
-
DefaultTokenContextGenerator
public DefaultTokenContextGenerator()Initializes a plainDefaultTokenContextGeneratorinstance. -
DefaultTokenContextGenerator
Initializes a customizedDefaultTokenContextGeneratorinstance via a set ofinducedAbbreviations.- Parameter:
inducedAbbreviations- The induced abbreviations to be used for this instance.
-
-
Methodendetails
-
getContext
- Angegeben von:
getContextin SchnittstelleTokenContextGenerator- Parameter:
sentence- The string that represents a sentence.index- The index to consider splitting tokens.- Gibt zurück:
- An array of features for a
sentenceat the specifiedindex.
-