Package opennlp.tools.tokenize
Klasse DefaultTokenContextGenerator
java.lang.Object
opennlp.tools.tokenize.DefaultTokenContextGenerator
- Alle implementierten Schnittstellen:
TokenContextGenerator
A default
TokenContextGenerator
which produces events for maxent decisions
for tokenization.-
Konstruktorübersicht
KonstruktorenKonstruktorBeschreibungInitializes a plainDefaultTokenContextGenerator
instance.DefaultTokenContextGenerator
(Set<String> inducedAbbreviations) Initializes a customizedDefaultTokenContextGenerator
instance via a set ofinducedAbbreviations
. -
Methodenübersicht
-
Konstruktordetails
-
DefaultTokenContextGenerator
public DefaultTokenContextGenerator()Initializes a plainDefaultTokenContextGenerator
instance. -
DefaultTokenContextGenerator
Initializes a customizedDefaultTokenContextGenerator
instance via a set ofinducedAbbreviations
.- Parameter:
inducedAbbreviations
- The induced abbreviations to be used for this instance.
-
-
Methodendetails
-
getContext
- Angegeben von:
getContext
in SchnittstelleTokenContextGenerator
- Parameter:
sentence
- The string that represents a sentence.index
- The index to consider splitting tokens.- Gibt zurück:
- An array of features for a
sentence
at the specifiedindex
.
-