Package opennlp.tools.util.featuregen

Klasse TokenPatternFeatureGenerator

java.lang.Object

opennlp.tools.util.featuregen.TokenPatternFeatureGenerator

Alle implementierten Schnittstellen:

AdaptiveFeatureGenerator

public class TokenPatternFeatureGenerator
extends Object
implements AdaptiveFeatureGenerator

Partitions tokens into sub-tokens based on character classes and generates class features for each of the sub-tokens and combinations of those sub-tokens.

Konstruktorübersicht

Konstruktoren

Konstruktor	Beschreibung
TokenPatternFeatureGenerator()	Initializes a TokenPatternFeatureGenerator.
TokenPatternFeatureGenerator(Tokenizer supportTokenizer)	Initializes a TokenPatternFeatureGenerator instance.

Methodenübersicht

Modifizierer und Typ	Methode	Beschreibung
void	createFeatures(List<String> feats, String[] toks, int index, String[] preds)	Adds the appropriate features for the token at the specified index with the specified array of previousOutcomes to the specified list of features.

Von Klasse geerbte Methoden java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Von Schnittstelle geerbte Methoden opennlp.tools.util.featuregen.AdaptiveFeatureGenerator

clearAdaptiveData, updateAdaptiveData

Konstruktordetails

TokenPatternFeatureGenerator

public TokenPatternFeatureGenerator()

Initializes a TokenPatternFeatureGenerator. For tokenization the SimpleTokenizer is used.

TokenPatternFeatureGenerator

public TokenPatternFeatureGenerator(Tokenizer supportTokenizer)

Initializes a TokenPatternFeatureGenerator instance.

Parameter:

supportTokenizer - The Tokenizer to be used.

Methodendetails

createFeatures

public void createFeatures(List<String> feats,
 String[] toks,
 int index,
 String[] preds)

Beschreibung aus Schnittstelle kopiert: AdaptiveFeatureGenerator

Adds the appropriate features for the token at the specified index with the specified array of previousOutcomes to the specified list of features.

Angegeben von:

createFeatures in Schnittstelle AdaptiveFeatureGenerator

Parameter:

feats - The list of features to be added to.

toks - The tokens of the sentence or other text unit being processed.

index - The index of the token which is currently being processed.

preds - The outcomes for the tokens prior to the specified index.