Package opennlp.tools.util.featuregen
Class WindowFeatureGenerator
- java.lang.Object
-
- opennlp.tools.util.featuregen.WindowFeatureGenerator
-
- All Implemented Interfaces:
AdaptiveFeatureGenerator
public class WindowFeatureGenerator extends Object implements AdaptiveFeatureGenerator
Generates previous and next features for a givenAdaptiveFeatureGenerator
. The window size can be specified. Features: Current token is always included unchanged Previous tokens are prefixed with p distance Next tokens are prefix with n distance
-
-
Field Summary
Fields Modifier and Type Field Description static String
NEXT_PREFIX
static String
PREV_PREFIX
-
Constructor Summary
Constructors Constructor Description WindowFeatureGenerator(int prevWindowSize, int nextWindowSize, AdaptiveFeatureGenerator... generators)
Initializes aWindowFeatureGenerator
with the given parameters.WindowFeatureGenerator(AdaptiveFeatureGenerator generator)
Initializes aWindowFeatureGenerator
.WindowFeatureGenerator(AdaptiveFeatureGenerator... generators)
Initializes aWindowFeatureGenerator
.WindowFeatureGenerator(AdaptiveFeatureGenerator generator, int prevWindowSize, int nextWindowSize)
Initializes aWindowFeatureGenerator
with the given parameters.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description void
clearAdaptiveData()
Informs a feature generator that the context of the adaptive data (typically a document) is no longer valid.void
createFeatures(List<String> features, String[] tokens, int index, String[] preds)
Adds the appropriate features for the token at the specifiedindex
with the specified array ofpreviousOutcomes
to the specified list of features.String
toString()
void
updateAdaptiveData(String[] tokens, String[] outcomes)
Informs a feature generator that the specified tokens have been classified with the corresponding set of specifiedoutcomes
.
-
-
-
Field Detail
-
PREV_PREFIX
public static final String PREV_PREFIX
- See Also:
- Constant Field Values
-
NEXT_PREFIX
public static final String NEXT_PREFIX
- See Also:
- Constant Field Values
-
-
Constructor Detail
-
WindowFeatureGenerator
public WindowFeatureGenerator(AdaptiveFeatureGenerator generator, int prevWindowSize, int nextWindowSize)
Initializes aWindowFeatureGenerator
with the given parameters.- Parameters:
generator
- TheAdaptiveFeatureGenerator
to apply to the window.prevWindowSize
- Size of the window to the left of the current token.nextWindowSize
- Size of the window to the right of the current token.
-
WindowFeatureGenerator
public WindowFeatureGenerator(int prevWindowSize, int nextWindowSize, AdaptiveFeatureGenerator... generators)
Initializes aWindowFeatureGenerator
with the given parameters.- Parameters:
generators
- One or moreAdaptiveFeatureGenerator
to apply to the window.prevWindowSize
- Size of the window to the left of the current token.nextWindowSize
- Size of the window to the right of the current token.
-
WindowFeatureGenerator
public WindowFeatureGenerator(AdaptiveFeatureGenerator generator)
Initializes aWindowFeatureGenerator
. The previous and next window size is 5.- Parameters:
generator
- TheAdaptiveFeatureGenerator
to apply to the window.
-
WindowFeatureGenerator
public WindowFeatureGenerator(AdaptiveFeatureGenerator... generators)
Initializes aWindowFeatureGenerator
. The previous and next window size is 5.- Parameters:
generators
- One or moreAdaptiveFeatureGenerator
to apply to the window.
-
-
Method Detail
-
createFeatures
public void createFeatures(List<String> features, String[] tokens, int index, String[] preds)
Description copied from interface:AdaptiveFeatureGenerator
Adds the appropriate features for the token at the specifiedindex
with the specified array ofpreviousOutcomes
to the specified list of features.- Specified by:
createFeatures
in interfaceAdaptiveFeatureGenerator
- Parameters:
features
- The list of features to be added to.tokens
- The tokens of the sentence or other text unit being processed.index
- The index of the token which is currently being processed.preds
- The outcomes for the tokens prior to the specified index.
-
updateAdaptiveData
public void updateAdaptiveData(String[] tokens, String[] outcomes)
Description copied from interface:AdaptiveFeatureGenerator
Informs a feature generator that the specified tokens have been classified with the corresponding set of specifiedoutcomes
.- Specified by:
updateAdaptiveData
in interfaceAdaptiveFeatureGenerator
- Parameters:
tokens
- The tokens of the sentence or other text unit which has been processed.outcomes
- The outcomes associated with the specified tokens.
-
clearAdaptiveData
public void clearAdaptiveData()
Description copied from interface:AdaptiveFeatureGenerator
Informs a feature generator that the context of the adaptive data (typically a document) is no longer valid.- Specified by:
clearAdaptiveData
in interfaceAdaptiveFeatureGenerator
-
-