Class TokenFeatureGenerator

java.lang.Object
opennlp.tools.util.featuregen.TokenFeatureGenerator
All Implemented Interfaces:
opennlp.tools.util.featuregen.AdaptiveFeatureGenerator

public class TokenFeatureGenerator extends Object implements opennlp.tools.util.featuregen.AdaptiveFeatureGenerator
Generates a feature which contains a token itself.
See Also:
  • AdaptiveFeatureGenerator
  • Constructor Details

    • TokenFeatureGenerator

      public TokenFeatureGenerator(boolean lowercase)
      Initializes a TokenFeatureGenerator.
      Parameters:
      lowercase - Whether or not to use lower-casing.
    • TokenFeatureGenerator

      public TokenFeatureGenerator()
      Initializes a TokenFeatureGenerator. Lower-casing will be enabled.
  • Method Details

    • createFeatures

      public void createFeatures(List<String> features, String[] tokens, int index, String[] preds)
      Specified by:
      createFeatures in interface opennlp.tools.util.featuregen.AdaptiveFeatureGenerator