Class TokenFeatureGenerator

    • Constructor Detail

      • TokenFeatureGenerator

        public TokenFeatureGenerator​(boolean lowercase)
        Initializes a TokenFeatureGenerator.
        Parameters:
        lowercase - Whether to use lower-casing or not.
      • TokenFeatureGenerator

        public TokenFeatureGenerator()
        Initializes a TokenFeatureGenerator. Lower-casing will be enabled.
    • Method Detail

      • createFeatures

        public void createFeatures​(List<String> features,
                                   String[] tokens,
                                   int index,
                                   String[] preds)
        Description copied from interface: AdaptiveFeatureGenerator
        Adds the appropriate features for the token at the specified index with the specified array of previousOutcomes to the specified list of features.
        Specified by:
        createFeatures in interface AdaptiveFeatureGenerator
        Parameters:
        features - The list of features to be added to.
        tokens - The tokens of the sentence or other text unit being processed.
        index - The index of the token which is currently being processed.
        preds - The outcomes for the tokens prior to the specified index.