public class DefaultTokenContextGenerator extends Object implements TokenContextGenerator
Constructor and Description |
---|
DefaultTokenContextGenerator()
Creates a default context generator for tokenizer.
|
DefaultTokenContextGenerator(Set<String> inducedAbbreviations)
Creates a default context generator for tokenizer.
|
Modifier and Type | Method and Description |
---|---|
String[] |
getContext(String sentence,
int index)
Returns an array of features for the specified sentence string at the specified index.
|
public DefaultTokenContextGenerator()
public String[] getContext(String sentence, int index)
TokenContextGenerator
getContext
in interface TokenContextGenerator
sentence
- The string for a sentence.index
- The index to consider splitting as a token.Copyright © 2018 The Apache Software Foundation. All rights reserved.