opennlp.tools.lemmatizer

Class DictionaryLemmatizer

java.lang.Object

opennlp.tools.lemmatizer.DictionaryLemmatizer

All Implemented Interfaces:

Lemmatizer

public class DictionaryLemmatizer
extends Object
implements Lemmatizer

Lemmatize by simple dictionary lookup into a hashmap built from a file containing, for each line, word\tablemma\tabpostag.

Version:

2014-07-08

Constructor Summary

Constructors

Constructor and Description
DictionaryLemmatizer(InputStream dictionary) Construct a hashmap from the input tab separated dictionary.

Method Summary

Modifier and Type	Method and Description
String	apply(String word, String postag) Lookup lemma in a dictionary.
Map<List<String>,String>	getDictMap() Get the Map containing the dictionary.
String[]	lemmatize(String[] tokens, String[] postags) Generates lemma tags for the word and postag returning the result in an array.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DictionaryLemmatizer

public DictionaryLemmatizer(InputStream dictionary)

Construct a hashmap from the input tab separated dictionary. The input file should have, for each line, word\tablemma\tabpostag

Parameters:

dictionary - the input dictionary via inputstream

Method Detail

getDictMap

public Map<List<String>,String> getDictMap()

Get the Map containing the dictionary.

Returns:

dictMap the Map

lemmatize

public String[] lemmatize(String[] tokens,
                          String[] postags)

Description copied from interface: Lemmatizer

Generates lemma tags for the word and postag returning the result in an array.

Specified by:

lemmatize in interface Lemmatizer

Parameters:

tokens - an array of the tokens

postags - an array of the pos tags

Returns:

an array of lemma classes for each token in the sequence.

apply

public String apply(String word,
                    String postag)

Lookup lemma in a dictionary. Outputs "O" if not found.

Parameters:

word - the token

postag - the postag

Returns:

the lemma