Package opennlp.tools.util.normalizer

Class ConfusableSkeletonCharSequenceNormalizer

java.lang.Object

opennlp.tools.util.normalizer.ConfusableSkeletonCharSequenceNormalizer

All Implemented Interfaces:

Serializable, opennlp.tools.util.normalizer.CharSequenceNormalizer

public class ConfusableSkeletonCharSequenceNormalizer
extends Object
implements opennlp.tools.util.normalizer.CharSequenceNormalizer

A CharSequenceNormalizer that reduces text to its Unicode confusable skeleton (UTS #39).

This maps lookalike characters to a common prototype so that, for example, a word spelled with Cyrillic or Greek letters that imitate Latin ones reduces to the same form as its Latin spelling. The result is a matching key, not readable text: it is lossy and does not preserve offsets, so it is only meaningful as a derived layer of the original/normalized model.

See Also:

• Serialized Form

Method Summary

Modifier and Type	Method	Description
static ConfusableSkeletonCharSequenceNormalizer	getInstance()	Returns the shared, stateless instance.
CharSequence	normalize(CharSequence text)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

getInstance

public static ConfusableSkeletonCharSequenceNormalizer getInstance()

Returns the shared, stateless instance.

Returns:

the shared, stateless instance

normalize

public CharSequence normalize(CharSequence text)

Specified by:

normalize in interface opennlp.tools.util.normalizer.CharSequenceNormalizer