Package opennlp.tools.util.normalizer

Class NfkcCharSequenceNormalizer

java.lang.Object

opennlp.tools.util.normalizer.NfkcCharSequenceNormalizer

All Implemented Interfaces:

Serializable, opennlp.tools.util.normalizer.CharSequenceNormalizer

public class NfkcCharSequenceNormalizer
extends Object
implements opennlp.tools.util.normalizer.CharSequenceNormalizer

A CharSequenceNormalizer that applies Unicode Normalization Form KC (compatibility composition, UAX #15).

NFKC folds compatibility variants to their canonical form: fullwidth and halfwidth letters, the U+FB01 ligature to fi, and super/subscript digits to plain digits. It is more aggressive than NFC and is lossy (it can change a character's appearance or meaning, e.g. a squared numeral to a plain one), so it is a deliberate choice for search/recall rather than a safe default.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
NfkcCharSequenceNormalizer()

Method Summary

Modifier and Type	Method	Description
static NfkcCharSequenceNormalizer	getInstance()	Returns the shared, stateless instance.
CharSequence	normalize(CharSequence text)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

NfkcCharSequenceNormalizer

public NfkcCharSequenceNormalizer()

Method Details

getInstance

public static NfkcCharSequenceNormalizer getInstance()

Returns the shared, stateless instance.

Returns:

the shared, stateless instance

normalize

public CharSequence normalize(CharSequence text)

Specified by:

normalize in interface opennlp.tools.util.normalizer.CharSequenceNormalizer