Package opennlp.tools.tokenize

Klasse DictionaryDetokenizer

java.lang.Object

opennlp.tools.tokenize.DictionaryDetokenizer

Alle implementierten Schnittstellen:

Detokenizer

public class DictionaryDetokenizer
extends Object
implements Detokenizer

A rule based detokenizer. Simple rules which indicate in which direction a token should be moved are looked up in a dictionary.

Siehe auch:

• Detokenizer
• DetokenizationDictionary

Verschachtelte Klassen - Übersicht

Von Schnittstelle geerbte verschachtelte Klassen/Schnittstellen opennlp.tools.tokenize.Detokenizer

Detokenizer.DetokenizationOperation

Konstruktorübersicht

Konstruktoren

Konstruktor	Beschreibung
DictionaryDetokenizer(DetokenizationDictionary dict)	Initializes a DictionaryDetokenizer instance.

Methodenübersicht

Modifizierer und Typ	Methode	Beschreibung
Detokenizer.DetokenizationOperation[]	detokenize(String[] tokens)	Detokenizes the collection of tokens.
String	detokenize(String[] tokens, String splitMarker)	Detokenizes the input tokens into a String.

Von Klasse geerbte Methoden java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Konstruktordetails

DictionaryDetokenizer

public DictionaryDetokenizer(DetokenizationDictionary dict)

Initializes a DictionaryDetokenizer instance.

Parameter:

dict - The DetokenizationDictionary to be used.

Methodendetails

detokenize

public Detokenizer.DetokenizationOperation[] detokenize(String[] tokens)

Beschreibung aus Schnittstelle kopiert: Detokenizer

Detokenizes the collection of tokens.

Angegeben von:

detokenize in Schnittstelle Detokenizer

Parameter:

tokens - The elements which should be detokenized.

Gibt zurück:

The merge operations to handle given tokens.

detokenize

public String detokenize(String[] tokens,
 String splitMarker)

Beschreibung aus Schnittstelle kopiert: Detokenizer

Detokenizes the input tokens into a String. Tokens which are connected without a whitespace character in between can be separated by a given splitMarker.

Angegeben von:

detokenize in Schnittstelle Detokenizer

Parameter:

tokens - The elements which should be concatenated.

splitMarker - The split marker or null.

Gibt zurück:

The concatenated tokens as a single string.