Package opennlp.tools.langdetect

Klasse LanguageDetectorME

java.lang.Object

opennlp.tools.langdetect.LanguageDetectorME

Alle implementierten Schnittstellen:

Serializable, LanguageDetector

public class LanguageDetectorME
extends Object
implements LanguageDetector

Implements a learnable LanguageDetector.

This will process the entire string when called with predictLanguage(CharSequence) or predictLanguages(CharSequence).

If you want this to stop early, use probingPredictLanguages(CharSequence) or probingPredictLanguages(CharSequence, LanguageDetectorConfig). When run in probing mode, this starts at the beginning of the char sequence and runs language detection on chunks of text. If the end of the string is reached or there are LanguageDetectorConfig.getMinConsecImprovements() consecutive predictions for the best language and the confidence increases over those last predictions and if the difference in confidence between the highest confidence language and the second highest confidence language is greater than LanguageDetectorConfig.getMinDiff(), the language detector will stop and report the results.

The authors wish to thank Ken Krugler and Yalder} for the inspiration for many of the design components of this detector.

Siehe auch:

• Serialisierte Form

Konstruktorübersicht

Konstruktoren

Konstruktor	Beschreibung
LanguageDetectorME(LanguageDetectorModel model)	Initializes an instance with a specific LanguageDetectorModel.

Methodenübersicht

Modifizierer und Typ	Methode	Beschreibung
String[]	getSupportedLanguages()
Language	predictLanguage(CharSequence content)	Predicts the Language for the full content length.
Language[]	predictLanguages(CharSequence content)	Predicts the languages for the full content length.
ProbingLanguageDetectionResult	probingPredictLanguages(CharSequence content)	This will stop processing early if the stopping criteria specified in LanguageDetectorConfig.DEFAULT_LANGUAGE_DETECTOR_CONFIG are met.
ProbingLanguageDetectionResult	probingPredictLanguages(CharSequence content, LanguageDetectorConfig config)	This will stop processing early if the stopping criteria specified in LanguageDetectorConfig.DEFAULT_LANGUAGE_DETECTOR_CONFIG are met.
static LanguageDetectorModel	train(ObjectStream<LanguageSample> samples, TrainingParameters mlParams, LanguageDetectorFactory factory)	Starts a training of a LanguageDetectorModel with the given parameters.

Von Klasse geerbte Methoden java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Konstruktordetails

LanguageDetectorME

public LanguageDetectorME(LanguageDetectorModel model)

Initializes an instance with a specific LanguageDetectorModel. Default feature generation is used.

Parameter:

model - the LanguageDetectorModel to be used.

Methodendetails

predictLanguages

public Language[] predictLanguages(CharSequence content)

Beschreibung aus Schnittstelle kopiert: LanguageDetector

Predicts the languages for the full content length.

Angegeben von:

predictLanguages in Schnittstelle LanguageDetector

Parameter:

content - The textual content to detect potential languages from.

Gibt zurück:

the predicted languages

predictLanguage

public Language predictLanguage(CharSequence content)

Beschreibung aus Schnittstelle kopiert: LanguageDetector

Predicts the Language for the full content length.

Angegeben von:

predictLanguage in Schnittstelle LanguageDetector

Parameter:

content - The textual content to detect potential languages from.

Gibt zurück:

the language with the highest confidence

getSupportedLanguages

public String[] getSupportedLanguages()

Angegeben von:

getSupportedLanguages in Schnittstelle LanguageDetector

Gibt zurück:

Retrieves an array of language (codes) that are supported by a LanguageDetector.

probingPredictLanguages

public ProbingLanguageDetectionResult probingPredictLanguages(CharSequence content)

This will stop processing early if the stopping criteria specified in LanguageDetectorConfig.DEFAULT_LANGUAGE_DETECTOR_CONFIG are met.

Parameter:

content - content to be processed

Gibt zurück:

A computed ProbingLanguageDetectionResult.

probingPredictLanguages

public ProbingLanguageDetectionResult probingPredictLanguages(CharSequence content,
 LanguageDetectorConfig config)

This will stop processing early if the stopping criteria specified in LanguageDetectorConfig.DEFAULT_LANGUAGE_DETECTOR_CONFIG are met.

Parameter:

content - The textual content to process.

config - The LanguageDetectorConfig to customize detection.

Gibt zurück:

A computed ProbingLanguageDetectionResult.

train

public static LanguageDetectorModel train(ObjectStream<LanguageSample> samples,
 TrainingParameters mlParams,
 LanguageDetectorFactory factory)
                                   throws IOException

Starts a training of a LanguageDetectorModel with the given parameters.

Parameter:

samples - The ObjectStream of LanguageSample used as input for training.

mlParams - The TrainingParameters for the context of the training.

factory - The LanguageDetectorFactory for creating related objects defined via mlParams.

Gibt zurück:

A valid, trained LanguageDetectorModel instance.

Löst aus:

IOException - Thrown if IO errors occurred.