Package opennlp.tools.tokenize

Klasse TokenizerModel

java.lang.Object

opennlp.tools.util.model.BaseModel

opennlp.tools.tokenize.TokenizerModel

Alle implementierten Schnittstellen:

Serializable, ArtifactProvider

public final class TokenizerModel
extends BaseModel

The TokenizerModel is the model used by a learnable Tokenizer.

Siehe auch:

• TokenizerME
• TokenizerFactory
• Serialisierte Form

Feldübersicht

Von Klasse geerbte Felder opennlp.tools.util.model.BaseModel

TRAINING_CUTOFF_PROPERTY, TRAINING_EVENTHASH_PROPERTY, TRAINING_ITERATIONS_PROPERTY

Konstruktorübersicht

Konstruktoren

Konstruktor	Beschreibung
TokenizerModel(File modelFile)	Initializes a TokenizerModel instance via a valid File.
TokenizerModel(InputStream in)	Initializes a TokenizerModel instance via a valid InputStream.
TokenizerModel(URL modelURL)	Initializes a TokenizerModel instance via a valid URL.
TokenizerModel(Path modelPath)	Initializes a TokenizerModel instance via a valid Path.
TokenizerModel(MaxentModel tokenizerModel, Map<String,String> manifestInfoEntries, TokenizerFactory tokenizerFactory)	Initializes a TokenizerModel instance via a MaxentModel and related resources.

Methodenübersicht

Modifizierer und Typ	Methode	Beschreibung
boolean	equals(Object obj)
Dictionary	getAbbreviations()
TokenizerFactory	getFactory()
MaxentModel	getMaxentModel()
int	hashCode()
boolean	useAlphaNumericOptimization()

Von Klasse geerbte Methoden opennlp.tools.util.model.BaseModel

getArtifact, getLanguage, getManifestProperty, getVersion, isLoadedFromSerialized, serialize, serialize, serialize

Von Klasse geerbte Methoden java.lang.Object

getClass, notify, notifyAll, toString, wait, wait, wait

Konstruktordetails

TokenizerModel

public TokenizerModel(MaxentModel tokenizerModel,
 Map<String,String> manifestInfoEntries,
 TokenizerFactory tokenizerFactory)

Initializes a TokenizerModel instance via a MaxentModel and related resources.

Parameter:

tokenizerModel - The model to be used.

manifestInfoEntries - Additional information kept in the manifest.

tokenizerFactory - The TokenizerFactory to be used internally.

TokenizerModel

public TokenizerModel(InputStream in)
               throws IOException

Initializes a TokenizerModel instance via a valid InputStream.

Parameter:

in - The InputStream used for loading the model.

Löst aus:

IOException - Thrown if IO errors occurred during initialization.

TokenizerModel

public TokenizerModel(File modelFile)
               throws IOException

Initializes a TokenizerModel instance via a valid File.

Parameter:

modelFile - The File used for loading the model.

Löst aus:

IOException - Thrown if IO errors occurred during initialization.

TokenizerModel

public TokenizerModel(Path modelPath)
               throws IOException

Initializes a TokenizerModel instance via a valid Path.

Parameter:

modelPath - The Path used for loading the model.

Löst aus:

IOException - Thrown if IO errors occurred during initialization.

TokenizerModel

public TokenizerModel(URL modelURL)
               throws IOException

Initializes a TokenizerModel instance via a valid URL.

Parameter:

modelURL - The URL used for loading the model.

Löst aus:

IOException - Thrown if IO errors occurred during initialization.

Methodendetails

getFactory

public TokenizerFactory getFactory()

Gibt zurück:

Retrieves the active TokenizerFactory.

getMaxentModel

public MaxentModel getMaxentModel()

Gibt zurück:

Retrieves the model as MaxentModel instance.

getAbbreviations

public Dictionary getAbbreviations()

Gibt zurück:

Retrieves the active abbreviation Dictionary.

useAlphaNumericOptimization

public boolean useAlphaNumericOptimization()

Gibt zurück:

true if alphanumeric optimization is active, false otherwise.

hashCode

public int hashCode()

Setzt außer Kraft:

hashCode in Klasse Object

equals

public boolean equals(Object obj)

Setzt außer Kraft:

equals in Klasse Object