Package opennlp.tools.tokenize

Klasse TokenizerStream

java.lang.Object

opennlp.tools.tokenize.TokenizerStream

Alle implementierten Schnittstellen:

AutoCloseable, ObjectStream<TokenSample>

public class TokenizerStream
extends Object
implements ObjectStream<TokenSample>

The TokenizerStream uses a Tokenizer to tokenize the input string and output samples.

Konstruktorübersicht

Konstruktoren

Konstruktor	Beschreibung
TokenizerStream(Tokenizer tokenizer, ObjectStream<String> input)	Initializes a instance.

Methodenübersicht

Modifizierer und Typ	Methode	Beschreibung
void	close()	Closes the ObjectStream and releases all allocated resources.
TokenSample	read()	Returns the next ObjectStream object.
void	reset()	Repositions the stream at the beginning and the previously seen object sequence will be repeated exactly.

Von Klasse geerbte Methoden java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Konstruktordetails

TokenizerStream

public TokenizerStream(Tokenizer tokenizer,
 ObjectStream<String> input)

Initializes a instance.

Parameter:

tokenizer - A working Tokenizer instance.

input - A plain text line stream.

Methodendetails

read

public TokenSample read()
                 throws IOException

Beschreibung aus Schnittstelle kopiert: ObjectStream

Returns the next ObjectStream object. Calling this method repeatedly until it returns null will return each object from the underlying source exactly once.

Angegeben von:

read in Schnittstelle ObjectStream<TokenSample>

Gibt zurück:

The next object or null to signal that the stream is exhausted.

Löst aus:

IOException - Thrown if there is an error during reading.

close

public void close()
           throws IOException

Beschreibung aus Schnittstelle kopiert: ObjectStream

Closes the ObjectStream and releases all allocated resources. After close was called, it's not allowed to call ObjectStream.read() or ObjectStream.reset().

Angegeben von:

close in Schnittstelle AutoCloseable

Angegeben von:

close in Schnittstelle ObjectStream<TokenSample>

Löst aus:

IOException - Thrown if there is an error during closing the stream.

reset

public void reset()
           throws IOException,
UnsupportedOperationException

Beschreibung aus Schnittstelle kopiert: ObjectStream

Repositions the stream at the beginning and the previously seen object sequence will be repeated exactly. This method can be used to re-read the stream if multiple passes over the objects are required.

The implementation of this method is optional.

Angegeben von:

reset in Schnittstelle ObjectStream<TokenSample>

Löst aus:

IOException - Thrown if there is an error during resetting the stream.

UnsupportedOperationException - Thrown if the reset() is not supported. By default, this is the case.