Package opennlp.tools.tokenize
Klasse WhitespaceTokenStream
java.lang.Object
opennlp.tools.util.FilterObjectStream<TokenSample,String>
opennlp.tools.tokenize.WhitespaceTokenStream
- Alle implementierten Schnittstellen:
AutoCloseable
,ObjectStream<String>
This stream formats
ObjectStream
of samples
into whitespace
separated token strings.-
Konstruktorübersicht
KonstruktorenKonstruktorBeschreibungWhitespaceTokenStream
(ObjectStream<TokenSample> tokens) Initializes aWhitespaceTokenStream
. -
Methodenübersicht
Von Klasse geerbte Methoden opennlp.tools.util.FilterObjectStream
close, reset
-
Konstruktordetails
-
WhitespaceTokenStream
Initializes aWhitespaceTokenStream
.- Parameter:
tokens
- Thestream
of tokens to be separated.
-
-
Methodendetails
-
read
Beschreibung aus Schnittstelle kopiert:ObjectStream
Returns the nextObjectStream
object. Calling this method repeatedly until it returnsnull
will return each object from the underlying source exactly once.- Gibt zurück:
- The next object or
null
to signal that the stream is exhausted. - Löst aus:
IOException
- Thrown if there is an error during reading.
-