Package opennlp.tools.tokenize
Class WhitespaceTokenStream
- java.lang.Object
-
- opennlp.tools.util.FilterObjectStream<TokenSample,String>
-
- opennlp.tools.tokenize.WhitespaceTokenStream
-
- All Implemented Interfaces:
AutoCloseable
,ObjectStream<String>
public class WhitespaceTokenStream extends FilterObjectStream<TokenSample,String>
This stream formatsObjectStream
ofsamples
into whitespace separated token strings.
-
-
Constructor Summary
Constructors Constructor Description WhitespaceTokenStream(ObjectStream<TokenSample> tokens)
Initializes aWhitespaceTokenStream
.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description String
read()
Returns the nextObjectStream
object.-
Methods inherited from class opennlp.tools.util.FilterObjectStream
close, reset
-
-
-
-
Constructor Detail
-
WhitespaceTokenStream
public WhitespaceTokenStream(ObjectStream<TokenSample> tokens)
Initializes aWhitespaceTokenStream
.- Parameters:
tokens
- Thestream
of tokens to be separated.
-
-
Method Detail
-
read
public String read() throws IOException
Description copied from interface:ObjectStream
Returns the nextObjectStream
object. Calling this method repeatedly until it returnsnull
will return each object from the underlying source exactly once.- Returns:
- The next object or
null
to signal that the stream is exhausted. - Throws:
IOException
- Thrown if there is an error during reading.
-
-