public class TokenizerStream extends Object implements ObjectStream<TokenSample>
TokenizerStream
uses a tokenizer to tokenize the
input string and output TokenSample
s.Constructor and Description |
---|
TokenizerStream(Tokenizer tokenizer,
ObjectStream<String> input) |
Modifier and Type | Method and Description |
---|---|
void |
close()
Closes the
ObjectStream and releases all allocated
resources. |
TokenSample |
read()
Returns the next object.
|
void |
reset()
Repositions the stream at the beginning and the previously seen object sequence
will be repeated exactly.
|
public TokenizerStream(Tokenizer tokenizer, ObjectStream<String> input)
public TokenSample read() throws IOException
ObjectStream
read
in interface ObjectStream<TokenSample>
IOException
- if there is an error during readingpublic void close() throws IOException
ObjectStream
ObjectStream
and releases all allocated
resources. After close was called its not allowed to call
read or reset.close
in interface AutoCloseable
close
in interface ObjectStream<TokenSample>
IOException
- if there is an error during closing the streampublic void reset() throws IOException, UnsupportedOperationException
ObjectStream
reset
in interface ObjectStream<TokenSample>
IOException
- if there is an error during reseting the streamUnsupportedOperationException
Copyright © 2018 The Apache Software Foundation. All rights reserved.