opennlp.tools.tokenize
Class WhitespaceTokenStream
java.lang.Object
opennlp.tools.util.FilterObjectStream<TokenSample,String>
opennlp.tools.tokenize.WhitespaceTokenStream
- All Implemented Interfaces:
- ObjectStream<String>
public class WhitespaceTokenStream
- extends FilterObjectStream<TokenSample,String>
This stream formats a TokenSample
s into whitespace
separated token strings.
Method Summary |
String |
read()
Returns the next object. |
WhitespaceTokenStream
public WhitespaceTokenStream(ObjectStream<TokenSample> tokens)
read
public String read()
throws IOException
- Description copied from interface:
ObjectStream
- Returns the next object. Calling this method repeatedly until it returns
null will return each object from the underlying source exactly once.
- Returns:
- the next object or null to signal that the stream is exhausted
- Throws:
IOException
Copyright © 2013 The Apache Software Foundation. All Rights Reserved.