Class EmptyLinePreprocessorStream

java.lang.Object

opennlp.tools.util.FilterObjectStream<String,String>

opennlp.tools.sentdetect.EmptyLinePreprocessorStream

All Implemented Interfaces:

AutoCloseable, opennlp.tools.util.ObjectStream<String>

@Internal
public class EmptyLinePreprocessorStream
extends FilterObjectStream<String,String>

ObjectStream to clean up empty lines for empty line separated document streams.
- Skips empty line at training data start
- Transforms multiple empty lines in a row into one
- Replaces white space lines with empty lines
- TODO: Terminates last document with empty line if it is missing

This stream should be used by the components that mark empty lines to mark document boundaries.

Note: This class is not thread safe.

Note: Do not use this class, internal use only!

Constructor Summary

Constructors

Constructor	Description
EmptyLinePreprocessorStream(opennlp.tools.util.ObjectStream<String> in)

Method Summary

Modifier and Type	Method	Description
String	read()

Methods inherited from class FilterObjectStream

close, reset

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

EmptyLinePreprocessorStream

public EmptyLinePreprocessorStream(opennlp.tools.util.ObjectStream<String> in)

Method Details

read

public String read()
            throws IOException

Throws:

IOException