Package opennlp.tools.tokenize

Klasse TokSpanEventStream

java.lang.Object

opennlp.tools.util.AbstractEventStream<TokenSample>

opennlp.tools.tokenize.TokSpanEventStream

Alle implementierten Schnittstellen:

AutoCloseable, ObjectStream<Event>

public class TokSpanEventStream
extends AbstractEventStream<TokenSample>

This class reads the samples via an Iterator and converts the samples into events which can be used by the maxent library for training.

Konstruktorübersicht

Konstruktoren

Konstruktor	Beschreibung
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics)	Initializes a new event stream based on the data stream using a TokenContextGenerator that relies on a DefaultTokenContextGenerator.
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, Pattern alphaNumeric, TokenContextGenerator cg)	Initializes a new event stream based on the data stream using a TokenContextGenerator.
TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, TokenContextGenerator cg)	Initializes a new event stream based on the data stream using a TokenContextGenerator.

Methodenübersicht

Von Klasse geerbte Methoden opennlp.tools.util.AbstractEventStream

close, read, reset

Von Klasse geerbte Methoden java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Konstruktordetails

TokSpanEventStream

public TokSpanEventStream(ObjectStream<TokenSample> tokenSamples,
 boolean skipAlphaNumerics,
 Pattern alphaNumeric,
 TokenContextGenerator cg)

Initializes a new event stream based on the data stream using a TokenContextGenerator.

Parameter:

tokenSamples - The data stream for this event stream.

skipAlphaNumerics - Whether alphanumerics are skipped, or not.

alphaNumeric - A custom alphanumeric Pattern or null. Default is: "^[A-Za-z0-9]+$", provided by Factory.DEFAULT_ALPHANUMERIC.

cg - A TokenContextGenerator which should be used for the event stream d.

TokSpanEventStream

public TokSpanEventStream(ObjectStream<TokenSample> tokenSamples,
 boolean skipAlphaNumerics,
 TokenContextGenerator cg)

Initializes a new event stream based on the data stream using a TokenContextGenerator.

Parameter:

tokenSamples - The data stream for this event stream.

skipAlphaNumerics - Whether alphanumerics are skipped, or not.

cg - A TokenContextGenerator which should be used for the event stream d.

TokSpanEventStream

public TokSpanEventStream(ObjectStream<TokenSample> tokenSamples,
 boolean skipAlphaNumerics)

Initializes a new event stream based on the data stream using a TokenContextGenerator that relies on a DefaultTokenContextGenerator.

Parameter:

tokenSamples - The data stream for this event stream.

skipAlphaNumerics - Whether alphanumerics are skipped, or not.