Class ADPOSSampleStream
java.lang.Object
opennlp.tools.formats.ad.ADPOSSampleStream
- All Implemented Interfaces:
AutoCloseable, ObjectStream<POSSample>
Note:
Do not use this class, internal use only!
-
Field Summary
FieldsModifier and TypeFieldDescriptionprivate final ObjectStream<ADSentenceStream.Sentence> private final booleanprivate final booleanprivate static final Pattern -
Constructor Summary
ConstructorsConstructorDescriptionADPOSSampleStream(InputStreamFactory in, String charsetName, boolean expandME, boolean includeFeatures) Creates a newPOSSamplestream from anInputStreamFactoryADPOSSampleStream(ObjectStream<String> lineStream, boolean expandME, boolean includeFeatures) Creates a newADPOSSampleStreamstream from aObjectStream<String>, that could be aPlainTextByLineStreamobject. -
Method Summary
Modifier and TypeMethodDescriptionvoidclose()Closes theObjectStreamand releases all allocated resources.private voidprivate voidprocessLeaf(ADSentenceStream.SentenceParser.Leaf leaf, List<String> sentence, List<String> tags) read()Returns the nextTobject.voidreset()Repositions the stream at the beginning and the previously seen object sequence will be repeated exactly.
-
Field Details
-
WHITESPACES_PATTERN
-
adSentenceStream
-
expandME
private final boolean expandME -
isIncludeFeatures
private final boolean isIncludeFeatures
-
-
Constructor Details
-
ADPOSSampleStream
public ADPOSSampleStream(ObjectStream<String> lineStream, boolean expandME, boolean includeFeatures) Creates a newADPOSSampleStreamstream from aObjectStream<String>, that could be aPlainTextByLineStreamobject.- Parameters:
lineStream- AObjectStream<String>stream as input.expandME- Iftruewill expand the multiword expressions, each word of the expression will have the POS Tag that was attributed to the expression plus the prefixB-orI-(CONLL convention).includeFeatures- Iftruewill combine the POS Tag with the feature tags.
-
ADPOSSampleStream
public ADPOSSampleStream(InputStreamFactory in, String charsetName, boolean expandME, boolean includeFeatures) throws IOException Creates a newPOSSamplestream from anInputStreamFactory- Parameters:
in- TheInputStreamFactoryfor the corpus.charsetName- Thecharsetto use for reading of the corpus.expandME- Iftruewill expand the multiword expressions, each word of the expression will have the POS Tag that was attributed to the expression plus the prefixB-orI-(CONLL convention).includeFeatures- Iftruewill combine the POS Tag with the feature tags.- Throws:
IOException
-
-
Method Details
-
read
Description copied from interface:ObjectStreamReturns the nextTobject. Calling this method repeatedly until it returnsnullwill return each object from the underlying source exactly once.- Specified by:
readin interfaceObjectStream<POSSample>- Returns:
- The next object or
nullto signal that the stream is exhausted. - Throws:
IOException- Thrown if there is an error during reading.
-
process
private void process(ADSentenceStream.SentenceParser.Node node, List<String> sentence, List<String> tags) -
processLeaf
private void processLeaf(ADSentenceStream.SentenceParser.Leaf leaf, List<String> sentence, List<String> tags) -
reset
Description copied from interface:ObjectStreamRepositions the stream at the beginning and the previously seen object sequence will be repeated exactly. This method can be used to re-read the stream if multiple passes over the objects are required.The implementation of this method is optional.
- Specified by:
resetin interfaceObjectStream<POSSample>- Throws:
IOException- Thrown if there is an error during resetting the stream.UnsupportedOperationException- Thrown if thereset()is not supported. By default, this is the case.
-
close
Description copied from interface:ObjectStreamCloses theObjectStreamand releases all allocated resources. After close was called, it's not allowed to callObjectStream.read()orObjectStream.reset().- Specified by:
closein interfaceAutoCloseable- Specified by:
closein interfaceObjectStream<POSSample>- Throws:
IOException- Thrown if there is an error during closing the stream.
-