Class WhitespaceTokenizer

java.lang.Object
org.apache.uima.analysis_component.AnalysisComponent_ImplBase
org.apache.uima.analysis_component.Annotator_ImplBase
org.apache.uima.analysis_component.CasAnnotator_ImplBase
opennlp.uima.tokenize.AbstractTokenizer
opennlp.uima.tokenize.WhitespaceTokenizer
All Implemented Interfaces:
org.apache.uima.analysis_component.AnalysisComponent

public final class WhitespaceTokenizer extends AbstractTokenizer
An OpenNLP-based Whitespace Tokenizer annotator.

Mandatory parameters

Type Name Description
String opennlp.uima.SentenceType The full name of the sentence type
String opennlp.uima.TokenType The full name of the token type
  • Field Summary

    Fields inherited from class AbstractTokenizer

    context, logger, name, sentenceType, tokenType
  • Constructor Summary

    Constructors
    Constructor
    Description
    Initializes the current instance.
  • Method Summary

    Modifier and Type
    Method
    Description
    protected void
    postProcessAnnotations(Span[] detectedNames, org.apache.uima.cas.text.AnnotationFS[] nameAnnotations)
     
    protected Span[]
    tokenize(org.apache.uima.cas.CAS cas, org.apache.uima.cas.text.AnnotationFS sentence)
     

    Methods inherited from class AbstractTokenizer

    initialize, process, typeSystemInit

    Methods inherited from class org.apache.uima.analysis_component.CasAnnotator_ImplBase

    getRequiredCasInterface, process

    Methods inherited from class org.apache.uima.analysis_component.Annotator_ImplBase

    getCasInstancesRequired, hasNext, next

    Methods inherited from class org.apache.uima.analysis_component.AnalysisComponent_ImplBase

    batchProcessComplete, collectionProcessComplete, destroy, getContext, getLogger, getResultSpecification, reconfigure, setResultSpecification

    Methods inherited from class Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
  • Constructor Details

  • Method Details

    • tokenize

      protected Span[] tokenize(org.apache.uima.cas.CAS cas, org.apache.uima.cas.text.AnnotationFS sentence)
      Specified by:
      tokenize in class AbstractTokenizer
    • postProcessAnnotations

      protected void postProcessAnnotations(Span[] detectedNames, org.apache.uima.cas.text.AnnotationFS[] nameAnnotations)
      Specified by:
      postProcessAnnotations in class AbstractTokenizer