Class AbstractTokenizer
java.lang.Object
org.apache.uima.analysis_component.AnalysisComponent_ImplBase
org.apache.uima.analysis_component.Annotator_ImplBase
org.apache.uima.analysis_component.CasAnnotator_ImplBase
opennlp.uima.tokenize.AbstractTokenizer
- All Implemented Interfaces:
org.apache.uima.analysis_component.AnalysisComponent
- Direct Known Subclasses:
SimpleTokenizer, Tokenizer, WhitespaceTokenizer
public abstract class AbstractTokenizer
extends org.apache.uima.analysis_component.CasAnnotator_ImplBase
-
Field Summary
Fields -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionvoidinitialize(org.apache.uima.UimaContext context) protected abstract voidpostProcessAnnotations(Span[] tokens, org.apache.uima.cas.text.AnnotationFS[] tokenAnnotations) voidprocess(org.apache.uima.cas.CAS cas) protected abstract Span[]tokenize(org.apache.uima.cas.CAS cas, org.apache.uima.cas.text.AnnotationFS sentence) voidtypeSystemInit(org.apache.uima.cas.TypeSystem typeSystem) Methods inherited from class org.apache.uima.analysis_component.CasAnnotator_ImplBase
getRequiredCasInterface, processMethods inherited from class org.apache.uima.analysis_component.Annotator_ImplBase
getCasInstancesRequired, hasNext, nextMethods inherited from class org.apache.uima.analysis_component.AnalysisComponent_ImplBase
batchProcessComplete, collectionProcessComplete, destroy, getContext, getLogger, getResultSpecification, reconfigure, setResultSpecification
-
Field Details
-
name
-
context
protected org.apache.uima.UimaContext context -
logger
protected org.apache.uima.util.Logger logger -
sentenceType
protected org.apache.uima.cas.Type sentenceTypeType of the sentence containing the tokens. -
tokenType
protected org.apache.uima.cas.Type tokenTypeType of the tokens to be created. -
isRemoveExistingAnnotations
-
-
Constructor Details
-
AbstractTokenizer
-
-
Method Details
-
initialize
public void initialize(org.apache.uima.UimaContext context) throws org.apache.uima.resource.ResourceInitializationException - Specified by:
initializein interfaceorg.apache.uima.analysis_component.AnalysisComponent- Overrides:
initializein classorg.apache.uima.analysis_component.AnalysisComponent_ImplBase- Throws:
org.apache.uima.resource.ResourceInitializationException
-
typeSystemInit
public void typeSystemInit(org.apache.uima.cas.TypeSystem typeSystem) throws org.apache.uima.analysis_engine.AnalysisEngineProcessException - Overrides:
typeSystemInitin classorg.apache.uima.analysis_component.CasAnnotator_ImplBase- Throws:
org.apache.uima.analysis_engine.AnalysisEngineProcessException
-
postProcessAnnotations
protected abstract void postProcessAnnotations(Span[] tokens, org.apache.uima.cas.text.AnnotationFS[] tokenAnnotations) -
tokenize
protected abstract Span[] tokenize(org.apache.uima.cas.CAS cas, org.apache.uima.cas.text.AnnotationFS sentence) -
process
public void process(org.apache.uima.cas.CAS cas) throws org.apache.uima.analysis_engine.AnalysisEngineProcessException - Specified by:
processin classorg.apache.uima.analysis_component.CasAnnotator_ImplBase- Throws:
org.apache.uima.analysis_engine.AnalysisEngineProcessException
-