Class TokenizerEvaluator
The
TokenizerEvaluator measures the performance of
the given Tokenizer with the provided reference
samples.- See Also:
-
Field Summary
Fields -
Constructor Summary
ConstructorsConstructorDescriptionTokenizerEvaluator(Tokenizer tokenizer, TokenizerEvaluationMonitor... listeners) Initializes an instance to evaluate aTokenizer. -
Method Summary
Modifier and TypeMethodDescriptionprotected TokenSampleprocessSample(TokenSample reference) Evaluates the given referenceTsample object.Methods inherited from class Evaluator
evaluate, evaluateSample
-
Field Details
-
fmeasure
-
tokenizer
-
-
Constructor Details
-
TokenizerEvaluator
Initializes an instance to evaluate aTokenizer.- Parameters:
tokenizer- TheTokenizerto evaluate.listeners- Theevaluation listeners.
-
-
Method Details
-
processSample
Description copied from class:EvaluatorEvaluates the given referenceTsample object.The implementation has to update the score after every invocation.
- Specified by:
processSamplein classEvaluator<TokenSample>- Parameters:
reference- Areference sample.- Returns:
- The predicted
sample.
-
getFMeasure
-