Class TokenizerCrossValidator
java.lang.Object
opennlp.tools.tokenize.TokenizerCrossValidator
A cross validator for
tokenizers.-
Field Summary
FieldsModifier and TypeFieldDescriptionprivate final TokenizerFactoryprivate final FMeasureprivate final TokenizerEvaluationMonitor[]private final TrainingParameters -
Constructor Summary
ConstructorsConstructorDescriptionTokenizerCrossValidator(TrainingParameters params, TokenizerFactory factory, TokenizerEvaluationMonitor... listeners) Creates aTokenizerCrossValidatorusing the givenTokenizerFactory. -
Method Summary
Modifier and TypeMethodDescriptionvoidevaluate(ObjectStream<TokenSample> samples, int nFolds) Starts the evaluation.
-
Field Details
-
params
-
fmeasure
-
listeners
-
factory
-
-
Constructor Details
-
TokenizerCrossValidator
public TokenizerCrossValidator(TrainingParameters params, TokenizerFactory factory, TokenizerEvaluationMonitor... listeners) Creates aTokenizerCrossValidatorusing the givenTokenizerFactory.- Parameters:
params- TheTrainingParametersfor the context of cross validation.factory- TheTokenizerFactoryto be used.listeners- Theevaluation listeners.
-
-
Method Details
-
evaluate
Starts the evaluation.- Parameters:
samples- TheObjectStreamofsamplesto train and test with.nFolds- Number of folds. It must be greater than zero.- Throws:
IOException- Thrown if IO errors occurred during evaluation.
-
getFMeasure
-