Uses of Class
opennlp.tools.tokenize.WhitespaceTokenizer
Packages that use WhitespaceTokenizer
Package
Description
Contains classes related to finding token or words in a string.
-
Uses of WhitespaceTokenizer in opennlp.tools.tokenize
Fields in opennlp.tools.tokenize declared as WhitespaceTokenizerModifier and TypeFieldDescriptionstatic final WhitespaceTokenizerWhitespaceTokenizer.INSTANCEUse this static reference to retrieve an instance of theWhitespaceTokenizer.private static final WhitespaceTokenizerTokenizerME.WHITESPACEprivate static final WhitespaceTokenizerTokenizerME.WHITESPACE_KEEPING_NEW_LINESMethods in opennlp.tools.tokenize that return WhitespaceTokenizerModifier and TypeMethodDescriptionstatic WhitespaceTokenizerWhitespaceTokenizer.newInstance(boolean keepNewLines) Creates a tokenizer that is not shared withWhitespaceTokenizer.INSTANCE, for a caller that setsAbstractTokenizer.setKeepNewLines(boolean)without touching other users of the shared instance.