Tokenizer (Manifold :: Templates 2026.1.6 API)

java.lang.Object
- manifold.templates.tokenizer.Tokenizer

```
public class Tokenizer
extends Object
```

- Constructor Summary
  
  Constructors
  Constructor Description
  
  Tokenizer()
- Method Summary
  
  All Methods Instance Methods Concrete Methods
  Modifier and Type Method Description
  
  List<Token> tokenize(CharSequence text)
  - Methods inherited from class java.lang.Object
    clone, emptyArray, equals, finalize, getClass, hashCode, jailbreak, notify, notifyAll, toString, wait, wait, wait

Constructor Detail
- Tokenizer
```
public Tokenizer()
```

Method Detail

tokenize

public List<Token> tokenize(CharSequence text)