Package manifold.js.rt.parser

Class Tokenizer

java.lang.Object

manifold.js.rt.parser.Tokenizer

Direct Known Subclasses:

TemplateTokenizer

public class Tokenizer
extends Object

Constructor Summary

Constructors

Constructor	Description
Tokenizer(String source, String url)

Method Summary

Modifier and Type	Method	Description
Token	next()
List<Token>	tokenize()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Tokenizer

public Tokenizer(String source,
                 String url)

Method Detail

next

public Token next()

tokenize

public List<Token> tokenize()