|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectcom.singularsys.jep.configurableparser.Tokenizer
public class Tokenizer
Breaks the input into a set of tokens.
Constructor Summary | |
---|---|
Tokenizer(java.io.BufferedReader br,
java.util.List<TokenMatcher> matchers)
Construct a tokenizer for a given input. |
Method Summary | |
---|---|
java.util.List<Token> |
scan()
|
static java.lang.String |
toString(java.util.List<Token> toks)
|
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public Tokenizer(java.io.BufferedReader br, java.util.List<TokenMatcher> matchers)
br
- the input to read from.matchers
- a set of TokenMatchers to match the given input.Method Detail |
---|
public java.util.List<Token> scan() throws ParseException
ParseException
public static java.lang.String toString(java.util.List<Token> toks)
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |