com.singularsys.jep.configurableparser
Class Tokenizer

java.lang.Object
  extended by com.singularsys.jep.configurableparser.Tokenizer

public class Tokenizer
extends java.lang.Object

Breaks the input into a set of tokens.


Constructor Summary
Tokenizer(java.io.BufferedReader br, java.util.List<TokenMatcher> matchers)
          Construct a tokenizer for a given input.
 
Method Summary
 java.util.List<Token> scan()
           
static java.lang.String toString(java.util.List<Token> toks)
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

Tokenizer

public Tokenizer(java.io.BufferedReader br,
                 java.util.List<TokenMatcher> matchers)
Construct a tokenizer for a given input.

Parameters:
br - the input to read from.
matchers - a set of TokenMatchers to match the given input.
Method Detail

scan

public java.util.List<Token> scan()
                           throws ParseException
Throws:
ParseException

toString

public static java.lang.String toString(java.util.List<Token> toks)


Copyright © 2007 Singular Systems http://www.singularsys.com/jep