Breaks the input into a set of tokens.
            
        
    Namespace: 
   SingularSys.Jep.ConfigurableParserAssembly: Jep (in Jep.dll) Version: 1.1.0.0 (1.0.0)
Syntax
| C# | 
|---|
public class Tokenizer  | 
| Visual Basic (Declaration) | 
|---|
Public Class Tokenizer  | 
| Visual C++ | 
|---|
public ref class Tokenizer  |