lex

This library aids in lexing programming languages.

Design

The library was designed for simplicity, not customization. There is a single lexer implementation that should be general enough for most programming languages. Later versions may support customization.

Usage

To use this library you create a lexer and feed it source code:

use lex::{Lexer, Lex};

let lexer: Lexer = Lexer::new();
let source: &'static str = "Hello, World!";
let lex: Lex<'static> = lexer.lex(source);