bnf_LLMSampler

This is a language model sampler that uses a Backus–Naur form schema to compute allowed logits.

how to try it?

1. Ensure you have a working rust environment(see https://www.rust-lang.org/tools/install)
2. Clone the repository
3. Type cd <your_cloned_repository_path> in command line
4. Type cargo build --release in command line
5. Start the executable