A memory efficient syntax tree.
This crate provides a tree structure which always is contiguously stored and
manipulated in memory. It provides similar APIs as [rowan] and is intended
to be an efficient replacement for it (read more below).
Add syntree to your crate:
toml
syntree = "0.7.0"
If you want a complete sample for how syntree can be used for parsing, see
the [calculator example].
This crate provides a way to efficiently model [abstract syntax trees]. The nodes of the tree are typically represented by variants in an enum, but [could be whatever you want].
Each tree consists of nodes and tokens. Nodes are intermediary elements in the tree which encapsulate zero or more other nodes or tokens, while tokens are leaf elements representing exact source locations.
An example tree for the simple expression 128 + 64 could be represented
like this:
Try it for yourself with:
sh cargo run --example calculator -- "128 + 64"
NUMBER@0..3
NUMBER@0..3 "128"
WHITESPACE@3..4 " "
OPERATOR@4..5
PLUS@4..5 "+"
WHITESPACE@5..6 " "
NUMBER@6..8
NUMBER@6..8 "64"
The primary difference between syntree and [rowan] is that we don't
store the original source in the syntax tree. Instead, the user of the
library is responsible for providing it as necessary. Like when calling
[printwithsource].
The API for constructing a syntax tree is provided through [TreeBuilder] which provides streaming builder methods. Internally the builder is represented as a contiguous slab of memory. Once a tree is built the structure of the tree can be queried through the [Tree] type.
```rust use syntree::{Span, TreeBuilder};
enum Syntax { OPERATION, NUMBER, PLUS, MINUS, WHITESPACE, }
use Syntax::*;
let mut b = TreeBuilder::new();
b.open(OPERATION);
b.open(OPERATION);
b.open(NUMBER); b.token(NUMBER, 4); b.close()?;
b.token(WHITESPACE, 1);
b.open(PLUS); b.token(PLUS, 1); b.close()?;
b.token(WHITESPACE, 1);
b.open(NUMBER); b.token(NUMBER, 5); b.close()?;
b.close()?;
b.token(WHITESPACE, 1);
b.open(MINUS); b.token(MINUS, 1); b.close()?;
b.token(WHITESPACE, 1);
b.open(NUMBER); b.token(NUMBER, 3); b.close()?;
b.close()?;
let tree = b.build()?;
assert_eq!(tree.children().count(), 1); ```
License: MIT/Apache-2.0