serde_token

serde_token provides a utility for transcoding a Serde deserializer into a sink of Tokens.

Installation

Install from Crates.io:

toml [dependencies] serde_token = "0.0.2"

Usage

```rust use futures::{unsync::mpsc::unbounded, Future, Sink, Stream}; use serdejson::Deserializer; use serdetoken::{tokenize, Token};

let mut de = Deserializer::fromstr(r#" [ {"a":false}, "hello", 3 ] "#); let (tokensink, token_stream) = unbounded::();

tokenize(&mut de, token_sink).unwrap();

let expected = tokenstream.collect().wait().unwrap(); asserteq!(expected, vec![ Token::Seq { len: None }, Token::Map { len: None }, Token::Str("a"), Token::Bool(false), Token::MapEnd, Token::Str("hello"), Token::U64(3), Token::SeqEnd, ]) ```

TODO

• [ ] look into handling Sink sending better (i.e. support back-pressure)

Changelog

| Version | Change Summary | | ------- | ---------------| | v0.0.2 | adds README | | v0.0.1 | initial release |

Contributing

1. Fork it https://github.com/yourusername/serdetoken/fork
2. Create your feature branch (git checkout -b feature/fooBar)
3. Commit your changes (git commit -am 'Add some fooBar')
4. Push to the branch (git push origin feature/fooBar)
5. Create a new Pull Request

Maintainers

• Sunny G - @sunny-g

License

MIT