utf8conv

Parser for reading and converting between UTF8 / UTF32 data without requiring heap memory, targeting no_std environments

Utf8conv can operate based on a single input buffer, or a series of input buffers. The outputs are produced one at a time, directly delivered to client caller with minimum latency.

Utf8conv is dual licensed under the MIT License, and Apache 2.0 License.

Credits attribution of utf8conv is located at crate directory doc/utf8conv-credits.md.

Single buffer iterator based UTF8 parsing

``` use utf8conv::prelude::*;

/// Single buffer iterator based UTF8 parsing /// converting to char fn main() { let mybuffer = "abc".asbytes(); let mut utf8refiter = mybuffer.iter(); let mut parser = FromUtf8::new(); let mut iterator = parser.utf8reftocharwithiter(& mut utf8refiter); while let Some(charval) = iterator.next() { println!("{}", charval); println!("{}", iterator.hasinvalidsequence()); } }

```

Multi-buffer iterator based UTF8 parsing

``` use utf8conv::prelude::*;

/// Multi-buffer iterator based UTF8 parsing /// converting to char fn main() { let mybuffers = ["ab".asbytes(), "".asbytes(), "cde".asbytes()]; let mut parser = FromUtf8::new(); for indx in 0 .. mybuffers.len() { parser.setislastbuffer(indx == mybuffers.len() - 1); let mut utf8refiter = mybuffers[indx].iter(); let mut iterator = parser.utf8reftocharwithiter(& mut utf8refiter); while let Some(charval) = iterator.next() { println!("{}", charval); println!("{}", iterator.hasinvalid_sequence()); } } } ```

Multi-buffer slice reading based UTF8 parsing

``` use utf8conv::prelude::*;

/// Multi-buffer slice reading based UTF8 parsing /// converting to char fn main() { let mybuffers = ["Wx".asbytes(), "".asbytes(), "yz".asbytes()]; let mut parser = FromUtf8::new(); for indx in 0 .. mybuffers.len() { parser.setislastbuffer(indx == mybuffers.len() - 1); let mut curslice = mybuffers[indx]; loop { match parser.utf8tochar(curslice) { Result::Ok((slicepos, charval)) => { curslice = slicepos; println!("{}", charval); println!("{}", parser.hasinvalidsequence()); } Result::Err(MoreEnum::More(amt)) => { // _amt equals to 0 when end of data break; } } } } } ```