Turn Traditional Chinese script to Simplified Chinese script and vice-versa. Check string script to determine if string is Traditional or Simplified Chinese Characters.
This package also includes a largest first matching tokenizer.
```rust extern crate character_converter;
use characterconverter::{istraditional, issimplified, traditionaltosimplified, simplifiedto_traditional, tokenize};
let traditionaltext = "歐洲"; let simplifiedtext = "欧洲";
// Check script assert!(istraditional(traditionaltext));
assert!(!issimplified(traditionaltext));
// Convert script let resultthree = traditionaltosimplified(traditionaltext); asserteq!(resultthree, simplified_text);
let resultfour = simplifiedtotraditional(simplifiedtext); asserteq!(resultfour, traditional_text);
// Tokenize let string = "好好学习天天向上."; let tokens = vec!["好好", "学习", "天天", "向上"]; assert_eq!(tokens, tokenize(string)); ```
Run benchmarks using the nightly bench feature:
cargo +nightly bench --features=bench