tiny-string-rs

tiny-string-rs is a library built for Rust to compress strings using a generated dictionary. Use training data to improve the performance depending on the type of data you want to compress.

Dictionary slot length

When generating a dictionary, you can specify the slot length as the second parameter, eg: rust let dict: Vec<String> = generate_dictionary(contents, 5); // slot length of 5 Note: The larger the slot length, the more computationally expensive it will be for generating a dictionary. If you choose a slot size larger than 6, it is recommended that you cache the dictionary for re-use.

Dictionary size

Dictionary size is currently fixed at 896. The first 128 ASCII characters are reserved for the standard character set. String length can be reduced 40-65% with compression. True compression size (total byte size of string) will be much less than the string length.

Sample usage

```rust extern crate testmark; use testmark::Testmark; use testmark::Timer;

use tinystring::{ generatedictionary, tinystringdeflate, tinystring_inflate }; use std::fs;

fn main() { let mut cbench: Testmark = Timer::new("TinyString Compression Test");

let contents: String = fs::read_to_string("sample.txt").unwrap();
let data: String = "I just spent about $3000 surgically removing a big ball of WTF from my Maine coon! Came home with a dozen staples down his belly and immediately started trying to eat the plastic wrap I just pulled off his medication bottles. Moron. I'm sorry your kitty didn't make it. Being stupidly suicidal seems to be a breed characteristic!".to_string();
let dict: Vec<String> = generate_dictionary(contents, 5);

cbench.start();
let result: String = tiny_string_deflate(data, dict.clone());
let inflated: String = tiny_string_inflate(result.to_string(), dict.clone());
cbench.stop();

println!("{} {}", result.to_string(), result.len());
println!("{} {}", inflated, inflated.len());
fs::write("result.txt", result).unwrap();

cbench.print();

} ```