hyphenation

Standard Knuth-Liang hyphenation based on the TeX UTF-8 patterns.

toml [dependencies] hyphenation = "0.3.2"

Quickstart

```rust use hyphenation::{Hyphenation, Standard}; use hyphenation::Language::{English_US};

// Set the location of the pattern repository, // absolute or relative to your executable hyphenation::setpatternfolder(Path::new("./patterns"));

// Load hyphenation data for American English from the pattern repository. let englishus = hyphenation::load(EnglishUS).unwrap();

// An iterator that breaks a word according to standard hyphenation practices. let h: Standard = "hyphenation".hyphenate(&english_us); // hy-phen-ation

// Collect the lazy hyphenator h into substring slices over the original string. let v: Vec<&str> = h.collect(); assert_eq!(v, vec!["hy", "phen", "ation"]);

// Hyphenators work with full text as well as individual words. let h2: Standard = "Word hyphenation by computer.".hyphenate(&englishus); let v2: Vec<&str> = h2.collect(); asserteq!(v2, vec!["Word hy", "phen", "ation by com", "puter."]);

// Mark hyphenation opportunities with soft hyphens, // and render the result to a new String. let h2 = "anfractuous".hyphenate(&englishus); let s: String = h1.punctuate().collect(); asserteq!(s, "an\u{ad}frac\u{ad}tu\u{ad}ous".to_owned()); ```

Unicode Normalization

hyphenation operates on strings in Normalization Form C, as described by the Unicode Standard Annex #15 and provided by the unicode-normalization crate.

This form is ubiquitous, and you probably need not worry about it. Nevertheless, it would be best to ensure NFC when working with any of the following languages:

Assamese
Bengali
Greek (Ancient, Monotonic, Polytonic)
Punjabi
Sanskrit

Pattern Data

The script used to parse, normalize, and convert the TeX hyphenation patterns may be found at ndr-qef/hyph-utf8.json.

hyphenation

Quickstart

Unicode Normalization

Pattern Data

License