ik-rs

ik-analyzer for Rust

Usage

add to Cargo.toml

toml [dependencies] ik-rs = "0.3.2"

Chinese Segment

```rust

[cfg(test)]

mod test { use ikrs::core::iksegmenter::{IKSegmenter, TokenMode};

#[test]
pub fn test_ik() {
    let mut ik = IKSegmenter::new();
    let text = "中华人民共和国";
    let tokens = ik.tokenize(text, TokenMode::INDEX); // TokenMode::SEARCH
    let mut token_texts = Vec::new();
    for token in tokens.iter() {
        println!("{:?}", token);
        token_texts.push(token.get_lexeme_text());
    }
    assert_eq!(
        token_texts,
        vec![
            "中华人民共和国",
            "中华人民",
            "中华",
            "华人",
            "人民共和国",
            "人民",
            "共和国",
            "共和",
            "国"
        ]
    )
}

}

```

Usage for Tantivy

use tantivy-ik project

Welcome to rust developer and search engine developer join us, and maintain this project together!

you can PR or submit issue...

and star⭐️ or fork this project to support me!