tantivy-tokenizer-tiny-segmenter

A Japanese tokenizer based on TinySegmenter.

See examples/basic.rs for basic usage.