sif-embedding

This is a Rust implementation of simple but powerful sentence embedding algorithms based on Smooth Inverse Frequency and Common Component Removal described in the following papers:

• Sanjeev Arora, Yingyu Liang, and Tengyu Ma, A Simple but Tough-to-Beat Baseline for Sentence Embeddings, ICLR 2017
• Kawin Ethayarajh, Unsupervised Random Walk Sentence Embeddings: A Strong but Simple Baseline, RepL4NLP 2018

This library will help you if

• NN-based sentence embeddings are too slow for your application, or
• you do not have an option using GPUs.

Documentation

https://docs.rs/sif-embedding/

Getting started

See tutorial.

Evaluations

evaluations provides tools to evaluate sif-embedding on several tasks.

Wiki

Trouble shooting: Tips on how to resolve errors I faced in my environment.

Licensing

Licensed under either of

• Apache License, Version 2.0 (LICENSE-APACHE or http://www.apache.org/licenses/LICENSE-2.0)
• MIT license (LICENSE-MIT or http://opensource.org/licenses/MIT)

at your option.