Indicium Search

🔎 A simple in-memory search for collections (Vec, HashMap, BTreeMap, etc) and key-value stores. Features autocompletion.

There are many incredible search engines available for Rust. Many seem to require compiling a separate server binary. I wanted something simple and light-weight - an easy-to-use crate that could conveniently search structs and collections within my own binary. So, I made indicium.

alt text

While indicium was made with web apps in mind, it is an in-memory search and it does not scale indefinitely or to Facebook or Google size. Even in such an environment, it would still be a convenient way of searching large static lists (such as currencies, languages, countries, etc.) It's also great for applications where there is an anticipated scale limit (i.e. searching a list of company assets, list of users in a corporate intranet, etc.)

Indicium easily can handle 100,000's records without breaking a sweat. This crate is primarily limited by available memory. However, depending on the nature your data-set and if there keywords that are repeated many times, performance may begin to degrade at a point.

What's New?

Quick Start Guide

For our Quick Start Guide example, we will be searching inside of the following struct:

rust struct MyStruct { title: String, year: u16, body: String, }

1. Implementing Indexable

To begin, we must make our record indexable. We'll do this by implementing the Indexable trait for our struct. The idea is to return a String for every field that we would like to be indexed. Example:

```rust use indicium::simple::Indexable;

impl Indexable for MyStruct { fn strings(&self) -> Vec { vec![ self.title.clone(), self.year.to_string(), self.body.clone(), ] } } ```

Don't forget that you may make numbers, numeric identifiers, enums, and other types indexable by converting them to a String and including them in the returned Vec<String>.

2. Indexing a Collection

To index an existing collection, we can iterate over the collection. For each record, we will insert it into the search index. This should look something like these two examples:

Vec

```rust use indicium::simple::SearchIndex;

let my_vec: Vec = Vec::new();

// In the case of a Vec collection, we use the index as our key. A // Vec index is a usize type. Therefore we will instantiate // SearchIndex as SearchIndex<usize>.

let mut search_index: SearchIndex = SearchIndex::default();

myvec .iter() .enumerate() .foreach(|(index, element)| search_index.insert(&index, element) ); ```

HashMap

```rust use std::collections::HashMap; use indicium::simple::SearchIndex;

let myhashmap: HashMap = HashMap::new();

// In the case of a HashMap collection, we use the hash map's key as // the SearchIndex key. In our hypothetical example, we will use // MyStruct's title as a the key which is a String type. Therefore // we will instantiate HashMap<K, V> as HashMap and // SearchIndex<K> as SearchIndex<String>.

let mut search_index: SearchIndex = SearchIndex::default();

myhashmap .iter() .foreach(|(key, value)| searchindex.insert(key, value) ); ```

As long as the Indexable trait was implemented for your value type, the above examples will index a previously populated Vec or HashMap. However, the preferred method for large collections is to insert into the SearchIndex as you insert into your collection (Vec, HashMap, etc.)

Once the index has been populated, you can use the search and autocomplete methods.

3. Searching

The search method will return keys as the search results. Each resulting key can then be used to retrieve the full record from its collection.

Basic usage:

```rust let mut search_index: SearchIndex = SearchIndex::default();

searchindex.insert(&0, &MyType::from("Harold Godwinson")); searchindex.insert(&1, &MyType::from("Edgar Ætheling")); searchindex.insert(&2, &MyType::from("William the Conqueror")); searchindex.insert(&3, &MyType::from("William Rufus")); search_index.insert(&4, &MyType::from("Henry Beauclerc"));

let resultingkeys: Vec<&usize> = searchindex.search("William");

asserteq!(resultingkeys, vec![&2, &3]); ```

Search only supports exact keyword matches and does not use fuzzy matching. Consider providing the autocomplete feature to your users as an ergonomic alternative to fuzzy matching.

5. Autocompletion

The autocomplete method will provide several autocompletion options for the last keyword in the supplied string.

Basic usage:

```rust let mut searchindex: SearchIndex = SearchIndexBuilder::default() .autocompletetype(&AutocompleteType::Global) .build();

searchindex.insert(&0, &MyType::from("apple")); searchindex.insert(&1, &MyType::from("ball")); searchindex.insert(&2, &MyType::from("bath")); searchindex.insert(&3, &MyType::from("bird")); searchindex.insert(&4, &MyType::from("birthday")); searchindex.insert(&5, &MyType::from("red")); search_index.insert(&6, &MyType::from("truck"));

let autocompleteoptions: Vec = searchindex.autocomplete("a very big bi");

asserteq!( autocompleteoptions, vec!["a very big bird", "a very big birthday"] ); ```