LeoSearch is the custom search engine I’ve written.
It has a couple data sources:
The front-end runs on AWS Lambda with a custom web framework in Rust. All of the data is stored in ClickHouse.
The querying and ranking is done with SQL, everything runs in ClickHouse. The results are ranked using Okapi BM25.
Started working on “LeoSearch”. It’s a tiny search engine I made for searching through my bookmarks.
I inserted everything into a ClickHouse table, implemented an inverted index, and wrote an Okapi BM25 implementation in SQL. It’s pretty fast and I’m happy with the results.