Awesome Infra for AI › Vector Databases & Retrieval Infrastructure

tantaraio/voy

⭐ 1076 Rust repository created 2023-01-27

Voy is a WebAssembly (WASM) vector similarity search engine, developed in Rust, designed for high-performance and lightweight deployment in web environments, including CDN edge servers and client-side applications. It leverages k-d trees for efficient indexing and fast nearest neighbor searches, making it ideal for creating responsive search experiences. The library is characterized by its small footprint (75KB gzipped, 69KB brotli) and tree-shakable architecture, which allows for optimized bundle sizes and asynchronous operations via Web Workers. Voy supports the generation of portable embedding indexes and offers a comprehensive API for indexing, searching, adding, removing, and clearing resources based on their embeddings. While it currently relies on external JavaScript libraries like `transformers.js` or `web-ai` for generating text embeddings (a built-in WASM transformation is planned), its core functionality focuses on managing and querying vector data. Voy is under active development, with plans for index updates, improved TypeScript support, and built-in embedding generation. It provides both a class-based API and individual functions for flexible integration, allowing developers to manage multiple indexes and perform efficient similarity searches.

https://github.com/tantaraio/voy

vector searchsimilarity searchWASMRustk-d treenearest neighbor searchwebassemblyembeddingsedge computingclient-side AI

Also in Vector Databases & Retrieval Infrastructure

pathwaycom/llm-app

Ready-to-run cloud templates for building real-time RAG, AI pipelines, and enterprise search applications that synchronize with various live data sources.

run-llama/llama_index

LlamaIndex is an open-source data framework for building LLM applications by connecting custom data sources to large language models, focusing on data ingestion, indexing, and retrieval augmented g...

milvus-io/milvus

Milvus is a high-performance, cloud-native vector database designed for scalable vector Approximate Nearest Neighbor (ANN) search, efficiently organizing and searching vast amounts of unstructured ...

VectifyAI/PageIndex

PageIndex is a vectorless, reasoning-based RAG system that builds hierarchical tree indexes from documents and uses LLMs to reason over them for context-aware retrieval.

qdrant/qdrant

Qdrant is an open-source, high-performance vector similarity search engine and vector database designed specifically for AI applications, enabling fast storage, search, and management of vectors wi...

Tencent/WeKnora

WeKnora is an open-source, LLM-powered knowledge framework for enterprise document understanding, semantic retrieval, and autonomous reasoning, featuring RAG, ReAct agents, and an auto-maintaining ...

topoteretes/cognee

Cognee is an open-source AI memory platform that provides AI agents with persistent long-term memory through a self-hosted knowledge graph, combining vector embeddings and graph reasoning.

RyanCodrai/turbovec

TurboVec is a Rust-based approximate nearest neighbor (ANN) vector index with Python bindings, built on Google Research's TurboQuant algorithm for efficient, memory-optimized vector similarity search.