Awesome Infra for AI › Vector Databases & Retrieval Infrastructure

epsilla-cloud/vectordb

⭐ 875 C++ repository created 2023-07-09

Epsilla is an open-source vector database management system designed for high-performance and scalable similarity search of embedding vectors. Its primary purpose is to bridge the gap between information retrieval and memory retention for Large Language Models (LLMs). The core engine is written in C++ and utilizes advanced academic parallel graph traversal techniques for vector indexing, aiming to provide significantly faster vector search while maintaining high precision. Key features include full-fledged database management with familiar concepts like databases, tables, and fields, metadata filtering, and hybrid search combining dense and sparse vectors. It supports built-in embedding functionality for natural language-based search, offers a cloud-native architecture with compute-storage separation, serverless capabilities, and multi-tenancy. Epsilla provides client libraries for Python, JavaScript, and Ruby, alongside a REST API interface, and integrates with popular LLM frameworks such as LangChain and LlamaIndex. While it can be run via Docker, it also offers an experimental Python library for direct embedding without a Docker container.

https://github.com/epsilla-cloud/vectordb

vector-databaseembeddingssimilarity-searchllm-infraretrievalknowledge-base

Also in Vector Databases & Retrieval Infrastructure

pathwaycom/llm-app

Ready-to-run cloud templates for building real-time RAG, AI pipelines, and enterprise search applications that synchronize with various live data sources.

run-llama/llama_index

LlamaIndex is an open-source data framework for building LLM applications by connecting custom data sources to large language models, focusing on data ingestion, indexing, and retrieval augmented g...

milvus-io/milvus

Milvus is a high-performance, cloud-native vector database designed for scalable vector Approximate Nearest Neighbor (ANN) search, efficiently organizing and searching vast amounts of unstructured ...

VectifyAI/PageIndex

PageIndex is a vectorless, reasoning-based RAG system that builds hierarchical tree indexes from documents and uses LLMs to reason over them for context-aware retrieval.

qdrant/qdrant

Qdrant is an open-source, high-performance vector similarity search engine and vector database designed specifically for AI applications, enabling fast storage, search, and management of vectors wi...

Tencent/WeKnora

WeKnora is an open-source, LLM-powered knowledge framework for enterprise document understanding, semantic retrieval, and autonomous reasoning, featuring RAG, ReAct agents, and an auto-maintaining ...

topoteretes/cognee

Cognee is an open-source AI memory platform that provides AI agents with persistent long-term memory through a self-hosted knowledge graph, combining vector embeddings and graph reasoning.

RyanCodrai/turbovec

TurboVec is a Rust-based approximate nearest neighbor (ANN) vector index with Python bindings, built on Google Research's TurboQuant algorithm for efficient, memory-optimized vector similarity search.