pathwaycom/llm-app
Ready-to-run cloud templates for building real-time RAG, AI pipelines, and enterprise search applications that synchronize with various live data sources.
Awesome Infra for AI › Vector Databases & Retrieval Infrastructure
milvus-io/milvus
Milvus is an open-source, high-performance vector database specifically engineered for scalable vector similarity search. Its core purpose is to power AI applications by effectively storing, indexing, and querying large volumes of unstructured data, such as text, images, and multi-modal information, through their vector embeddings. Written in Go and C++, Milvus leverages hardware acceleration for CPU/GPU to achieve best-in-class vector search performance. It features a fully-distributed and Kubernetes-native architecture, ensuring horizontal scalability to handle billions of vectors and tens of thousands of search queries, with real-time updates. Milvus also offers a Standalone mode for single-machine deployments and Milvus Lite for quick Python-based local setups. Key features include its distributed architecture separating compute and storage, allowing independent scaling for read-heavy or write-heavy workloads, and ensuring high availability through stateless microservices and replicas. It supports various vector index types like HNSW, IVF, FLAT, SCANN, and DiskANN, with quantization-based variations and mmap, along with hardware acceleration and GPU indexing (e.g., NVIDIA's CAGRA). Milvus provides flexible multi-tenancy options (database, collection, partition, or partition key level) and supports hot/cold storage for cost-effectiveness. It is ideal for building AI applications that require efficient vector search with metadata filtering or hybrid search capabilities.
https://github.com/milvus-io/milvus
Also in Vector Databases & Retrieval Infrastructure
run-llama/llama_index
LlamaIndex is an open-source data framework for building LLM applications by connecting custom data sources to large language models, focusing on data ingestion, indexing, and retrieval augmented g...
VectifyAI/PageIndex
PageIndex is a vectorless, reasoning-based RAG system that builds hierarchical tree indexes from documents and uses LLMs to reason over them for context-aware retrieval.
qdrant/qdrant
Qdrant is an open-source, high-performance vector similarity search engine and vector database designed specifically for AI applications, enabling fast storage, search, and management of vectors wi...
Tencent/WeKnora
WeKnora is an open-source, LLM-powered knowledge framework for enterprise document understanding, semantic retrieval, and autonomous reasoning, featuring RAG, ReAct agents, and an auto-maintaining ...
topoteretes/cognee
Cognee is an open-source AI memory platform that provides AI agents with persistent long-term memory through a self-hosted knowledge graph, combining vector embeddings and graph reasoning.
RyanCodrai/turbovec
TurboVec is a Rust-based approximate nearest neighbor (ANN) vector index with Python bindings, built on Google Research's TurboQuant algorithm for efficient, memory-optimized vector similarity search.
weaviate/weaviate
Weaviate is an open-source, cloud-native vector database for semantic search, combining vector similarity search with keyword filtering, RAG, and reranking capabilities.