pathwaycom/llm-app
Ready-to-run cloud templates for building real-time RAG, AI pipelines, and enterprise search applications that synchronize with various live data sources.
Awesome Infra for AI › Vector Databases & Retrieval Infrastructure
infiniflow/infinity
Infinity is an advanced AI-native database engineered specifically for modern LLM applications. Its core functionality revolves around providing performant hybrid search capabilities, integrating dense embedding, sparse embedding, tensor, and full-text search, alongside robust filtering. This design makes it highly suitable for Retrieval-Augmented Generation (RAG) applications, powering use cases such as semantic search, recommendation engines, question-answering systems, conversational AI, and content generation. The database boasts impressive performance metrics, achieving low query latency and high queries per second (QPS) on large vector and full-text datasets. It simplifies deployment with a single-binary architecture and offers an intuitive Python API, making it developer-friendly. Key features include support for various reranking algorithms like RRF and ColBERT, and a wide array of data types. Infinity's focus on vector and embedding storage as a primary database feature, rather than an add-on to a general-purpose database, aligns it directly with the operational needs of AI/ML models at inference time.
https://github.com/infiniflow/infinity
Also in Vector Databases & Retrieval Infrastructure
run-llama/llama_index
LlamaIndex is an open-source data framework for building LLM applications by connecting custom data sources to large language models, focusing on data ingestion, indexing, and retrieval augmented g...
milvus-io/milvus
Milvus is a high-performance, cloud-native vector database designed for scalable vector Approximate Nearest Neighbor (ANN) search, efficiently organizing and searching vast amounts of unstructured ...
VectifyAI/PageIndex
PageIndex is a vectorless, reasoning-based RAG system that builds hierarchical tree indexes from documents and uses LLMs to reason over them for context-aware retrieval.
qdrant/qdrant
Qdrant is an open-source, high-performance vector similarity search engine and vector database designed specifically for AI applications, enabling fast storage, search, and management of vectors wi...
Tencent/WeKnora
WeKnora is an open-source, LLM-powered knowledge framework for enterprise document understanding, semantic retrieval, and autonomous reasoning, featuring RAG, ReAct agents, and an auto-maintaining ...
topoteretes/cognee
Cognee is an open-source AI memory platform that provides AI agents with persistent long-term memory through a self-hosted knowledge graph, combining vector embeddings and graph reasoning.
RyanCodrai/turbovec
TurboVec is a Rust-based approximate nearest neighbor (ANN) vector index with Python bindings, built on Google Research's TurboQuant algorithm for efficient, memory-optimized vector similarity search.