Awesome Infra for AI › Vector Databases & Retrieval Infrastructure

alibaba/zvec

⭐ 16064 C++ repository created 2025-12-05

Zvec is an in-process vector database developed by Alibaba Group, optimized for embedded use within applications. It offers a lightweight, high-performance solution for vector similarity search, capable of handling billions of vectors in milliseconds. Key features include native support for both dense and sparse vectors, enabling multi-vector queries. It also supports hybrid search, combining semantic similarity with structured filters for more precise results. Zvec ensures data durability through write-ahead logging (WAL), guaranteeing persistence even in the event of process crashes or power failures. It allows concurrent read access by multiple processes, while writes are handled by a single process. As an embedded library, Zvec is highly versatile, running across various environments such as notebooks, servers, CLI tools, and edge devices. It supports multiple platforms including Linux, macOS, and Windows, with client libraries available for Python and Node.js, and recent additions like Dart/Flutter SDK for mobile development. The project emphasizes ease of installation and use, requiring no external servers or complex configurations.

https://github.com/alibaba/zvec

vector-databasevector-searchembeddingin-processsimilarity-searchRAGLLM-memorydatabaselow-latencyscalable

Also in Vector Databases & Retrieval Infrastructure

pathwaycom/llm-app

Ready-to-run cloud templates for building real-time RAG, AI pipelines, and enterprise search applications that synchronize with various live data sources.

run-llama/llama_index

LlamaIndex is an open-source data framework for building LLM applications by connecting custom data sources to large language models, focusing on data ingestion, indexing, and retrieval augmented g...

milvus-io/milvus

Milvus is a high-performance, cloud-native vector database designed for scalable vector Approximate Nearest Neighbor (ANN) search, efficiently organizing and searching vast amounts of unstructured ...

VectifyAI/PageIndex

PageIndex is a vectorless, reasoning-based RAG system that builds hierarchical tree indexes from documents and uses LLMs to reason over them for context-aware retrieval.

qdrant/qdrant

Qdrant is an open-source, high-performance vector similarity search engine and vector database designed specifically for AI applications, enabling fast storage, search, and management of vectors wi...

Tencent/WeKnora

WeKnora is an open-source, LLM-powered knowledge framework for enterprise document understanding, semantic retrieval, and autonomous reasoning, featuring RAG, ReAct agents, and an auto-maintaining ...

topoteretes/cognee

Cognee is an open-source AI memory platform that provides AI agents with persistent long-term memory through a self-hosted knowledge graph, combining vector embeddings and graph reasoning.

RyanCodrai/turbovec

TurboVec is a Rust-based approximate nearest neighbor (ANN) vector index with Python bindings, built on Google Research's TurboQuant algorithm for efficient, memory-optimized vector similarity search.