Awesome Infra for AI › Vector Databases & Retrieval Infrastructure

VectifyAI/PageIndex

⭐ 38642 Python repository created 2025-04-01

PageIndex offers a novel approach to Retrieval-Augmented Generation (RAG) by moving away from traditional vector databases and chunking methods. It addresses the limitations of similarity-based retrieval, which often falls short in handling complex professional documents requiring deep reasoning. Instead, PageIndex creates a hierarchical tree index from long documents, mimicking how human experts navigate and extract information. LLMs then perform reasoning-based retrieval through a tree search, ensuring high relevance and context awareness. This method provides better traceability and explainability, as retrieval steps are grounded in explicit page and section references, offering transparency that opaque vector search often lacks. Key features include the absence of vector databases and chunking, enabling truly context-aware retrieval that adapts to conversation history and domain knowledge. The system has demonstrated state-of-the-art accuracy on benchmarks like FinanceBench, outperforming vector-based solutions. PageIndex is available for self-hosting, as a cloud service via a chat platform or API, and through enterprise deployments, making it a flexible solution for various use cases requiring precise, reasoning-driven document analysis.

https://github.com/VectifyAI/PageIndex

RAGRetrieval-Augmented GenerationLLMcontext-aware retrievalreasoning-based AIvectorlessdocument indexingagentic AIinformation retrieval

Also in Vector Databases & Retrieval Infrastructure

pathwaycom/llm-app

Ready-to-run cloud templates for building real-time RAG, AI pipelines, and enterprise search applications that synchronize with various live data sources.

run-llama/llama_index

LlamaIndex is an open-source data framework for building LLM applications by connecting custom data sources to large language models, focusing on data ingestion, indexing, and retrieval augmented g...

milvus-io/milvus

Milvus is a high-performance, cloud-native vector database designed for scalable vector Approximate Nearest Neighbor (ANN) search, efficiently organizing and searching vast amounts of unstructured ...

qdrant/qdrant

Qdrant is an open-source, high-performance vector similarity search engine and vector database designed specifically for AI applications, enabling fast storage, search, and management of vectors wi...

Tencent/WeKnora

WeKnora is an open-source, LLM-powered knowledge framework for enterprise document understanding, semantic retrieval, and autonomous reasoning, featuring RAG, ReAct agents, and an auto-maintaining ...

topoteretes/cognee

Cognee is an open-source AI memory platform that provides AI agents with persistent long-term memory through a self-hosted knowledge graph, combining vector embeddings and graph reasoning.

RyanCodrai/turbovec

TurboVec is a Rust-based approximate nearest neighbor (ANN) vector index with Python bindings, built on Google Research's TurboQuant algorithm for efficient, memory-optimized vector similarity search.

weaviate/weaviate

Weaviate is an open-source, cloud-native vector database for semantic search, combining vector similarity search with keyword filtering, RAG, and reranking capabilities.