Awesome Infra for AI › Vector Databases & Retrieval Infrastructure

run-llama/llama_index

⭐ 52412 Python repository created 2022-11-02

LlamaIndex is a data framework designed to facilitate the development of Large Language Model (LLM) applications through the integration of custom data sources. Its core functionality revolves around data ingestion, indexing, and enabling Retrieval Augmented Generation (RAG) workflows. The project provides tools to connect various data formats—such as PDFs, APIs, and databases—to LLMs, making it easier for models to access and reason over private or domain-specific information. Key components include data connectors to ingest data from diverse sources, data indexes to structure and store this data (often using vector databases), and query engines to retrieve relevant information and synthesize responses with LLMs. LlamaIndex offers modularity, allowing users to select and integrate their preferred LLMs, embedding models, and vector stores through a rich ecosystem of integrations. It supports advanced RAG techniques, agents for complex interactions, and tools for document parsing and structured data extraction. The framework is central to building intelligent applications that require LLMs to interact with and understand proprietary knowledge bases, moving beyond foundational model capabilities to create more informed and context-aware AI systems.

https://github.com/run-llama/llama_index

LLM applicationsRAGdata frameworkagenticdata ingestionindexingretrievalvector databasesdocument processingLLM orchestration

Also in Vector Databases & Retrieval Infrastructure

pathwaycom/llm-app

Ready-to-run cloud templates for building real-time RAG, AI pipelines, and enterprise search applications that synchronize with various live data sources.

milvus-io/milvus

Milvus is a high-performance, cloud-native vector database designed for scalable vector Approximate Nearest Neighbor (ANN) search, efficiently organizing and searching vast amounts of unstructured ...

VectifyAI/PageIndex

PageIndex is a vectorless, reasoning-based RAG system that builds hierarchical tree indexes from documents and uses LLMs to reason over them for context-aware retrieval.

qdrant/qdrant

Qdrant is an open-source, high-performance vector similarity search engine and vector database designed specifically for AI applications, enabling fast storage, search, and management of vectors wi...

Tencent/WeKnora

WeKnora is an open-source, LLM-powered knowledge framework for enterprise document understanding, semantic retrieval, and autonomous reasoning, featuring RAG, ReAct agents, and an auto-maintaining ...

topoteretes/cognee

Cognee is an open-source AI memory platform that provides AI agents with persistent long-term memory through a self-hosted knowledge graph, combining vector embeddings and graph reasoning.

RyanCodrai/turbovec

TurboVec is a Rust-based approximate nearest neighbor (ANN) vector index with Python bindings, built on Google Research's TurboQuant algorithm for efficient, memory-optimized vector similarity search.

weaviate/weaviate

Weaviate is an open-source, cloud-native vector database for semantic search, combining vector similarity search with keyword filtering, RAG, and reranking capabilities.