Awesome Infra for AI › Vector Databases & Retrieval Infrastructure

tensorchord/pgvecto.rs

⭐ 2190 Rust repository created 2023-04-15

pgvecto.rs is a PostgreSQL extension designed to enhance the database's capabilities with robust vector similarity search functionalities. Written in Rust and based on pgrx, it offers a performant and scalable solution for integrating vector search into existing PostgreSQL deployments. This extension stands out from the standard pgvector by supporting higher vector dimensions (up to 65535), providing a more complete filtering mechanism through its VBASE method, and introducing additional data types like binary vectors, FP16, and INT8. It also leverages dynamic SIMD instruction dispatching for optimal performance based on the host machine's capabilities. A key differentiator is its approach to indexing, managing storage and memory separately from PostgreSQL's native engine, which allows for specialized optimizations suited for vector data. While a new implementation, VectorChord, is now recommended by the developers for better stability and performance, pgvecto.rs remains a significant open-source contribution for those seeking to implement advanced vector search directly within a PostgreSQL environment, crucial for retrieval-augmented generation (RAG) and other AI/ML applications requiring efficient similarity search.

https://github.com/tensorchord/pgvecto.rs

vector databasepostgres extensionvector searchRustsimilarity searchLLMRAGembeddings

Also in Vector Databases & Retrieval Infrastructure

pathwaycom/llm-app

Ready-to-run cloud templates for building real-time RAG, AI pipelines, and enterprise search applications that synchronize with various live data sources.

run-llama/llama_index

LlamaIndex is an open-source data framework for building LLM applications by connecting custom data sources to large language models, focusing on data ingestion, indexing, and retrieval augmented g...

milvus-io/milvus

Milvus is a high-performance, cloud-native vector database designed for scalable vector Approximate Nearest Neighbor (ANN) search, efficiently organizing and searching vast amounts of unstructured ...

VectifyAI/PageIndex

PageIndex is a vectorless, reasoning-based RAG system that builds hierarchical tree indexes from documents and uses LLMs to reason over them for context-aware retrieval.

qdrant/qdrant

Qdrant is an open-source, high-performance vector similarity search engine and vector database designed specifically for AI applications, enabling fast storage, search, and management of vectors wi...

Tencent/WeKnora

WeKnora is an open-source, LLM-powered knowledge framework for enterprise document understanding, semantic retrieval, and autonomous reasoning, featuring RAG, ReAct agents, and an auto-maintaining ...

topoteretes/cognee

Cognee is an open-source AI memory platform that provides AI agents with persistent long-term memory through a self-hosted knowledge graph, combining vector embeddings and graph reasoning.

RyanCodrai/turbovec

TurboVec is a Rust-based approximate nearest neighbor (ANN) vector index with Python bindings, built on Google Research's TurboQuant algorithm for efficient, memory-optimized vector similarity search.