Awesome Infra for AI › Vector Databases & Retrieval Infrastructure

philippgille/chromem-go

⭐ 1061 Go repository created 2023-12-24

Chromem-go is an embeddable vector database implemented in Go, providing a Chroma-like API without external dependencies. Its primary purpose is to allow Go applications to incorporate retrieval augmented generation (RAG) and other embedding-based features directly within the application, similar to how SQLite is used for relational data. This eliminates the need to run a separate server-side database. The project focuses on simplicity and performance for common use cases, rather than supporting millions of documents or extensive features, making it ideal for scenarios where a lightweight, in-process solution is preferred. It handles document storage alongside their embeddings and supports various embedding creators, including hosted (OpenAI, Azure OpenAI, GCP Vertex AI, Cohere, Mistral, Jina, mixedbread.ai) and local (Ollama, LocalAI) options, or a custom embedding function. Essential functionalities like collection creation, adding documents, and nearest-neighbor search for querying similar content are provided. The database supports multithreaded processing for adding and querying, leveraging Go's native concurrency features, and includes experimental WebAssembly binding. It's particularly useful for integrating precise, up-to-date knowledge into LLM applications to combat knowledge cut-off and hallucinations without fine-tuning.

https://github.com/philippgille/chromem-go

vector-databasegolangin-memoryembeddingsRAGnearest-neighborChroma-likeembeddableLLMsAI inference

Also in Vector Databases & Retrieval Infrastructure

pathwaycom/llm-app

Ready-to-run cloud templates for building real-time RAG, AI pipelines, and enterprise search applications that synchronize with various live data sources.

run-llama/llama_index

LlamaIndex is an open-source data framework for building LLM applications by connecting custom data sources to large language models, focusing on data ingestion, indexing, and retrieval augmented g...

milvus-io/milvus

Milvus is a high-performance, cloud-native vector database designed for scalable vector Approximate Nearest Neighbor (ANN) search, efficiently organizing and searching vast amounts of unstructured ...

VectifyAI/PageIndex

PageIndex is a vectorless, reasoning-based RAG system that builds hierarchical tree indexes from documents and uses LLMs to reason over them for context-aware retrieval.

qdrant/qdrant

Qdrant is an open-source, high-performance vector similarity search engine and vector database designed specifically for AI applications, enabling fast storage, search, and management of vectors wi...

Tencent/WeKnora

WeKnora is an open-source, LLM-powered knowledge framework for enterprise document understanding, semantic retrieval, and autonomous reasoning, featuring RAG, ReAct agents, and an auto-maintaining ...

topoteretes/cognee

Cognee is an open-source AI memory platform that provides AI agents with persistent long-term memory through a self-hosted knowledge graph, combining vector embeddings and graph reasoning.

RyanCodrai/turbovec

TurboVec is a Rust-based approximate nearest neighbor (ANN) vector index with Python bindings, built on Google Research's TurboQuant algorithm for efficient, memory-optimized vector similarity search.