Awesome Infra for AI › Vector Databases & Retrieval Infrastructure

kelindar/search

⭐ 560 Go repository created 2024-09-29

This Go library provides an efficient solution for embedding and vector search, designed for small to medium-scale projects requiring semantic power. It leverages llama.cpp without cgo, using purego for seamless integration with C libraries. The project supports GGUF BERT models, allowing access to sophisticated embeddings, and offers GPU acceleration through precompiled binaries with Vulkan support for Windows and Linux. It enables the creation of a search index from computed embeddings that can be saved and loaded, facilitating basic vector-based searches. While powerful for its intended scope (datasets under 100,000 entries), it acknowledges limitations such as potential performance bottlenecks for larger datasets due to its brute-force search approach, lack of advanced query capabilities found in more sophisticated search engines, and challenges with high-dimensional complex embeddings from large language models unless optimized GPU resources are available. The library focuses on simple vector similarity search and is ideal for integrating semantic search into Go applications with minimal hassle.

https://github.com/kelindar/search

semantic searchvector searchembeddingsllama.cppBERTGGUFGoGPU acceleration

Also in Vector Databases & Retrieval Infrastructure

pathwaycom/llm-app

Ready-to-run cloud templates for building real-time RAG, AI pipelines, and enterprise search applications that synchronize with various live data sources.

run-llama/llama_index

LlamaIndex is an open-source data framework for building LLM applications by connecting custom data sources to large language models, focusing on data ingestion, indexing, and retrieval augmented g...

milvus-io/milvus

Milvus is a high-performance, cloud-native vector database designed for scalable vector Approximate Nearest Neighbor (ANN) search, efficiently organizing and searching vast amounts of unstructured ...

VectifyAI/PageIndex

PageIndex is a vectorless, reasoning-based RAG system that builds hierarchical tree indexes from documents and uses LLMs to reason over them for context-aware retrieval.

qdrant/qdrant

Qdrant is an open-source, high-performance vector similarity search engine and vector database designed specifically for AI applications, enabling fast storage, search, and management of vectors wi...

Tencent/WeKnora

WeKnora is an open-source, LLM-powered knowledge framework for enterprise document understanding, semantic retrieval, and autonomous reasoning, featuring RAG, ReAct agents, and an auto-maintaining ...

topoteretes/cognee

Cognee is an open-source AI memory platform that provides AI agents with persistent long-term memory through a self-hosted knowledge graph, combining vector embeddings and graph reasoning.

RyanCodrai/turbovec

TurboVec is a Rust-based approximate nearest neighbor (ANN) vector index with Python bindings, built on Google Research's TurboQuant algorithm for efficient, memory-optimized vector similarity search.