PrismorSec/prismor
Prismor provides runtime security hooks for AI coding agents, blocking dangerous commands, preventing secret leaks, and defending against prompt injection.
Awesome Infra for AI › Weekly › 2026-07-06
2026-07-06
AI Safety & Guardrails
LLM Gateways & Proxies
seakee/CPA-Manager-Plus
CPA Manager Plus is a self-hosted dashboard for monitoring AI gateway traffic, providing real-time analysis of requests, costs, failures, quotas, and account health for OpenAI-compatible and CPA/CL...
khankamraan2006-crypto/fabric-router-core
CloudForge AI is a distributed LLM gateway that orchestrates multi-provider inference with intelligent routing, cost governance, and security for high-availability production environments.
tiylabs/tiygate
TiyGate is an open-source AI gateway built in Rust for managing and routing LLM services across multiple providers with features for high availability, logging, and usage analytics.
LLM Observability & Tracing
rajudandigam/agent-inspect
Agent Inspect provides local execution trees, tracing, and debugging for TypeScript AI agents, offering in-depth insights into agent runs without cloud dependencies.
Model Serving Frameworks
dphnAI/sonar
Sonar is a high-performance, vLLM-based inference engine for serving HuggingFace-compatible LLMs at scale, featuring continuous batching, PagedAttention, and extensive quantization support.
Vector Databases & Retrieval Infrastructure
automataIA/graphrag-rs
GraphRAG-rs is a high-performance Rust implementation of GraphRAG for building queryable knowledge graphs from documents, offering server, WASM-only, and hybrid deployment architectures.
redevops-io/redevops-rag
redevops-rag is a compact library and CLI tool providing a hybrid RAG pipeline with DuckDB for vector search, BM25, Reciprocal Rank Fusion, recency/keyword priors, and optional cross-encoder rerank...