data-privacy-stack/presidio
Presidio is an open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data, leveraging NLP and customizable pipelines.
Awesome Infra for AI › Weekly › 2026-06-29
2026-06-29
AI Safety & Guardrails
LLM Evaluation & Testing
agencyenterprise/PromptInject
PromptInject is a framework for quantitatively analyzing the robustness of LLMs against adversarial prompt attacks through modular prompt assembly and evaluation.
LLM Gateways & Proxies
workweave/router
A model router for agentic systems that routes prompts to the most suitable LLM, optimizing performance and cost by dynamically selecting from various providers like Anthropic and OpenAI.
LLM Observability & Tracing
tma1-ai/tma1
TMA1 provides local-first observability for LLM agents, capturing every LLM call, routing insights back to the agent via hooks and MCP tools, and offering a dashboard for detailed analysis.
Model Serving Frameworks
vortico/flama
Flama is a production framework for serving predictive and generative AI models as APIs, supporting OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native Model Context Protoc...
Vector Databases & Retrieval Infrastructure
NVIDIA/cuvs
cuVS is an NVIDIA library providing GPU-accelerated algorithms for vector similarity search and clustering, designed to simplify high-performance vector operations.
lightonai/next-plaid
NextPlaid is a local-first multi-vector database and indexing engine that powers ColGREP, a semantic code search tool for terminals and coding agents.