cordum-io/cordum
Source-available control plane that gates AI-agent actions behind approval workflows, a policy safety kernel, and a compliance firewall before they execute.
Awesome Infra for AI › Weekly › 2026-09-07
2026-09-07
AI Safety & Guardrails
LLM Evaluation & Testing
aaron-for-value/VeriRun
Distributed runtime for reproducible, isolated evaluation of AI-generated code and agent benchmarks, with sandboxed execution, provenance tracking, and a reward path for post-training loops.
LLM Gateways & Proxies
tbphp/gpt-load
Self-hosted Go gateway that unifies multiple AI providers and subscription accounts behind one endpoint, with credential scheduling, failover, logging and cost tracking.
weave-os/router
Self-hosted or hosted Go proxy that routes each LLM request across Anthropic, OpenAI, Gemini and OpenAI-compatible providers using an on-box embedding-based scorer to cut model costs.
LLM Observability & Tracing
Continuum-AI-Corp/OrcaReplay
Records coding-agent sessions such as Claude Code or Codex through a local proxy, then replays them offline byte-for-byte or forks mid-run onto a different model to compare outcomes.
Workflow Orchestration for AI
Abilityai/trinity
Self-hosted platform for running autonomous AI agents in isolated Docker containers, with fleet-wide scheduling, agent-to-agent delegation, observability and a tamper-evident audit trail.
ai-sdlc-framework/ai-sdlc
Spec-driven orchestration framework that dispatches AI coding subagents through a dependency graph, runs cross-harness reviews, and gates merges with governance policies and signed attestations.