Awesome Infra for AI › LLM Gateways & Proxies

apache/casbin-gateway

⭐ 641 Go added to this list on 2026-09-28 repository created 2017-05-13

Casbin Gateway is a local, installable gateway and management console for the AI coding agents running on a developer's machine (Claude Code, Codex, Cursor, Gemini CLI, and many others). Installed with a single script, it runs as a background service with a tray icon and local web UI, requiring no external database, sign-in, or language runtime. It intercepts and relays traffic between each installed agent and up to 44 supported model providers (OpenAI, Anthropic, Google, and many third-party or self-hosted options such as Ollama, vLLM, and llama.cpp), letting a user point every agent at any provider from one place and switch, upgrade, or roll back agent versions centrally. Access-control policies, expressed and enforced through the Casbin authorization library, apply on every relayed request and can restrict roughly forty aspects of what each agent's tools, models, and providers are allowed to do. The gateway also gives visibility into what each agent is doing: it reads spend and usage directly from agents' own transcripts (including, on Windows, traffic that bypasses the proxy entirely), and it can probe a configured provider endpoint to check whether the model and features actually served match what was purchased, grading providers on an A-F authenticity scale. It also surfaces each agent's installed skills, MCP servers, and instruction files side by side, and supports copying these assets between agents. The project targets individuals or teams running multiple AI coding CLIs who want centralized routing, cost visibility, and policy control without modifying each agent.

https://github.com/apache/casbin-gateway

llm-gatewayai-coding-agentscasbinaccess-controlmulti-providerobservability