diegosouzapw/OmniRoute
OmniRoute is a free AI gateway that unifies access to over 170 AI providers, offering token compression, auto-fallback, and aggregating free tiers to provide billions of free tokens monthly.
Awesome Infra for AI › LLM Gateways & Proxies
caozhiyuan/copilot-api
Copilot API Proxy is an AI gateway designed to provide an OpenAI- and Anthropic-compatible API endpoint for various AI services. Its primary function is to serve as a local proxy for GitHub Copilot, the built-in Codex provider, and configurable third-party providers like DashScope and DeepSeek. This allows tools like Claude Code, OpenCode, and other OpenAI-compatible clients to access multiple AI models through a single, consistent local server. The gateway offers features such as OpenAI and Anthropic API compatibility, routing for multiple providers (Copilot, Codex, and external services), and standalone operation for third-party providers even without GitHub Copilot credentials. It supports agent-friendly Claude handling on Copilot, preserving Claude's native behaviors and tool flows. The project also provides flexible authentication and deployment options, including interactive login, direct tokens, and support for GitHub Enterprise. For local control and visibility, it includes a usage dashboard, rate limiting, and optional token visibility. Multi-provider routing allows for both provider-specific and top-level API access. Advanced features include exact Claude token counting and configurable GPT context compaction for managing long conversations. Installation is straightforward using Bun or npx, and a Docker image is provided for containerized deployment. There's also an Electron desktop application for users preferring a GUI, offering one-click proxy management, usage monitoring, and advanced configuration. This tool is valuable for developers and organizations looking to streamline access, manage, and monitor their interactions with various AI models through a unified gateway.
https://github.com/caozhiyuan/copilot-api
Also in LLM Gateways & Proxies
Mintplex-Labs/anything-llm
AnythingLLM is an all-in-one local-first AI application for chatting with documents, managing AI agents, and integrating with various LLMs and vector databases, offering dynamic model routing and m...
BerriAI/litellm
LiteLLM is an open-source AI Gateway and Python SDK providing a unified interface to over 100 LLM providers, with features like cost tracking, guardrails, load balancing, and observability.
QuantumNous/new-api
new-api is a unified LLM gateway and AI asset management system that enables aggregation, distribution, and cross-conversion of various LLMs into OpenAI, Claude, or Gemini compatible formats, offer...
Kong/kong
Kong Gateway is a cloud-native API and AI gateway offering high performance, extensibility via plugins, and advanced AI traffic capabilities including multi-LLM support, semantic security, and cach...
decolua/9router
9Router is an AI router and token saver that connects various AI coding tools to over 40 AI providers, optimizing usage with auto-fallback, quota tracking, and token compression.
apache/apisix
Apache APISIX is a dynamic, real-time, high-performance API Gateway that can also function as an AI Gateway, providing AI proxying, load balancing for LLMs, and robust security for AI agents.
lidge-jun/opencodex
OpenCodex is a universal local proxy that enables OpenAI Codex, Claude Code, and Grok Build to utilize any LLM provider, offering advanced model routing, account pooling, and API key management.