diegosouzapw/OmniRoute
OmniRoute is a free AI gateway that unifies access to over 170 AI providers, offering token compression, auto-fallback, and aggregating free tiers to provide billions of free tokens monthly.
Awesome Infra for AI › LLM Gateways & Proxies
PAIArtCom/Clipal
Clipal is a local LLM API gateway and reverse proxy specifically built to enhance developer productivity when working with AI coding tools such as Claude Code, Continue, Aider, and Cherry Studio. It acts as an intelligent traffic controller by consolidating multiple model providers, handling automatic failover between them, and managing API keys and OAuth credentials. The tool provides a user-friendly local Web UI for visual management, allowing users to add, edit, enable, or disable providers, and pin specific models without needing restarts, thanks to hot-reloading capabilities. Clipal supports multi-key pools for a single provider, rotating keys and retrying requests locally to overcome rate limits or quota issues. It also features priority-based failover with circuit breaking and quota management, enabling instant fallback to secondary models or providers. The system supports OAuth for Codex, Claude, and Gemini accounts, automatically refreshing access tokens. Clipal runs as a frictionless background service on macOS, Linux, and Windows, offering one-click CLI takeover for popular AI coding assistants, which configures local base URLs and backs up original settings. It standardizes client ingress to a single local route and is compatible with Anthropic/Claude, OpenAI/Codex, and Google Gemini request formats, supporting various AI coding assistants and desktop chat clients.
https://github.com/PAIArtCom/Clipal
Also in LLM Gateways & Proxies
Mintplex-Labs/anything-llm
AnythingLLM is an all-in-one local-first AI application for chatting with documents, managing AI agents, and integrating with various LLMs and vector databases, offering dynamic model routing and m...
BerriAI/litellm
LiteLLM is an open-source AI Gateway and Python SDK providing a unified interface to over 100 LLM providers, with features like cost tracking, guardrails, load balancing, and observability.
QuantumNous/new-api
new-api is a unified LLM gateway and AI asset management system that enables aggregation, distribution, and cross-conversion of various LLMs into OpenAI, Claude, or Gemini compatible formats, offer...
Kong/kong
Kong Gateway is a cloud-native API and AI gateway offering high performance, extensibility via plugins, and advanced AI traffic capabilities including multi-LLM support, semantic security, and cach...
decolua/9router
9Router is an AI router and token saver that connects various AI coding tools to over 40 AI providers, optimizing usage with auto-fallback, quota tracking, and token compression.
apache/apisix
Apache APISIX is a dynamic, real-time, high-performance API Gateway that can also function as an AI Gateway, providing AI proxying, load balancing for LLMs, and robust security for AI agents.
lidge-jun/opencodex
OpenCodex is a universal local proxy that enables OpenAI Codex, Claude Code, and Grok Build to utilize any LLM provider, offering advanced model routing, account pooling, and API key management.