diegosouzapw/OmniRoute
OmniRoute is a free AI gateway that unifies access to over 170 AI providers, offering token compression, auto-fallback, and aggregating free tiers to provide billions of free tokens monthly.
Awesome Infra for AI › LLM Gateways & Proxies
decolua/9router
9Router is a smart routing solution designed to optimize the usage of large language models (LLMs) for AI coding tools. It acts as a proxy, intercepting requests from tools like Claude Code, Codex, and Cursor, and intelligently routing them to a diverse array of over 40 AI providers and 100+ models. A primary feature is its "RTK Token Saver," which compresses `tool_result` content, potentially reducing token consumption by 20-40% per request. This helps users save on costs and avoid hitting API rate limits. The router also implements an advanced auto-fallback mechanism, prioritizing subscribed models, then cheaper alternatives, and finally free models, ensuring continuous operation even when quotas are exhausted or rate limits are hit. It offers multi-account support for round-robin distribution and includes quota tracking to maximize subscription utilization. By translating formats (e.g., OpenAI to Claude), it ensures compatibility across different AI APIs. 9Router serves as a universal gateway, preventing downtime, reducing expenditure, and providing a unified access point for a wide range of AI models from various providers.
https://github.com/decolua/9router
Also in LLM Gateways & Proxies
Mintplex-Labs/anything-llm
AnythingLLM is an all-in-one local-first AI application for chatting with documents, managing AI agents, and integrating with various LLMs and vector databases, offering dynamic model routing and m...
BerriAI/litellm
LiteLLM is an open-source AI Gateway and Python SDK providing a unified interface to over 100 LLM providers, with features like cost tracking, guardrails, load balancing, and observability.
QuantumNous/new-api
new-api is a unified LLM gateway and AI asset management system that enables aggregation, distribution, and cross-conversion of various LLMs into OpenAI, Claude, or Gemini compatible formats, offer...
Kong/kong
Kong Gateway is a cloud-native API and AI gateway offering high performance, extensibility via plugins, and advanced AI traffic capabilities including multi-LLM support, semantic security, and cach...
apache/apisix
Apache APISIX is a dynamic, real-time, high-performance API Gateway that can also function as an AI Gateway, providing AI proxying, load balancing for LLMs, and robust security for AI agents.
lidge-jun/opencodex
OpenCodex is a universal local proxy that enables OpenAI Codex, Claude Code, and Grok Build to utilize any LLM provider, offering advanced model routing, account pooling, and API key management.
casdoor/casdoor
Casdoor is an open-source, "AI-first" Identity and Access Management (IAM) and Model Context Protocol (MCP) gateway, providing authentication and authorization for AI applications and agents.