diegosouzapw/OmniRoute
OmniRoute is a free AI gateway that unifies access to over 170 AI providers, offering token compression, auto-fallback, and aggregating free tiers to provide billions of free tokens monthly.
Awesome Infra for AI › LLM Gateways & Proxies
QuantumNous/new-api
new-api functions as a next-generation LLM gateway and AI asset management system, designed for aggregating and distributing various large language models. Its core capability lies in cross-converting different LLMs to be compatible with OpenAI, Claude, or Gemini APIs, thereby providing a centralized access point. The project emphasizes multi-model management, allowing users to consolidate and manage diverse AI models through a single interface. Key features include a modern UI, multi-language support, data compatibility with the original One API database, and a visual dashboard for statistical analysis. It also offers robust permission management, including token grouping, model restrictions, and user management. For authorized usage, new-api provides internal top-up and quota allocation, organizational-level cost accounting based on requests, usage, and cache-hits, and flexible billing policies for internal or enterprise customers. It supports cache billing statistics for models like OpenAI, Azure, DeepSeek, Claude, and Qwen, making it a comprehensive solution for managing AI API access, usage, and costs.
https://github.com/QuantumNous/new-api
Also in LLM Gateways & Proxies
Mintplex-Labs/anything-llm
AnythingLLM is an all-in-one local-first AI application for chatting with documents, managing AI agents, and integrating with various LLMs and vector databases, offering dynamic model routing and m...
BerriAI/litellm
LiteLLM is an open-source AI Gateway and Python SDK providing a unified interface to over 100 LLM providers, with features like cost tracking, guardrails, load balancing, and observability.
Kong/kong
Kong Gateway is a cloud-native API and AI gateway offering high performance, extensibility via plugins, and advanced AI traffic capabilities including multi-LLM support, semantic security, and cach...
decolua/9router
9Router is an AI router and token saver that connects various AI coding tools to over 40 AI providers, optimizing usage with auto-fallback, quota tracking, and token compression.
apache/apisix
Apache APISIX is a dynamic, real-time, high-performance API Gateway that can also function as an AI Gateway, providing AI proxying, load balancing for LLMs, and robust security for AI agents.
lidge-jun/opencodex
OpenCodex is a universal local proxy that enables OpenAI Codex, Claude Code, and Grok Build to utilize any LLM provider, offering advanced model routing, account pooling, and API key management.
casdoor/casdoor
Casdoor is an open-source, "AI-first" Identity and Access Management (IAM) and Model Context Protocol (MCP) gateway, providing authentication and authorization for AI applications and agents.