Awesome Infra for AI › LLM Gateways & Proxies

Nexus-Router/nexus

⭐ 436 Rust repository created 2025-07-11

Nexus serves as a unified AI gateway for managing diverse AI infrastructure, specifically focusing on large language models (LLMs) and Model Context Protocol (MCP) servers. It allows users to plug in various MCP servers (STDIO, SSE, HTTP) and LLM providers such as OpenAI, Anthropic, Google, and AWS Bedrock, routing all requests through a single endpoint. Key features include LLM provider routing with full tool calling support, context-aware tool search across connected tools using natural language, and flexible configuration via TOML files with environment variable substitution. The platform emphasizes security with built-in CORS, CSRF protection, OAuth2, TLS support, and multi-level rate limiting. Nexus is designed for aggregation, governance, and control of AI stacks, enabling centralized management of AI service access and usage. It can run as a standalone binary, via Docker, or be built from source, providing operational flexibility. Additionally, it supports authentication forwarding, static header insertion for MCP servers, and access control based on user groups, making it suitable for enterprise AI deployments that require fine-grained control and security.

https://github.com/Nexus-Router/nexus

aiapilarge-language-modelsllmopsllmsmcpmodel-context-protocolllm-gatewayai-governancesecurityroutingllm-proxy