Awesome Infra for AI › LLM Gateways & Proxies

starbaser/ccproxy

⭐ 348 Python repository created 2025-07-29

ccproxy is a command-line interface proxy designed for transparent network interception of LLM traffic. Built on mitmproxy and WireGuard, it provides full TLS inspection and allows users to hook into, modify, and reroute requests and responses between different LLM providers like Anthropic, OpenAI, Gemini, DeepSeek, and Perplexity Pro. Its core functionality includes a DAG-driven pipeline for decomposing, transforming, and routing traffic, supported by 'lightllm' for surgical adaptation and streaming finite-state machine operations. The tool facilitates cross-provider routing, allowing users to direct requests to specific models or providers based on custom logic. It also supports 'compliance shaping' by replaying sanitized SDK envelopes while injecting actual request content at runtime. ccproxy aims to extend LLM client capabilities by bridging unsupported Model Context Protocol (MCP) features such as sampling, server notifications, and experimental tasks. The architecture features an addon chain for processing requests and responses, handling authentication, Gemini-specific fallbacks, and egress sanitization. It also includes an `SSEPipeline` for managing cross-provider streaming. Configuration is managed via a YAML file, allowing users to define providers, their authentication mechanisms, and custom hooks to control LLM usage.

https://github.com/starbaser/ccproxy

aiai-gatewayai-proxyai-toolsanthropicclaudeclaude-aiclaude-apiclaude-codeclaude-maxclaudecodegeminigemini-clilitellmllmllm-gatewayllm-proxyllmopsopenaiopenrouter