diegosouzapw/OmniRoute
OmniRoute is a free AI gateway that unifies access to over 170 AI providers, offering token compression, auto-fallback, and aggregating free tiers to provide billions of free tokens monthly.
Awesome Infra for AI › LLM Gateways & Proxies
Paritok-official/paritok-4b-v1
Paritok-4B-v1 is an innovative open-source compression model specifically designed to optimize interactions with coding agents. Trained on 45K real coding-agent trajectories, it intelligently understands and retains critical information (like function signatures and paths) while aggressively compressing less vital data, leading to substantial token reductions. It achieves up to 95% fewer tokens on heavy long-session traffic, typically cutting input token bills by 74% to 95% with Claude/GPT models. Despite this high compression, Paritok-4B-v1 matches the performance of gpt-4.1-mini on SWE-bench Verified, retaining 86.5% of full-context solve quality. Crucially, Paritok operates as a non-destructive gateway, meaning compressed content is never permanently discarded; agents can recall exact original content on demand via an `expand_context` mechanism, providing a high degree of data integrity and flexibility. The model is small and self-hostable (a 4B LoRA adapter running on a single 24GB GPU), offering a cost-effective solution for teams looking to reduce LLM API expenses without vendor lock-in or per-token fees. It is fully compatible with popular agent frameworks like Claude Code, Cursor, and OpenHands, making it a valuable tool for optimizing LLM agent operations.
https://github.com/Paritok-official/paritok-4b-v1
Also in LLM Gateways & Proxies
Mintplex-Labs/anything-llm
AnythingLLM is an all-in-one local-first AI application for chatting with documents, managing AI agents, and integrating with various LLMs and vector databases, offering dynamic model routing and m...
BerriAI/litellm
LiteLLM is an open-source AI Gateway and Python SDK providing a unified interface to over 100 LLM providers, with features like cost tracking, guardrails, load balancing, and observability.
QuantumNous/new-api
new-api is a unified LLM gateway and AI asset management system that enables aggregation, distribution, and cross-conversion of various LLMs into OpenAI, Claude, or Gemini compatible formats, offer...
Kong/kong
Kong Gateway is a cloud-native API and AI gateway offering high performance, extensibility via plugins, and advanced AI traffic capabilities including multi-LLM support, semantic security, and cach...
decolua/9router
9Router is an AI router and token saver that connects various AI coding tools to over 40 AI providers, optimizing usage with auto-fallback, quota tracking, and token compression.
apache/apisix
Apache APISIX is a dynamic, real-time, high-performance API Gateway that can also function as an AI Gateway, providing AI proxying, load balancing for LLMs, and robust security for AI agents.
lidge-jun/opencodex
OpenCodex is a universal local proxy that enables OpenAI Codex, Claude Code, and Grok Build to utilize any LLM provider, offering advanced model routing, account pooling, and API key management.