Awesome Infra for AI › LLM Gateways & Proxies

taichuy/1flowbase

⭐ 267 Rust repository created 2026-03-09

1flowbase functions as an open-source virtual model gateway designed for local AI agent clients, enabling the composition of elaborate, multi-model workflows. These workflows can then be published as standard OpenAI or Claude-compatible model endpoints, offering a unified access point. The platform provides comprehensive visibility into these workflows, detailing model calls, node inputs and outputs, tool callbacks, token usage, latency, failures, and associated costs. This allows users to debug execution node by node, rather than just seeing the final response. Key features include a visual workflow editor, multi-node orchestration, and support for streaming responses across OpenAI Responses, OpenAI Chat Completions, and Claude-compatible Messages APIs. By providing a detailed breakdown of the execution path, 1flowbase helps optimize costs through model cascading, fallbacks, verification, and formatting steps. It addresses the common challenge of opaque AI request processes by illuminating the hidden execution path, which often includes system prompts, tool definitions, chat history, and intermediate model calls, all of which impact cost, latency, and output quality. The platform also focuses on tracking token consumption and offers tools for prompt and model configuration version history, ultimately aiming to facilitate the optimization and reuse of complex AI workflows.

https://github.com/taichuy/1flowbase

ai-agents-platformai-gatewayclaude-apicost-optimizationfusionllm-gatewayllm-orchestrationllmopsmodel-routermulti-agentobservabilityself-hostedtoken-trackingvirtual-modelworkflow-engine