Awesome Infra for AI › Workflow Orchestration for AI

LiteLLM-Labs/litellm-agent-control-plane

⭐ 1302 Rust repository created 2026-05-07

LiteLLM Agent Control Plane (LAP) serves as a centralized platform for managing and operating diverse AI agents, such as OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, and DeepAgents. It offers a unified API to create, run, and orchestrate these agents, abstracting away the complexities of underlying runtimes. LAP allows developers to deploy agents without direct access to model providers like Bedrock or Anthropic, streamlining access control within teams. Key features include persistent agent session management, enabling agents to retain context across runs, and the ability to schedule agents using CRON for automated execution. The platform also focuses on memory management, ensuring agents can recall and utilize past interactions and data. By integrating with LiteLLM's AI gateway capabilities, it provides a comprehensive solution for operationalizing AI agents in a controlled and accessible environment.

https://github.com/LiteLLM-Labs/litellm-agent-control-plane

agent-builderagent-builder-toolsagent-platformai-gatewaylitellmagent-orchestrationllm-opsagent-managementunified-api

Also in Workflow Orchestration for AI

ComposioHQ/composio

Composio provides SDKs for building AI agents capable of interacting with over 1000 tools, offering capabilities like tool search, context management, and authentication across various AI frameworks.

TencentCloud/TencentDB-Agent-Memory

TencentDB Agent Memory is a memory management system for AI agents, featuring a 4-tier progressive pipeline to improve efficiency and reasoning by categorizing and condensing agent memories without...

TransformerOptimus/SuperAGI

SuperAGI is an open-source framework designed for building, managing, and running autonomous AI agents, offering tools for deployment, capability extension, and performance monitoring.

dataelement/bisheng

BISHENG is an open LLM application DevOps platform focusing on enterprise scenarios, providing comprehensive features for GenAI workflows, RAG, agents, model management, evaluation, and enterprise-...

iflytek/astron-agent

Astron Agent is an enterprise-grade platform for building, orchestrating, and deploying AI agent applications with integrated RPA, model management, and high-availability features.

0xPlaygrounds/rig

Rig is a Rust library designed for building modular and scalable LLM-powered applications, offering a unified interface for multiple model providers and vector stores.

plastic-labs/honcho

Honcho is a memory infrastructure for building stateful AI agents, enabling them to understand and retain information about people, agents, groups, projects, and ideas over time.

julep-ai/julep

Julep is an open-source platform for building, orchestrating, and self-hosting agent-based AI workflows with persistent memory and tool integration.