Awesome Infra for AI › Workflow Orchestration for AI

ThousandBirdsInc/chidori

⭐ 1366 Rust repository created 2023-07-19

Chidori is a reactive runtime and agent framework designed to simplify the development and operation of AI agents by making them durable, replayable, and resumable by default. It addresses common challenges of building non-deterministic, expensive, and long-running agents by capturing every side effect (LLM calls, tool calls, HTTP requests) as a recorded 'host call'. This architecture enables automatic checkpointing, allowing agents to survive crashes, pause for human intervention without holding processes, and resume from any point. The unique replay feature ensures byte-identical output with zero LLM calls, making debugging, testing, and continuous integration efficient and cost-effective. Agents are written in plain async TypeScript, avoiding DSLs or complex graph configurations, and run on an embedded pure-Rust JavaScript engine, eliminating external Node.js dependencies. Chidori also includes structural prompt caching and provides SDKs for TypeScript and Python, enabling developers to build robust conversational assistants or autonomous tool-using workers with inherent fault tolerance and debugging capabilities. Its core focus is on the operational aspects of AI agents, providing a reliable infrastructure for their execution and management.

https://github.com/ThousandBirdsInc/chidori

AI agentsLLM orchestrationdurable agentsreplayable agentsresumable agentsagent frameworkTypeScriptRustMLOpsLLMOpsAI testingAI debuggingprompt caching

Also in Workflow Orchestration for AI

ComposioHQ/composio

Composio provides SDKs for building AI agents capable of interacting with over 1000 tools, offering capabilities like tool search, context management, and authentication across various AI frameworks.

TencentCloud/TencentDB-Agent-Memory

TencentDB Agent Memory is a memory management system for AI agents, featuring a 4-tier progressive pipeline to improve efficiency and reasoning by categorizing and condensing agent memories without...

TransformerOptimus/SuperAGI

SuperAGI is an open-source framework designed for building, managing, and running autonomous AI agents, offering tools for deployment, capability extension, and performance monitoring.

dataelement/bisheng

BISHENG is an open LLM application DevOps platform focusing on enterprise scenarios, providing comprehensive features for GenAI workflows, RAG, agents, model management, evaluation, and enterprise-...

iflytek/astron-agent

Astron Agent is an enterprise-grade platform for building, orchestrating, and deploying AI agent applications with integrated RPA, model management, and high-availability features.

0xPlaygrounds/rig

Rig is a Rust library designed for building modular and scalable LLM-powered applications, offering a unified interface for multiple model providers and vector stores.

plastic-labs/honcho

Honcho is a memory infrastructure for building stateful AI agents, enabling them to understand and retain information about people, agents, groups, projects, and ideas over time.

julep-ai/julep

Julep is an open-source platform for building, orchestrating, and self-hosting agent-based AI workflows with persistent memory and tool integration.