Awesome Infra for AI › Workflow Orchestration for AI

stoyan-stoyanov/llmflows

⭐ 708 Python repository created 2023-06-26

LLMFlows is a Python framework designed to simplify the development and operation of Large Language Model (LLM) applications such as chatbots, question-answering systems, and AI agents. It emphasizes simplicity, explicitness, and transparency, providing core abstractions to utilize LLMs and vector stores without hidden prompts or LLM calls. The framework allows users to define complex flows of LLM interactions and manage dependencies between prompt templates and LLM generations. It supports both synchronous and asynchronous execution of flow steps to optimize runtime. LLMFlows aims to provide full control and visibility into each component of an LLM application, facilitating easier monitoring, maintenance, and debugging of these systems in production. It integrates with various LLM APIs and enables the construction of structured applications with clear flow orchestration. Key features include prompt templating, chat history management for conversational LLMs, and flow orchestration for complex, multi-step LLM interactions.

https://github.com/stoyan-stoyanov/llmflows

llmllmopsworkflow orchestrationprompt managementllm-inferencepythonAI agents

Also in Workflow Orchestration for AI

ComposioHQ/composio

Composio provides SDKs for building AI agents capable of interacting with over 1000 tools, offering capabilities like tool search, context management, and authentication across various AI frameworks.

TencentCloud/TencentDB-Agent-Memory

TencentDB Agent Memory is a memory management system for AI agents, featuring a 4-tier progressive pipeline to improve efficiency and reasoning by categorizing and condensing agent memories without...

TransformerOptimus/SuperAGI

SuperAGI is an open-source framework designed for building, managing, and running autonomous AI agents, offering tools for deployment, capability extension, and performance monitoring.

dataelement/bisheng

BISHENG is an open LLM application DevOps platform focusing on enterprise scenarios, providing comprehensive features for GenAI workflows, RAG, agents, model management, evaluation, and enterprise-...

iflytek/astron-agent

Astron Agent is an enterprise-grade platform for building, orchestrating, and deploying AI agent applications with integrated RPA, model management, and high-availability features.

0xPlaygrounds/rig

Rig is a Rust library designed for building modular and scalable LLM-powered applications, offering a unified interface for multiple model providers and vector stores.

plastic-labs/honcho

Honcho is a memory infrastructure for building stateful AI agents, enabling them to understand and retain information about people, agents, groups, projects, and ideas over time.

julep-ai/julep

Julep is an open-source platform for building, orchestrating, and self-hosting agent-based AI workflows with persistent memory and tool integration.