Awesome Infra for AI › Workflow Orchestration for AI

0xPlaygrounds/rig

⭐ 8807 Rust repository created 2024-06-05

Rig is a Rust-based library that facilitates the development of scalable, modular, and ergonomic applications powered by Large Language Models (LLMs). It provides a high-level abstraction layer that unifies access to over 20 different LLM providers and more than 10 vector store integrations, simplifying the integration of AI capabilities into applications. The library supports various LLM functionalities, including completion, embedding workflows, transcription, audio generation, and image generation. A core feature is its support for agentic workflows, enabling multi-turn streaming and prompting, which is crucial for building sophisticated AI agents. Rig emphasizes GenAI Semantic Convention compatibility for robust observability. It is designed to minimize boilerplate code when interacting with LLMs and is engineered for full WebAssembly (WASM) compatibility for its core library. This makes Rig suitable for developers looking to build performant and maintainable LLM applications in a strongly-typed language, addressing the operational aspects of serving and orchestrating AI models.

https://github.com/0xPlaygrounds/rig

agentaiartificial-intelligenceautomationgenerative-ailarge-language-modelllmllmopsrustscalable-ai

Also in Workflow Orchestration for AI

ComposioHQ/composio

Composio provides SDKs for building AI agents capable of interacting with over 1000 tools, offering capabilities like tool search, context management, and authentication across various AI frameworks.

TencentCloud/TencentDB-Agent-Memory

TencentDB Agent Memory is a memory management system for AI agents, featuring a 4-tier progressive pipeline to improve efficiency and reasoning by categorizing and condensing agent memories without...

TransformerOptimus/SuperAGI

SuperAGI is an open-source framework designed for building, managing, and running autonomous AI agents, offering tools for deployment, capability extension, and performance monitoring.

dataelement/bisheng

BISHENG is an open LLM application DevOps platform focusing on enterprise scenarios, providing comprehensive features for GenAI workflows, RAG, agents, model management, evaluation, and enterprise-...

iflytek/astron-agent

Astron Agent is an enterprise-grade platform for building, orchestrating, and deploying AI agent applications with integrated RPA, model management, and high-availability features.

plastic-labs/honcho

Honcho is a memory infrastructure for building stateful AI agents, enabling them to understand and retain information about people, agents, groups, projects, and ideas over time.

julep-ai/julep

Julep is an open-source platform for building, orchestrating, and self-hosting agent-based AI workflows with persistent memory and tool integration.

GoogleCloudPlatform/agent-starter-pack

A Python package providing production-ready templates for GenAI agents on Google Cloud, focusing on infrastructure, CI/CD, observability, and security.