BoundaryML/baml
BAML (Basically a Made-up Language) is an AI framework that facilitates reliable AI workflows and agents by transforming prompt engineering into schema engineering for structured output generation.
Awesome Infra for AI › Prompt Management
genkit-ai/genkit
Genkit is an open-source, multi-language framework (JavaScript/TypeScript, Go, Python, Dart) developed and used in production by Google for building full-stack AI applications. It offers a unified interface for integrating with various AI models from providers like Google, OpenAI, Anthropic, and Ollama. The framework simplifies AI development by providing streamlined APIs for functionalities such as structured output, agentic tool calling, context-aware generation (RAG), and multi-modal input/output. It supports seamless integration with web and mobile platforms through purpose-built client SDKs. Genkit includes developer tools like a CLI and a local Developer UI for rapid prototyping, testing, and debugging of AI flows and prompts, offering detailed execution traces and visual feedback. It also provides comprehensive production monitoring capabilities to track model performance, request volumes, latency, and error rates through a dedicated dashboard. This allows developers to ship AI features with confidence and ensure they meet quality and performance targets in real-world usage. Genkit is designed for server-side deployment in various environments, including Firebase Cloud Functions and Google Cloud Run, while also enabling client-side integration.
https://github.com/genkit-ai/genkit
Also in Prompt Management
pezzolabs/pezzo
Pezzo is an open-source, cloud-native LLMOps platform for streamlined prompt design, version management, instant delivery, collaboration, troubleshooting, and observability of AI operations.
dot-agent/nextpy
Nextpy is a framework for building self-modifying software, focusing on guardrails, structured outputs, a powerful prompt engine for pre-compiling and session state, and optimized code generation f...
neuron-core/neuron-ai
Neuron is a PHP framework for building and orchestrating AI agents, supporting LLM integration, prompt management, RAG, multi-agent workflows, and observability.
microsoft/aici
AICI (Artificial Intelligence Controller Interface) allows building Wasm-based controllers to constrain and direct LLM output in real time, enabling advanced generation strategies.
patterns-ai-core/langchainrb
Langchain.rb provides a Ruby interface for building LLM-powered applications, offering a unified API for various LLM providers, prompt management, and RAG capabilities.
Open-Source-Legal/OpenContracts
OpenContracts is an open-source document intelligence platform that processes unstructured documents into a programmable citation graph using AI agents, structured extraction, and a Model Context P...
microsoft/prompty
Prompty is a markdown-based file format (.prompty) and runtime for creating, managing, and executing LLM prompts, providing tools for development, previewing, and tracing.