BoundaryML/baml
BAML (Basically a Made-up Language) is an AI framework that facilitates reliable AI workflows and agents by transforming prompt engineering into schema engineering for structured output generation.
Awesome Infra for AI › Prompt Management
pezzolabs/pezzo
Pezzo is an open-source, cloud-native LLMOps platform designed to enhance the operational aspects of Large Language Model (LLM) applications. Its core purpose is to streamline the entire lifecycle of prompt management and AI operations, from design to deployment and monitoring. The platform facilitates prompt design, enabling developers to create and iterate on prompts efficiently. It includes robust version management capabilities, ensuring that changes to prompts are tracked and can be rolled back if necessary. Pezzo emphasizes instant delivery of AI changes, allowing for rapid iteration and deployment of prompt updates in production environments. Collaboration features are built-in, enabling teams to work together on prompt engineering and LLM application development. For operational excellence, Pezzo provides comprehensive troubleshooting tools and observability features, allowing users to monitor their AI operations, identify issues, and obtain insights into model behavior. The platform also aims to optimize costs and reduce latency associated with LLM interactions through features like caching. It supports various clients, including Node.js and Python, and integrates with frameworks like LangChain, making it versatile for different development stacks. Pezzo’s infrastructure relies on open-source technologies such as PostgreSQL, ClickHouse, Redis, and Supertokens, designed for scalability and cloud-native deployments.
https://github.com/pezzolabs/pezzo
Also in Prompt Management
genkit-ai/genkit
Genkit is an open-source framework by Google for building and operating AI-powered applications across multiple languages, featuring unified APIs for various models, structured outputs, multi-modal...
dot-agent/nextpy
Nextpy is a framework for building self-modifying software, focusing on guardrails, structured outputs, a powerful prompt engine for pre-compiling and session state, and optimized code generation f...
neuron-core/neuron-ai
Neuron is a PHP framework for building and orchestrating AI agents, supporting LLM integration, prompt management, RAG, multi-agent workflows, and observability.
microsoft/aici
AICI (Artificial Intelligence Controller Interface) allows building Wasm-based controllers to constrain and direct LLM output in real time, enabling advanced generation strategies.
patterns-ai-core/langchainrb
Langchain.rb provides a Ruby interface for building LLM-powered applications, offering a unified API for various LLM providers, prompt management, and RAG capabilities.
Open-Source-Legal/OpenContracts
OpenContracts is an open-source document intelligence platform that processes unstructured documents into a programmable citation graph using AI agents, structured extraction, and a Model Context P...
microsoft/prompty
Prompty is a markdown-based file format (.prompty) and runtime for creating, managing, and executing LLM prompts, providing tools for development, previewing, and tracing.