promptfoo/promptfoo
Promptfoo is a CLI and library for evaluating LLM applications, offering automated testing, red teaming, and vulnerability scanning for prompts, models, agents, and RAGs.
Awesome Infra for AI › LLM Evaluation & Testing
uptrain-ai/uptrain
UpTrain is an open-source, unified platform designed specifically for the evaluation and improvement of Generative AI applications. It offers a comprehensive suite of tools to assess the quality and reliability of large language models (LLMs) and AI agents. The platform includes over 20 preconfigured checks covering various aspects such as language understanding, code generation, sentiment analysis, hallucination detection, toxicity, bias, and jailbreak attempts. These checks provide graded evaluations, allowing developers to quickly identify weaknesses in their models. Beyond basic evaluation, UpTrain performs root cause analysis on identified failure cases, helping uncover the underlying reasons for poor performance. It also provides actionable insights on how to resolve these issues, facilitating an iterative improvement process for AI applications. The platform supports various LLM use cases, including chatbots, agents, RAG systems, and code generation applications. It integrates with popular LLM providers like OpenAI, Azure OpenAI, Anthropic, and open-source models, allowing for flexible testing and evaluation across different environments. Key features include a no-code UI for test case generation, an SDK for custom evaluations, production monitoring for data and model drift, and a prompt experiments hub for managing and optimizing prompts. UpTrain aims to help organizations deploy reliable and robust AI applications by providing continuous evaluation, monitoring, and improvement capabilities throughout the AI development lifecycle. It's a critical tool for MLOps teams focused on the operational aspects of serving and maintaining high-quality generative AI.
https://github.com/uptrain-ai/uptrain
Also in LLM Evaluation & Testing
ifixai-ai/iFixAi
iFixAi is a diagnostic tool that evaluates AI models and agents for operational misalignment, including fabrication, manipulation, deception, unpredictability, and opacity, by running up to 45 insp...
confident-ai/deepeval
DeepEval is an open-source LLM evaluation framework, offering a variety of metrics and tools for assessing the performance of AI agents, RAG pipelines, and chatbots through unit testing.
vibrantlabsai/ragas
Ragas is an evaluation framework for LLM applications that provides objective metrics, test data generation, and feedback loops for continuous improvement.
NVIDIA/garak
Garak is an open-source LLM vulnerability scanner designed to red-team and assess generative AI models for weaknesses like hallucination, data leakage, prompt injection, and toxicity.
evidentlyai/evidently
Evidently is an open-source Python framework for evaluating, testing, and monitoring ML and LLM systems, providing comprehensive data and model quality checks from experiments to production.
open-compass/opencompass
Open-source LLM evaluation platform for running standardized benchmarks across models, with configurable datasets, prompt templates, and an official public leaderboard.
Giskard-AI/giskard-oss
Giskard is an open-source Python library for testing and evaluating agentic systems and LLM applications, offering tools for scenario-based testing, red teaming, and vulnerability scanning.