promptfoo/promptfoo
Promptfoo is a CLI and library for evaluating LLM applications, offering automated testing, red teaming, and vulnerability scanning for prompts, models, agents, and RAGs.
Awesome Infra for AI › LLM Evaluation & Testing
cvs-health/langfair
LangFair is a comprehensive Python library designed to evaluate bias and fairness in large language model (LLM) use cases. It departs from static benchmark assessments, which often fail to capture real-world risks, by adopting a "Bring Your Own Prompts" (BYOP) approach. This allows users to tailor bias and fairness evaluations to their specific scenarios, ensuring that computed metrics accurately reflect LLM performance in practical applications where prompt-specific risks are critical. The library focuses on output-based metrics, making it suitable for governance audits and real-world testing without requiring access to internal model states. Key functionalities include generating LLM responses using LangChain integrations, computing toxicity metrics such as Toxic Fraction and Expected Maximum Toxicity, and assessing stereotype metrics like Stereotype Association and Cooccurrence Bias. LangFair also supports counterfactual metric generation and computation, helping to identify and quantify biases related to specific attributes like gender. For streamlined assessments, the `AutoEval` class offers a semi-automated evaluation process, integrating response generation and various metric computations in a few lines of code. This makes LangFair a valuable tool for developers, researchers, and organizations aiming to build more responsible and ethical AI applications by rigorously evaluating their LLMs for fairness and bias.
https://github.com/cvs-health/langfair
Also in LLM Evaluation & Testing
ifixai-ai/iFixAi
iFixAi is a diagnostic tool that evaluates AI models and agents for operational misalignment, including fabrication, manipulation, deception, unpredictability, and opacity, by running up to 45 insp...
confident-ai/deepeval
DeepEval is an open-source LLM evaluation framework, offering a variety of metrics and tools for assessing the performance of AI agents, RAG pipelines, and chatbots through unit testing.
vibrantlabsai/ragas
Ragas is an evaluation framework for LLM applications that provides objective metrics, test data generation, and feedback loops for continuous improvement.
NVIDIA/garak
Garak is an open-source LLM vulnerability scanner designed to red-team and assess generative AI models for weaknesses like hallucination, data leakage, prompt injection, and toxicity.
evidentlyai/evidently
Evidently is an open-source Python framework for evaluating, testing, and monitoring ML and LLM systems, providing comprehensive data and model quality checks from experiments to production.
open-compass/opencompass
Open-source LLM evaluation platform for running standardized benchmarks across models, with configurable datasets, prompt templates, and an official public leaderboard.
Giskard-AI/giskard-oss
Giskard is an open-source Python library for testing and evaluating agentic systems and LLM applications, offering tools for scenario-based testing, red teaming, and vulnerability scanning.