P
promptfoo
promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
★24.1kstars
TypeScript
MIT
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?Dev Tools project leveraging ci and ci-cd, built with TypeScript, open-source
Who made it?Maintained by promptfoo team, 24.1K⭐ on GitHub, #83 out of 2853 in Dev Tools
Why does it exist?With the growing demand for ci and ci-cd in Dev Tools, promptfoo created promptfoo as a streamlined solution.
What can it do?Key use cases: cicd, evaluation, evaluation-framework
How to install with AI?Use an AI coding assistant to automatically run npm/pnpm install and configure the project per the README.
🔗 github.com/promptfoo/promptfoo | 官网 https://promptfoo.dev
🔗 github.com/promptfoo/promptfoo | 官网 https://promptfoo.dev
Topics
cici-cdcicdevaluationevaluation-frameworkllmllm-evalllm-evaluationllm-evaluation-frameworkllmopspentestingprompt-engineeringprompt-testingpromptsragred-teamingtestingvulnerability-scanners