[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"project-3720":3},{"id":4,"name":5,"fullName":6,"owner":5,"repo":5,"description":7,"homepage":8,"htmlUrl":9,"language":10,"languages":9,"totalLinesOfCode":9,"stars":11,"forks":12,"watchers":13,"openIssues":14,"contributorsCount":15,"subscribersCount":15,"size":15,"stars1d":16,"stars7d":17,"stars30d":18,"stars90d":15,"forks30d":15,"starsTrendScore":19,"compositeScore":20,"rankGlobal":9,"rankLanguage":9,"license":21,"archived":22,"fork":22,"defaultBranch":23,"hasWiki":22,"hasPages":22,"topics":24,"createdAt":9,"pushedAt":9,"updatedAt":43,"readmeContent":44,"aiSummary":45,"trendingCount":15,"starSnapshotCount":15,"syncStatus":46,"lastSyncTime":47,"discoverSource":48},3720,"promptfoo","promptfoo\u002Fpromptfoo","Test your prompts, agents, and RAGs. Red teaming\u002Fpentesting\u002Fvulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI\u002FCD integration.  Used by OpenAI and Anthropic.","https:\u002F\u002Fpromptfoo.dev",null,"TypeScript",22116,1963,58,78,0,34,233,963,168,44.88,"MIT License",false,"main",[25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42],"ci","ci-cd","cicd","evaluation","evaluation-framework","llm","llm-eval","llm-evaluation","llm-evaluation-framework","llmops","pentesting","prompt-engineering","prompt-testing","prompts","rag","red-teaming","testing","vulnerability-scanners","2026-06-12 02:00:53","# Promptfoo: LLM evals & red teaming\n\n\u003Cp align=\"center\">\n  \u003Ca href=\"https:\u002F\u002Fnpmjs.com\u002Fpackage\u002Fpromptfoo\">\u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fnpm\u002Fv\u002Fpromptfoo\" alt=\"npm\">\u003C\u002Fa>\n  \u003Ca href=\"https:\u002F\u002Fnpmjs.com\u002Fpackage\u002Fpromptfoo\">\u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fnpm\u002Fdm\u002Fpromptfoo\" alt=\"npm\">\u003C\u002Fa>\n  \u003Ca href=\"https:\u002F\u002Fgithub.com\u002Fpromptfoo\u002Fpromptfoo\u002Factions\u002Fworkflows\u002Fmain.yml\">\u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Factions\u002Fworkflow\u002Fstatus\u002Fpromptfoo\u002Fpromptfoo\u002Fmain.yml\" alt=\"GitHub Workflow Status\">\u003C\u002Fa>\n  \u003Ca href=\"https:\u002F\u002Fgithub.com\u002Fpromptfoo\u002Fpromptfoo\u002Fblob\u002Fmain\u002FLICENSE\">\u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Flicense\u002Fpromptfoo\u002Fpromptfoo\" alt=\"MIT license\">\u003C\u002Fa>\n  \u003Ca href=\"https:\u002F\u002Fdiscord.gg\u002Fpromptfoo\">\u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fdiscord\u002F1146610656779440188?logo=discord&label=promptfoo\" alt=\"Discord\">\u003C\u002Fa>\n\u003C\u002Fp>\n\n\u003Cp align=\"center\">\n  \u003Ccode>promptfoo\u003C\u002Fcode> is a CLI and library for evaluating and red-teaming LLM apps. Stop the trial-and-error approach - start shipping secure, reliable AI apps.\n\u003C\u002Fp>\n\n\u003Cp align=\"center\">\n  \u003Ca href=\"https:\u002F\u002Fwww.promptfoo.dev\">Website\u003C\u002Fa> ·\n  \u003Ca href=\"https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fgetting-started\u002F\">Getting Started\u003C\u002Fa> ·\n  \u003Ca href=\"https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fred-team\u002F\">Red Teaming\u003C\u002Fa> ·\n  \u003Ca href=\"https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002F\">Documentation\u003C\u002Fa> ·\n  \u003Ca href=\"https:\u002F\u002Fdiscord.gg\u002Fpromptfoo\">Discord\u003C\u002Fa>\n\u003C\u002Fp>\n\n> Promptfoo is now part of OpenAI. Promptfoo remains open source and MIT licensed. Read the [company update](https:\u002F\u002Fwww.promptfoo.dev\u002Fblog\u002Fpromptfoo-joining-openai\u002F).\n\n## Quick Start\n\nRequires [Node.js](https:\u002F\u002Fnodejs.org\u002Fen\u002Fdownload) 20.20+ or 22.22+ for npm and npx usage.\n\n```sh\nnpm install -g promptfoo\npromptfoo init --example getting-started\n```\n\nAlso available via `brew install promptfoo` and `pip install promptfoo`. You can also use `npx promptfoo@latest` to run any command without installing.\n\nMost LLM providers require an API key. Set yours as an environment variable:\n\n```sh\nexport OPENAI_API_KEY=sk-abc123\n```\n\nOnce you're in the example directory, run an eval and view results:\n\n```sh\ncd getting-started\npromptfoo eval\npromptfoo view\n```\n\nSee [Getting Started](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fgetting-started\u002F) (evals) or [Red Teaming](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fred-team\u002F) (vulnerability scanning) for more.\n\n## What can you do with Promptfoo?\n\n- **Test your prompts and models** with [automated evaluations](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fgetting-started\u002F)\n- **Secure your LLM apps** with [red teaming](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fred-team\u002F) and vulnerability scanning\n- **Compare models** side-by-side (OpenAI, Anthropic, Azure, Bedrock, Ollama, and [more](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fproviders\u002F))\n- **Automate checks** in [CI\u002FCD](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fintegrations\u002Fci-cd\u002F)\n- **Review pull requests** for LLM-related security and compliance issues with [code scanning](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fcode-scanning\u002F)\n- **Share results** with your team\n\nHere's what it looks like in action:\n\n\u003Cimg src=\"site\u002Fstatic\u002Fimg\u002Fclaude-vs-gpt-example@2x.png\" alt=\"prompt evaluation matrix - web viewer\" width=\"700\">\n\nIt works on the command line too:\n\n\u003Cimg src=\"https:\u002F\u002Fwww.promptfoo.dev\u002Fimg\u002Fdocs\u002Fself-grading.gif\" alt=\"promptfoo command line\" width=\"700\">\n\nIt also can generate [security vulnerability reports](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fred-team\u002F):\n\n\u003Cimg src=\"https:\u002F\u002Fwww.promptfoo.dev\u002Fimg\u002Fredteam-dashboard@2x.jpg\" alt=\"gen ai red team\" width=\"700\">\n\n## Why Promptfoo?\n\n- **Developer-first**: Fast, with features like live reload and caching\n- **Private**: LLM evals run 100% locally - your prompts never leave your machine\n- **Flexible**: Works with any LLM API or programming language\n- **Battle-tested**: Powers LLM apps serving 10M+ users in production\n- **Data-driven**: Make decisions based on metrics, not gut feel\n- **Open source**: MIT licensed, with an active community\n\n## Learn More\n\n- [Getting Started](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fgetting-started\u002F)\n- [Full Documentation](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fintro\u002F)\n- [Red Teaming Guide](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fred-team\u002F)\n- [CLI Usage](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fusage\u002Fcommand-line\u002F)\n- [Node.js Package](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fusage\u002Fnode-package\u002F)\n- [Supported Models](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fproviders\u002F)\n- [Code Scanning Guide](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fcode-scanning\u002F)\n\n## Contributing\n\nWe welcome contributions! Check out our [contributing guide](https:\u002F\u002Fwww.promptfoo.dev\u002Fdocs\u002Fcontributing\u002F) to get started.\n\nJoin our [Discord community](https:\u002F\u002Fdiscord.gg\u002Fpromptfoo) for help and discussion.\n\n\u003Ca href=\"https:\u002F\u002Fgithub.com\u002Fpromptfoo\u002Fpromptfoo\u002Fgraphs\u002Fcontributors\">\n  \u003Cimg src=\"https:\u002F\u002Fcontrib.rocks\u002Fimage?repo=promptfoo\u002Fpromptfoo\" \u002F>\n\u003C\u002Fa>\n","Promptfoo 是一个用于评估和红队测试大语言模型应用的命令行工具和库。它支持自动化的提示词和模型测试，帮助开发者构建安全可靠的AI应用，并提供红队测试和漏洞扫描功能来增强应用的安全性。该工具允许用户对比不同模型（如GPT、Claude、Gemini等）的表现，并通过简单的声明式配置轻松集成到CI\u002FCD流程中。适用于需要确保其基于LLM的应用程序质量与安全性的开发团队或个人，在开发过程中持续监控模型性能及安全性。",2,"2026-06-11 02:55:47","top_language"]