Promptfoo

Promptfoo is an AI security and testing platform that helps developers evaluate, secure, and improve AI applications, agents, and LLM workflows through automated testing. They enable teams to run red teaming, detect vulnerabilities, evaluate prompts, and test AI behavior at scale, making it easier to identify risks before deployment. The platform is designed for AI development workflows with automated attack simulation, security testing, and continuous evaluation tools, allowing teams to build more reliable and secure AI systems.

They provide advanced capabilities like prompt injection testing, jailbreak detection, PII leak analysis, and AI guardrail evaluation, enabling organizations to monitor AI risks across applications and agents. Developers can integrate CI/CD pipelines, GitHub workflows, MCP frameworks, and cloud or on-premise environments, while receiving automated remediation guidance and real-time threat intelligence. With support for 50+ vulnerability types, large-scale automation, and enterprise-grade security workflows, they are widely used by enterprises and AI engineering teams building production AI applications.

And the best part? They offer an open-source version for developers, while enterprise pricing is not publicly disclosed.