Home » AI Directory » Developer » Promptfoo
Promptfoo
Open-source LLM evals and red teaming.
Visit Promptfoo » promptfoo.dev
| Promptfoo at a glance | |
|---|---|
| What it does | Open-source LLM evals and red teaming |
| Category | Developer |
| Website | www.promptfoo.dev |
| Checked | Website working when last checked (2026-10-16) |
In their own words
“The AI Security Platform that catches vulnerabilities in development. Trusted by 156 of the Fortune 500 and 300,000+ developers worldwide.”
— from the Promptfoo website
8 alternatives to Promptfoo
Other developer tools that do similar things:
Langfuse
Open-source LLM engineering platform for tracing and evals
Haystack
Open-source framework for LLM and RAG pipelines
LiteLLM
Open-source LLM gateway with a unified API
Helicone
Open-source LLM observability and gateway
Arize Phoenix
Open-source LLM tracing and evaluation
Comet Opik
Open-source LLM evaluation and tracing
DeepEval
Open-source framework for evaluating LLM outputs
Agenta
Open-source LLMOps platform for prompts and evals
How to choose
- Try it on your real codebase, not a demo. Results vary a lot by language and project size.
- Decide how much control you want: suggestions you accept line by line, or an agent that makes larger changes for you to review.
- Check your company's rules on sending code to outside AI services before you start.
Full guide to choosing developer tools »
Is this your tool? Get it featured at the top of its category. Something wrong on this page? Tell us.