Promptfoo

NewTrialOpen Source
Visit Website

Open-source tool for testing and evaluating LLM prompts

evaluationtestingprompts
Advantages
  • CLI-based
  • Multiple provider support
  • CI/CD integration
Considerations
  • Learning curve
  • Config-heavy
PricingFree tier: Fully open source
Use Cases
Prompt testing
Model comparison
Regression testing
Alternatives
RAGAS
DeepEval
LangSmith
Release History

No release history available yet.