DeepEval
NewTrialOpen Sourcev1.3Latest release: November 15, 2024
Open-source LLM evaluation framework
evaluationllmtestingopen-source
Advantages
- Open source
- Pytest integration
- Many built-in metrics
- CI/CD friendly
- Active development
Considerations
- Newer project
- Documentation evolving
- Requires LLM for some metrics
PricingFree tier: Fully open source
Use Cases
LLM output evaluation
RAG testing
Regression testing
Benchmark comparisons
Release History
1.3November 15, 2024
View release notes 1.0June 1, 2024Major Release
View release notes