{"id":"deepeval","name":"DeepEval","maker":"Confident AI","url":"https://deepeval.com","repo":"confident-ai/deepeval","package":"pypi:deepeval","summary":"A Python framework for evaluating LLM applications and agents with unit-test style checks and built-in metrics.","details":"Provides metrics for answer relevance, faithfulness, tool use and other qualities, and runs them in pytest or from the command line. Results can be sent to the maker's Confident AI platform, which needs an account. The framework is open source under Apache 2.0.","open_source":true,"hosted":true,"verified":"2026-11-15","category":"observability","category_name":"Observability and evaluation","page":"https://modelmoot.com/tools/deepeval","reviewed":"2026-11-15","checked":{"at":"2026-11-15T14:03:44.997Z","address_answers":true,"repository":{"at":"2026-11-15T20:20:00.691Z","archived":false,"licence":"Apache-2.0","language":"Python","last_change":"2026-11-12T23:21:12.000Z","latest_release":{"tag":"python-v4.2.4","published":"2026-09-22T16:36:00.000Z"}}},"note":"Descriptions are the site's own. Facts under \"checked\" were read automatically from the tool's address and public repository."}