{"id":"swe-bench-live","name":"SWE-bench-Live","maker":"Microsoft Research and collaborators","url":"https://swe-bench-live.github.io","repo":"SWE-bench-Live/SWE-bench-Live","summary":"A continuously updated issue-resolution benchmark built from recent GitHub issues across several repositories.","details":"Follows the SWE-bench task format but adds new issues over time to limit overlap with model training data, and provides automated environment setup for each repository. The site hosts a leaderboard and the repository holds the data and evaluation code under the MIT licence.","open_source":true,"hosted":false,"verified":"2026-11-15","category":"benchmarks","category_name":"Agent benchmarks","page":"https://modelmoot.com/tools/swe-bench-live","reviewed":"2026-11-15","checked":{"at":"2026-11-15T16:10:15.342Z","address_answers":true},"note":"Descriptions are the site's own. Facts under \"checked\" were read automatically from the tool's address and public repository."}