A curated subset of SWE-bench—real GitHub issues with validated test cases—used as a production-grade benchmark for AI coding agents.
SWE-bench Verified addresses quality issues in the original SWE-bench by hand-validating ~500 tasks. Scores on SWE-bench Verified are widely cited when comparing Claude Code, GitHub Copilot, and other coding agents.