We evaluate DeepCode on the PaperBench benchmark (released by OpenAI), a rigorous testbed requiring AI agents to independently reproduce 20 ICML 2024 papers from scratch. The benchmark comprises 8,316 ...
Developers are navigating confusing gaps between expectation and reality. So are the rest of us. Depending who you ask, AI-powered coding is either giving software developers an unprecedented ...
Southeast Missouri State University’s HackLabs teams brought home three podium finishes from the AI Vibe-Coding Hackathon in November, earning two second-place awards and one third-place award against ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback