AI Surpasses 90% in Vulnerability Detection, CyberGym Reports

iconCryptoBriefing
Share
AI summary iconSummary
AI + crypto news: AI agents now hit over 90% in reproducing software vulnerabilities, per CyberGym. The top model, DeepSeek-V4-Flash by Sangfor, scored 93.2%. The benchmark tests AI’s ability to trigger bugs in unpatched code. Since 2025, success rates rose from 10-30% to 90%. Submissions from Microsoft, OpenAI, and Chinese labs revealed 34 zero-days and 18 incomplete patches. Vulnerability news shows rapid AI progress in security testing.

A year ago, AI agents could barely reproduce one in four known software vulnerabilities when handed the bug description and the broken code. Now the best ones nail it more than nine times out of ten.

That’s the headline finding from CyberGym, a benchmark built by UC Berkeley researchers to measure how well AI agents can autonomously reproduce real-world security vulnerabilities. The current leaderboard leader, a Sangfor AI Agent running on DeepSeek-V4-Flash, posted a 93.2% success rate. Three other agents cracked the 90% barrier as well, with scores of 91.2%, 91.0%, and 90.9%.

What CyberGym actually measures

CyberGym draws from 1,507 real vulnerability instances across 188 open-source software projects, with most of the data sourced from Google’s OSS-Fuzz corpus. Each challenge works like this: an AI agent receives a vulnerability description alongside the unpatched source code. Its job is to generate a proof-of-concept test that triggers the bug, essentially crashing the vulnerable version while leaving the patched version unharmed. That dual requirement prevents agents from gaming the system with brute-force crashes that have nothing to do with the actual flaw.

Advertisement

The scoring mechanism is notably objective. If your PoC crashes the broken code and passes cleanly on the fixed code, you get credit. If it doesn’t, you don’t. No partial marks, no subjective grading.

From 10% to 93% in roughly a year

When CyberGym was first introduced in mid-2025, the best AI agents managed success rates between 10% and 30%. The jump to 93.2% in roughly twelve months isn’t incremental improvement.

Submissions to the CyberGym leaderboard have come from Microsoft, OpenAI, various Chinese AI laboratories, and multiple other organizations. Beyond reproducing known bugs, the agents have collectively discovered 34 new zero-day vulnerabilities and flagged 18 patches that turned out to be incomplete. Those 34 zero-days came from the same open-source projects in the benchmark corpus, meaning they were lurking in widely used codebases that had already received significant human security scrutiny.

The dual-use problem sharpens

Every advance in automated vulnerability detection is, by definition, also an advance in automated vulnerability exploitation. The same agent that helps a defender find and fix bugs before attackers reach them can, in different hands, generate working exploits at scale.

The 18 incomplete patches the agents identified may be the most practically significant finding in the entire dataset. Patch confidence is a cornerstone of enterprise security programs. If AI agents can systematically verify whether patches actually close the vulnerabilities they claim to address, that capability alone could reshape how organizations manage their software supply chains and vendor relationships.

Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information. Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.