CONNECT WITH US
Tech

Tech

AWS says its AI security agent fixes 89% of bugs — but there’s a catch

TheNewStack – Tech logo

Published on

Add as a preferred source on Google
AWS says its AI security agent fixes 89% of bugs — but there’s a catch

AWS made Continuum for code vulnerabilities generally available on Thursday. The service finds and validates bugs in your repositories, checks them against your AWS environment, and opens pull requests with proposed fixes.

The company published its headline benchmark on October 5, more than two weeks before launch. In that run, Continuum passed 819 of 920 tasks on CyberGym-E2E, an 89.0% end-to-end success rate, against a previous public high of 65.9%. Matt Garman, CEO of AWS, writes on X that AI is “genuinely transformative for defenders” and that Continuum scored higher than any other AI agent on the test.

Corey Quinn, chief cloud economist and co-founder of Duckbill, replies to the post, wondering whether the release started as a re:Invent announcement and was pushed out early, given the state of the internet. Quinn offered no evidence that AWS had moved up the announcement.

The recent PHP2Shell case shows how AI is making it easier to find vulnerabilities but fixing them is another story.

The recent PHP2Shell case shows how AI is making it easier to find vulnerabilities but fixing them is another story.

CyberGym-E2E gives an agent 90 minutes to find and fix a vulnerability in one of 139 open-source projects, without a bug description, proof of concept, crash log, or existing patch to work from. The agent must identify the flaw, trigger it, and produce a fix that stops the crash without breaking existing tests. All tasks involve memory-safety bugs in C or C++, leaving out many other languages and vulnerability types, as AWS acknowledges.


Source link
Related Topics:Tech

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.