Discover your interests, together

Real deals, honest reviews and shopping stories from people who share your interests — every day on Milik.

Discover your interests, togetherReal deals, honest reviews and shopping stories from people who share your interests — every day on Milik.

Why AI Can’t Reliably Fix Security Vulnerabilities—Even When It Finds Them

Why AI Can’t Reliably Fix Security Vulnerabilities—Even When It Finds Them
Interest|AI Application Exploration

Detection Is Impressive; Remediation Is Failing

AI vulnerability patching is the use of large language models and autonomous agents to detect security flaws and generate code changes that claim to fix those vulnerabilities, often passing tests and resembling human-written patches while still frequently leaving exploitable paths open or introducing new bugs. The uncomfortable takeaway from recent research is clear: AI is good at spotting trouble, bad at reliably cleaning it up. In a large-scale study of six freshly disclosed CVEs and 6,080 AI-generated patches, only about one in four fixes left the software both secure and behaving as intended. At the same time, multi-agent tools aimed at telecom software have uncovered 84 previously unknown flaws in 4G and 5G network code, yet dozens of those issues remain unresolved despite being confirmed and assigned CVE identifiers. The gap between detection and remediation is not a minor tuning problem; it is a structural weakness in autonomous security fixes.

Why AI Can’t Reliably Fix Security Vulnerabilities—Even When It Finds Them

Three Out of Four AI Patches Break Something You Can’t See

The 6,080-patch experiment exposes how CVE remediation failures pile up when AI agents are trusted to fix code on their own. Ask a frontier model to patch a vulnerability and it will produce something that looks like a maintainer-quality change and often passes the reproducer test, yet “roughly one time in four, it is a fix.” About half of the surviving patches left at least one exploitable path open, and closer to one in twenty introduced a new vulnerability on top of failing to close the original hole. In a focused campaign on the freenginx use-after-free bug, an automated agent had ChatGPT 5.5 write 270 fix attempts; reviewers found that 114 blocked the original crash, but every single one added a fresh problem, so none came out clean. These AI security limitations are mostly invisible: nothing in the patch announces that the bug remains or that new attack surfaces exist, and the cost to spot those hidden failures is comparable to writing a known-good fix manually.

Why Autonomous Agents Miss the Real Bug

The deeper problem is that autonomous security fixes focus on the example exploit, not the underlying class of bug. When handed a single reproducer, the models tend to patch that exact code path instead of addressing the broader design flaw. More than a third of patches graded as successful were flagged as fragile because they relied on narrow checks that block the demonstrated exploit while leaving the vulnerable logic in place, ready to be reached by a different input. In the Chromium case CVE-2026-8512, for instance, AI-generated fixes could arrange one necessary lifetime claim but consistently skipped the second, merely moving the flaw instead of removing it. Automated harnesses that loop until tests stop failing amplify this bias: if the test never triggers the tricky corner case, the agent happily settles on an incomplete patch that passes all checks. When fix guidance is wrong, things get worse—prompts with plausible but incorrect directions yielded working patches only about one time in six, even under loose criteria.

5G Networks Show the Detection–Remediation Gap

Telecom software is where AI’s detection strengths are undeniable and its remediation weaknesses become dangerous for ordinary users. Researchers turned a chain of three AI agents, called iFinder, loose on 4G and 5G core implementations and the system reported 84 previously unknown flaws. Developers have confirmed 83 of them and 81 now carry CVE identifiers, yet only 58 have patches; three of the seven affected projects have not shipped any fixes, leaving 23 confirmed vulnerabilities with no code changes behind them. The worst of these allows an attacker to hijack a subscriber’s data session so that the network quietly delivers the victim’s traffic to the attacker instead of the internet. This is not a remote lab curiosity: operators are moving cores into cloud environments, where misconfigurations can expose internal interfaces to the open internet, and the researchers showed that even an ordinary phone with a valid SIM could smuggle control messages inside its data tunnel against several open-source cores. The pipeline is useful rather than magic—it caught 15 of 22 known bugs and roughly a quarter of its reports are wrong—so human triage and patching still decide what gets secured and when.

Security Workflows Must Treat AI as a Junior Partner, Not an Autopilot

Together, these results spell out why AI vulnerability patching cannot be left unsupervised. While autonomous agents can find subtle memory errors and protocol flaws far faster than manual review, their CVE remediation failures show that they do not yet understand software behavior or threat models in a way that produces trustworthy fixes at scale. According to one research group, “LLM-produced patches still require review from a skilled engineer with domain expertise,” and that review costs roughly as much as writing the patch yourself because you must reason through every security implication. In the telecom case, maintainers’ uneven responses mean practical risk persists even after AI-driven discovery: dozens of confirmed 5G core vulnerabilities still have no fix, including a critical session hijack that can be reproduced under default settings. The path forward is not to abandon AI, but to demote it: treat models and agents as tireless junior analysts that surface issues and propose draft patches, then require human validation before any autonomous security fixes move to production.

Milik earns a commission when you shop through our links, at no extra cost to you. This article was generated with AI from published sources and product data.

You May Also Like

Comments
Say something...
No comments yet. Be the first to share your thoughts!