OpenAI dual-use models misprice cyber risk, argues Joshua Achiam

OpenAI's Joshua Achiam explores AGI risks in cybersecurity. Learn why regulators must treat AI vulnerability patching as a critical risk-management issue.

Edward Mullen ·

OpenAI dual-use models misprice cyber risk, argues Joshua Achiam

Conventional wisdom suggests advanced AI models are a boon for cybersecurity, offering sophisticated tools for defense and vulnerability patching. However, this perspective overlooks a critical flaw: the dual-use nature of these technologies. OpenAI's own insights reveal that such models, while appearing benign, introduce novel risks as adversaries can manipulate them, thus mispricing the true cyber-attack threat.

Achiam frames these models as powerful tools for vulnerability patching, yet notes they carry risks where adversaries could manipulate the same capabilities to outpace traditional defense measures. In practice, this means a tool designed to mend holes can also be used to probe, discover, and exploit them more quickly and broadly than ever before. The distinction between defense and offense is increasingly a function of governance, not just capability.

From a regulatory standpoint, the mispricing is a procurement problem: boards will set risk budgets based on a skewed reading of what these models can do, while regulators seek guardrails that don’t stifle innovation. In corporate terms, the issue is whether risk is treated as a hardware-like capex spike or a continuous opex-managed governance challenge. If policy and contracting lag behind capability, the same tool that patches a vulnerability today could empower an attacker tomorrow.

A skeptical take from the security community would argue that the benefits of rapid patching and automated defense outweigh the risks, provided governance keeps pace. That view treats dual-use as a manageable risk, contained by standards, audits, and limited deployment. The counterpoint, however, is that the speed and breadth of modern AI-assisted probing and exploitation can outstrip governance cycles, creating systemic exposure even when individual safeguards seem sound.

What this means for procurement and regulation over the next 12–18 months is a practical shift from counting FLOPs to counting risk exposures. Enterprises will ask for contract language that explicitly accounts for dual-use scenarios, including red-teaming results, escalation paths, and guarantees around patching versus exploitation pathways.

Regulators will increasingly expect governance artifacts—ranging from model-card-like disclosures to board-level risk reviews—in vendor assessments. In short, the risk sits at the intersection of policy and procurement, not in the lab alone.

The implied beneficiaries are those who can translate governance into credible risk transfer: large enterprises with mature risk committees, reputable auditors, and vendors that can articulate transparent controls. The exposed include organizations with thin risk governance, supply chains prone to vendor lock, and boards unaccustomed to cyber-risk as a procurement constraint.

The quiet middle ground is where risk management and cost discipline converge: contracts that price risk as a load across time, not a one-off spike.

Watch for three kinds of signals in the coming months. First, any independent audit or regulator-aligned reporting that details concrete mitigation mechanisms beyond generalized warnings would tilt the balance toward responsible deployment.

Second, sourcing teams will start demanding dual-use risk metrics in procurement briefings, explicitly separating defense from offense capabilities and tying them to measurable safeguards. Third, major cyber incidents or near-misses that are plausibly linked to AI-enabled tooling would force a recalibration of risk budgets and vendor SLAs.

Taken together, these signals would indicate governance is gaining the bandwidth to keep pace with capability growth, or not.

This is a cross-industry

risk, not a single-silo problem. It implicates boards, procurement teams, regulators, and cybersecurity officers across healthcare, manufacturing, finance, and tech alike.

If the mispricing persists, the cost is not just a few patches but a structural shift in how risk is priced into every AI-enabled project. The counterbalance will be a governance-rich approach: explicit acknowledgement of dual-use realities in contracts, clear escalation protocols, and a willingness to treat cybersecurity risk as a product feature replete with guardrails.

Finally, the question for executives isn’t whether AGI has arrived, but how quickly governance can harden to the reality that dual-use tools are not inherently defensive by default. The next six to twelve months will reveal whether boards adopt these tools with robust, auditable risk controls or continue treating cyber risk as a peripheral concern.

The trajectory will depend on whether procurement teams demand contract language that encodes risk-adjusted economics and whether regulators insist on verifiable governance artifacts before scale.

More stories