The World Has Arms Control Regimes, But AI Companies Are Not Answering to Them

When Anthropic posted a job listing for a “Policy Manager, Chemical Weapons and High-Yield Explosives,” it was easy to read as a curiosity. A Silicon Valley AI company is hiring someone whose core responsibility is to prevent a language model from helping someone synthesize a nerve agent or build a dirty bomb. This is not a role that fits neatly into the usual taxonomy of tech jobs.

But the listing is not a curiosity. It is a symptom of something policymakers have been slow to name directly: the frontier AI industry is constructing its own internal arms control infrastructure, in the absence of any external requirement to do so, with no accountability to any institution beyond itself. Without external oversight, these arrangements will not survive the competitive pressures that the companies themselves have identified. And the companies building them have, in their own policy documents, essentially said as much.