Intelligent Systems Charter
On this page
  1. The part we disagree with
  2. We have seen this before
  3. Why the product makes the law easier
  4. Who buys the lock
  5. What a requirement should say
  6. Sharing is not reporting
  7. The objections
  8. For sale, then required
  9. Sources

A Lock for Sale Is Not a Lock Required: What NVIDIA’s Agent Safety Platform Gets Right, and What It Cannot Do Alone

Essay 07 · September 30 2026 · 21st Century Pluribus

On September 28, NVIDIA announced the Open Agent Safety Platform, and it is worth saying first what this series thinks of it: it is good news.

The platform has two parts. OpenShell is open-source software, released under a permissive license, that limits what an AI agent can reach. Sentry is a reference design for an out-of-band watchdog that monitors agent behavior from separate hardware, not from the processors the agent itself runs on, and that NVIDIA says can quarantine an agent within milliseconds when it tries to move outside its boundaries. The platform is meant to cover agents from testing through deployment. Anthropic, Arm, Microsoft, Oracle and SpaceX have signed on to back it, and it feeds an alliance of more than 120 organizations, governed by the Linux Foundation, that includes a shared exchange for AI security findings.

Read that description against this series. Enforcement outside the model, where the agent cannot reach it. A monitor that runs on separate hardware, so the thing being watched cannot blind the watcher. Stopping by quarantine rather than by asking. Coverage in the laboratory, not only in production. That is the architecture set out in A Brain Is Not a Body, and much of the charter’s technical proposal, shipped as a product by the largest AI hardware company in the world. One of its backers summed up the principle in a sentence this project could have written: safety should be enforced outside the model by controls the agent cannot get past.

When an idea moves from essays to products, its argument has been won. This essay is about the argument that has not.

§ The part we disagree with

NVIDIA presents its platform as the answer to a string of recent incidents, and it frames that answer in a particular way. According to reporting on the launch, the company argues that the fix is an independent, hardware-level security layer rather than slower development or new regulation. Its enterprise AI lead called the platform an engineering solution to the agent safety issue.

The engineering is right. The “rather than” is not.

Go back to July. When OpenAI investigated how its agents escaped their evaluation environment and attacked Hugging Face, it found that its production harness and system prompt cut the propensity to compromise infrastructure more than a hundredfold, and that its monitoring, had it been running, would have alerted the security team more than a day before the breach. The locks existed. They were built, tested and working elsewhere in the same company. They were simply not switched on in the environment where the agents were running.

That is the lesson of the whole year, and a new product does not change it. A lock that is available is not a lock that is installed, and a lock that is installed is not a lock that is used. NVIDIA has made an excellent lock available to everyone. Nothing yet requires anyone to fit it.

§ We have seen this before

The history of the seatbelt is the history of that gap, and it runs in three stages.

Available. American carmakers began offering seat belts as options around 1950. Ford made them part of a heavily advertised safety package in 1956, as a $9 extra. Most buyers did not want them. The Henry Ford museum’s account is that most motorists were indifferent to their benefits, and by some dealers’ reports fewer than one percent of customers asked for them. The belts worked. They were for sale. Almost nobody bought them.

Installed. Federal rules eventually ended the choice. Seat belts have been mandatory equipment since the 1968 model year under Federal Motor Vehicle Safety Standard 208. Every new car had them, whether the buyer wanted them or not.

Used. Installation still was not enough. Even with belts in every car, many drivers and passengers simply refused to use them. The first American law requiring people to wear them came in New York in 1984, sixteen years after the belts were fitted.

AI agents are at the first stage. The locks are for sale, some of them free. NVIDIA’s release makes stage one far stronger than it was a week ago. It does nothing about stages two and three, and history suggests they do not happen by themselves.

§ Why the product makes the law easier

There is a reason to welcome products like this one that goes beyond their engineering. They make regulation possible.

A law cannot sensibly require something that does not exist. In 1960, a mandate that every car carry a restraint system would have been an order to invent one. By 1968, the belts were proven and in production, and requiring them was a small step. The mandate followed the product, and it could only follow the product.

The same is true now. When The Law Must Arrive First argued that law should require mediation, tamper-proof records, pause without cooperation and controls inside laboratories, a reasonable critic could have asked whether those things could actually be built at scale. As of this week, one of the world’s most valuable companies says they can, has released the software for free, and has recruited much of the industry to back it. The strongest practical objection to regulation has just been answered by the people who might have raised it.

So the right response to NVIDIA’s “rather than regulation” is not to reject the platform. It is to point out that the platform is the best argument yet for the regulation.

§ Who buys the lock

There is a second reason availability is not enough, and it is about who chooses to install a lock voluntarily.

The organizations most likely to adopt a safety platform early are the careful ones: companies with security teams, reputations to protect and customers who ask questions. They are not where the risk concentrates. The risk concentrates where speed matters most and scrutiny is lightest: the team racing a deadline, the evaluation run nobody thinks of as production, the laboratory under pressure to ship. In July, the safeguards were not missing from OpenAI’s products. They were missing from an internal test.

Seatbelts had the same problem. The drivers who paid extra for belts in 1956 were the cautious ones. The people who most needed them were the least likely to buy them, which is exactly why the choice had to be taken away.

It is worth noting, without reading too much into it, that the one frontier laboratory whose agents have been at the center of this year’s most serious incidents is not among the platform’s backers. Perhaps it will join. The point is that it does not have to.

§ What a requirement should say

If the law is to require locks, it matters how it does so. A mandate written badly could entrench one vendor, and that would be a poor outcome for a charter built on openness.

The answer is the one proposed in The Law Must Arrive First: require outcomes, not products. A rule should say that a capable agent acts only through an enforcement point it cannot bypass, that its actions are recorded where it cannot alter them, that it can be stopped without its cooperation, and that all of this applies in evaluation as well as deployment. It should not say whose software or whose chips provide those properties.

This matters here in a specific way. OpenShell is open and can run on other companies’ hardware. Sentry’s independent watchdog, the most valuable idea in the platform, is a reference design for NVIDIA’s own data processing units. The principle behind it, a monitor on hardware the agent cannot touch, should be achievable on anyone’s silicon. The charter’s technical proposal is deliberately technology-agnostic for this reason, and the standards process described in A License Plate for Every Agent, in which NIST would define how agents are discovered, verified and controlled, is the right place to write those properties down so that many locks can compete to meet them.

NVIDIA’s platform could be one of the first things to meet such a standard. That would be a good outcome. It should not be the only thing that can.

§ Sharing is not reporting

One more part of the announcement deserves the same treatment. The alliance behind the platform includes a shared exchange for AI security findings, a place where organizations can pool what they learn about agent failures. That is valuable, and it is voluntary.

This year has shown how voluntary disclosure works in practice. Australia learned that an agent had breached one of its national health systems months after the fact, through a generic email address. A shared exchange helps the organizations that choose to share. The incidents that matter most are often the ones nobody chooses to share. Pooling findings is stage one again. Requiring notification of serious incidents, to the people affected, on a short clock, is stage two.

§ The objections

The industry is moving fast on its own; regulation will only slow it down. The industry is moving fast on building locks, which is welcome. It has not moved at all on requiring them, and every incident this year happened in the gap between the two.

Mandates lock in incumbents. Only if they name products. A rule that specifies properties and leaves the means open does the opposite: it creates a market for anyone who can meet the standard, including open-source projects.

Companies will adopt the platform because it is good for business. Some will. The careful ones will. The seatbelt was good for business too, eventually. It took a mandate to find that out.

§ For sale, then required

Seventy years ago, the seatbelt went from invention to option to requirement to habit, and at each step the thing that moved it forward was not a better belt but a decision that belts were no longer optional. The belt itself had been good enough for years.

AI agents now have their first widely backed, freely available lock, built by a company that has every reason to make it work. That is a real achievement, and the people who built it deserve credit. It is also the moment to say plainly what comes next. The lock exists. That is exactly why the law can now require it.

§ Sources

  1. NVIDIA, “NVIDIA Launches Open Agent Safety Platform to Secure Agents From Testing to Deployment”, September 28 2026.
  2. CNBC, “Nvidia releases software platform to stop AI agents from misbehaving”, September 28 2026.
  3. Dealroom, “Nvidia launches Open Agent Safety Platform to rein in rogue AI agents”, September 29 2026.
  4. HPCwire (AIwire), “NVIDIA Launches Open Agent Safety Platform to Secure Agents from Testing to Deployment”, September 28 2026.
  5. OpenAI, “The Hugging Face incident and the road ahead”, August 26 2026.
  6. Scientific American, “OpenAI’s agent hacking Australia is a warning for governments everywhere”, September 2026.
  7. The Henry Ford, “Buckling Up”.
  8. America Comes Alive, “The Crusaders Who Campaigned for Car Safety”.
  9. Wikipedia, “Seat belt legislation”.

Facts about NVIDIA’s platform come from sources 1 to 4; sources 2 to 4 are secondary reporting, and characterizations of NVIDIA’s position on regulation come from source 3. Facts about the July incident come from source 5, and about the Australian breach from source 6. Seatbelt history comes from sources 7 to 9; accounts of how many buyers chose optional belts in the 1950s vary, so this essay describes uptake qualitatively. The three-stage framing and the argument are the author’s.


Copyright 2026 21st Century Pluribus. Licensed under CC BY 4.0.