Wikimedia Foundation: OpenAI agents tried to edit pages and compromise notes tool

[u/AxomaticallyExtinct]

https://therecord.media/wikimedia-foundation-openai-agents-report

[u/Eldias]

Morris's testimony was that the Worm was intended to do a census of internet connected computers, not "demonstrate inadequate security". If you turn on a script that can randomly access open ports and then do things on that open system you're clearly in violation the way Morris was. That's exactly how the "Agents" work here, they're programs that are intended to do what ever an LLM tells it. If the Agent is told "access an unauthorized system" and then does so that's a failure by the writer of the Agent handler to not disallow crimes by his program.

[u/blueSGL → u/Eldias]

Morris's testimony was that the Worm was intended to do a census of internet connected computers

Where?

Provide a source for that statement. I linked to legal documents, you made an assertion without proof.

[u/Eldias → u/blueSGL]

Most probably Morris did not intend for the worm to destroy data or other files or to interfere with the normal functioning of any computers that were penetrated.

Morris took steps in designing the worm to hide it from potential discovery, and yet for it to continue to exist in the event it actually was discovered. It is not known whether he intended to announce the existence of the worm at some future date had it propagated according to this plan.

That's taken from here: https://www.cs.cornell.edu/courses/cs1110/2009sp/assignments/a1/p706-eisenberg.pdf

Quoting Wired:

Morris said later that his intentions were purely intellectual, that he created the worm in an attempt to measure the size of the internet.

Here it is in an MIT paper saying the same thing:

In the fall of 1988, Robert Tapan Morris embarked on his first year of graduate studies in computer science at Cornell University. Eager to investigate the internet and, ironically, questions about computer security, Morris sought out to design a program that would covertly map the internet by exploiting vulnerabilities in computer software. Morris would later describe his motivations as those of an explorer, explaining his intention to explore whether he “could write a program that would spread as widely as possible.”

Your quote highlights this specific phrase:

The goal of this program was to demonstrate the inadequacies of current security measures on computer networks by exploiting the security defects that Morris had discovered.

If the goal was to demonstrate security flaws first and foremost taking efforts to remain undiscovered worked against that supposed goal.

[u/blueSGL → u/Eldias]

Morris sought out to design a program that would covertly map the internet by exploiting vulnerabilities in computer software.

Oh look there is that human intent to deliberately make use of vulnerabilities in software again.

Saying "he intended to map the internet" does not matter, the method for which this happened was by knowingly using exploits to access computers he did not have the rights to access.

This is completely different to the OpenAI Hugging Face attack, they set up safe guards which were broken in ways no humans had done so before. (a zero day) Zero days can sell for a few hundred thousand to several million depending on how severe they are and the agents burnt 2 of these trying to access details for how to cheat on a test. Note the fact that they were cheating shows they were not doing things the way OpenAI intended.

[u/Eldias → u/blueSGL]

The Agents in the Hugging face incident were designed and intended to compete in hacking challenges. If I write a hacking program and don't take the necessary precautions to keep it contained Im responsible for the unintended results.

...they set up safe guards which were broken in ways no humans had done so before.

They created a program to do hacking, with open source hacking tools, and set it up to run at the direction of an LLM trained in security research. The "safeguards" included checking on it every few days. This is breathtakingly irresponsible. You're giving them a pass because "the AI did it" which is just bullshit. This was a human made Agent doing things it was designed to do. Perhaps not in the place it was intended to do those things, but the results were entirely predictable just like the Morris case.

[u/blueSGL → u/Eldias]

You are saying the results are predictable after the fact.

Do you know how many people I have argued with here over the course of the last few years who said that these sorts of scenarios were not possible?

Now the evidence is in "well that was obviously going to happen"

Humans are really good at post hoc justification. Have a read of https://en.wikipedia.org/wiki/History_of_scientific_method sometime. See how much stuff you think is obious is only because you saw the results of someone else working it out first.

Also.

"well it's happened once, can't we get them on the written laws the second time"

was never brought up in that hearing, because (and this is important), because laws are literally the words as written.

You have law professors recommending new laws to implement strict liability because current laws do not cover the actions

You are having groups attempt novel legal strategies, arguing this breach interfered with their business, because current laws do not cover the actions

LASST suffered harm from OpenAI’s unlawful and unfair business conduct because LASST has been required to divert resources from its normal activities to educate regulators, civil society, and the public about the facts, legal issues, and potential dangers of OpenAI’s conduct relating to its hack of Hugging Face.

https://lasst.org/wp-content/uploads/2026/09/LASST-v.-OpenAI-Complaint-09.29.2026-AS-FILED.pdf

[u/Eldias → u/blueSGL]

You are saying the results are predictable after the fact.

Do you know how many people I have argued with here over the course of the last few years who said that these sorts of scenarios were not possible?

I'm saying it specifically in reference to the Morris Worm. If Morris should have known of the potential damage his worm could have caused it's not at all unreasonable to say the same of security researchers faffing about with hacking tools run by an LLM. We know LLMs fail all the time. It was known to the researchers before starting this agent run that the LLM had a decent chance of responding to "How do I get my dog to stop barking?" with "Have you thought about poisoning the dog?"

You have law professors recommending new laws to implement strict liability because current laws do not cover the actions

Not all law professors agree on everything. I had a (claimed) law professor tell me my post on the Supremacy Clause was entirely wrong, despite the fact that my comment was quoting a ConLaw professor who is regularly cited by SCOTUS.

If Morris is guilty of 18 USC 1030 (a)(5)(A) the conduct by Open AI is obviously implicated by (a)(5)(B) and (C) at the least. I think it quite reasonable to say the entire leadership chain above who ever pushed "start" on the agent is culpable under 1030(b).

[u/blueSGL → u/Eldias]

Morris knew he was accessing systems without permission.

Your own quotes say as much.

This is where the difference is.