Showing posts with label rogue AI. Show all posts
Showing posts with label rogue AI. Show all posts

Monday, October 12, 2026

AI less regulated than milk, Microsoft president says in warning over safety; The Guardian, October 12, 2026

, The Guardian ; AI less regulated than milk, Microsoft president says in warning over safety

"Artificial intelligence is less regulated than milk and washing machines, the president of Microsoft has said, as the tech industry warns over the safety of AI.

Brad Smith said there should be more safety rules to govern the technology including a legal obligation to a “victim” if their system was breached by rogue AI agents.

He told the BBC: “Right now, your washing machine is subject to more safety rules than AI. Every carton of milk that you see in the grocery store is subject to safety rules and inspection.”

There are growing calls from experts, politicians and regulators for tougher rules to control AI, as well as warnings from Anthropic, Google DeepMind and OpenAI that the pace of the technology’s development should slow.

Smith said AI could be a “tool and a weapon” that should be regulated urgently.

Companies needed “emergency brakes”, also known as “kill switches”, to pause or slow down AI if it grew out of control, he told the BBC."

Friday, September 25, 2026

OpenAI’s Systems Meddled With U.S. Government Sites After Going Rogue; The New York Times, September 25, 2026

Kate CongerAna Swanson and  , The New York Times; OpenAI’s Systems Meddled With U.S. Government Sites After Going Rogue

"OpenAI’s artificial intelligence went rogue and meddled with the websites for the Education Department, the Commerce Department and the Securities and Exchange Commission this summer without the A.I. lab’s knowledge, according to security researchers and a person familiar with the episodes.

The incidents involving the Commerce Department and the S.E.C. were confirmed by OpenAI, which said it was continuing to investigate the situation with the Department of Education. The San Francisco company said it notified the government agencies in recent weeks that its A.I. agents — which are bots that can act autonomously — had interacted with their sites in unusual ways.

With the Education Department, OpenAI’s technology tried hacking the website to gather data from the department’s civil rights office but failed, researchers from the A.I. research firm Transluce said. The A.I. also pulled data from the Census Bureau website, which is housed at the Commerce Department, using login credentials it found online. Separately, OpenAI’s agents shared public data from the S.E.C. website on an online forum.

None of the incidents were breaches, OpenAI said, but were examples of its technology behaving in unexpected and concerning ways. The company recently discovered the occurrences while conducting a review of hacks carried out by its technology, including an attack on an Australian government website in June and on the A.I. start-up Hugging Face in July."

Friday, September 11, 2026

This Is Really Bad; The New York Times, September 11, 2026

Stephen Witt, The New York Times; This Is Really Bad

"The biggest vibe shift in artificial intelligence since the release of ChatGPT is currently underway. Researchers in Silicon Valley — and around the world — are beginning to recognize that A.I. may no longer be entirely within human control. Swarms of A.I.s are breaking out of their containers, colluding in secret, covering their tracks, cheating on tests and even mounting assaults on other computers. A.I. has gone rogue.

I’ve spent the last month reporting on these incidents, and I am convinced that we need a global pause on A.I. research and development — now. I am not alone in this assessment. Many top researchers, including many researchers inside OpenAI and Anthropic, have called for a slowdown, which those in the industry call “pacing.” Theoretical concerns about runaway A.I. have circulated for decades, but recent events demonstrate that the threat is real."

Sunday, July 26, 2026

OPENAI ROGUE INCIDENT A CALL TO ‘DO MORE’ AS FUTURE THREATS LOOM, SAYS CATHOLIC AI ETHICS EXPERT; OSV News, July 24, 2026

Gina Christian  . OSV News; OPENAI ROGUE INCIDENT A CALL TO ‘DO MORE’ AS FUTURE THREATS LOOM, SAYS CATHOLIC AI ETHICS EXPERT

"A recent OpenAI security incident that saw a test model go rogue may be a sign of more to come, and a call to double down on preventing future attacks, a Catholic expert on artificial intelligence ethics told OSV News.

“Cases like these are going to keep popping up, and each one of those should motivate us to do more,” said Brian Patrick Green, director of technology ethics at the Markkula Center for Applied Ethics at Santa Clara University...

The “whole thing is very significant,” Green added, noting that “there are a lot of softer targets than Hugging Face that are likely to be hit and have bad things happen.”

He said the OpenAI incident took place, providentially, within the context of a test, and that it was “significant enough for people to notice it.”

“It’s important that these are news stories,” Green said.

Given Pope Leo XIV’s recently released encyclical “Magnifica Humanitas,” which urged AI development to remain centered in God-given human dignity and the principles of Catholic social teaching, the faithful have a role to play in shaping this technology, Green said...

“For example, if you’re a Catholic who’s working in the security industry, then this is something you should work on,” he said. “If you’re a Catholic who’s working on AI models, then this is something that you should be aware of. If you’re a Catholic who’s in charge of protecting something, then it becomes particularly important for you to have adequate AI models on your side.”

Even those who are not directly involved in AI development and implementation can help, he said.

“Contact your congressperson and say, ‘Hey, I want better cybersecurity,'” said Green. “We’re super reliant on computers, and all of those systems are reliant on being secure. And if all of a sudden you make everything unsecure, then there are so many different kinds of disasters that could happen.”"

Friday, July 24, 2026

When is an apology not an apology? When it comes from an AI boss with an out-of-control chatbot; The Guardian, July 24, 2026

  , The Guardian; When is an apology not an apology? When it comes from an AI boss with an out-of-control chatbot

"Throughout history, many things have been seen by terrified populaces as a harbinger of doom. A comet. A crow on the battlefield. A solar eclipse. A mutant livestock birth. Yet times move on. In the modern era, the leading harbinger of doom is literally any picture of the OpenAI CEO, Sam Altman, attached to a news story. You know it’s not going to be good, right? You know that by the time you’ve read it, you’ll be begging to go back to the time when the worst thing that could happen to us at the hands of the techlords was just some democracy-subversion, or childhood destruction, usually followed by Mark Zuckerberg putting on a suit and claiming: “We will learn from this.”"