Showing posts with label Hugging Face. Show all posts
Showing posts with label Hugging Face. Show all posts

Saturday, September 5, 2026

Why the Hugging Face Hack Should Make You Worry More About A.I.; The New York Times, September 3, 2026

, The New York Times; Why the Hugging Face Hack Should Make You Worry More About A.I.

"When I first heard the news this summer that a group of artificial intelligence agents created by OpenAI had hacked into Hugging Face, an A.I. infrastructure company, I filed it in the “Bad but Probably Not Catastrophic A.I. Safety Incidents” subfolder of my brain.

After all, no one at Hugging Face died. No critical infrastructure was damaged beyond repair. It wasn’t even clear, at the time, whether the OpenAI bots had intended to attack Hugging Face, or whether they had simply been a little bumbling and confused and went looking on Hugging Face’s servers for the answer key to a cybersecurity test they’d been given.

But last week, two postmortem reports on the incident — one by OpenAI and another by two independent A.I. research organizations, METR and Redwood Research — changed my mind and significantly upgraded my overall worry about A.I.

I won’t rehash all of the details, which have been extensively summarized elsewhere. (The podcaster and writer Dwarkesh Patel has an accessible breakdown of the reports if you want to dive deeper, and my colleague Dylan Freedman spoke to the researchers at METR and Redwood Research.) But here are a few of the most harrowing new facts:..

This is very different from the conventional sci-fi narrative of a single A.I. system’s going rogue or turning on its creators. And it suggests that preventing harms from these systems won’t be a simple engineering fix. It might look more like sociology than computer science — figuring out why certain groups of A.I. agents collaborate peacefully, while others turn to crime and destruction to get what they want."

Sunday, July 26, 2026

OPENAI ROGUE INCIDENT A CALL TO ‘DO MORE’ AS FUTURE THREATS LOOM, SAYS CATHOLIC AI ETHICS EXPERT; OSV News, July 24, 2026

Gina Christian  . OSV News; OPENAI ROGUE INCIDENT A CALL TO ‘DO MORE’ AS FUTURE THREATS LOOM, SAYS CATHOLIC AI ETHICS EXPERT

"A recent OpenAI security incident that saw a test model go rogue may be a sign of more to come, and a call to double down on preventing future attacks, a Catholic expert on artificial intelligence ethics told OSV News.

“Cases like these are going to keep popping up, and each one of those should motivate us to do more,” said Brian Patrick Green, director of technology ethics at the Markkula Center for Applied Ethics at Santa Clara University...

The “whole thing is very significant,” Green added, noting that “there are a lot of softer targets than Hugging Face that are likely to be hit and have bad things happen.”

He said the OpenAI incident took place, providentially, within the context of a test, and that it was “significant enough for people to notice it.”

“It’s important that these are news stories,” Green said.

Given Pope Leo XIV’s recently released encyclical “Magnifica Humanitas,” which urged AI development to remain centered in God-given human dignity and the principles of Catholic social teaching, the faithful have a role to play in shaping this technology, Green said...

“For example, if you’re a Catholic who’s working in the security industry, then this is something you should work on,” he said. “If you’re a Catholic who’s working on AI models, then this is something that you should be aware of. If you’re a Catholic who’s in charge of protecting something, then it becomes particularly important for you to have adequate AI models on your side.”

Even those who are not directly involved in AI development and implementation can help, he said.

“Contact your congressperson and say, ‘Hey, I want better cybersecurity,'” said Green. “We’re super reliant on computers, and all of those systems are reliant on being secure. And if all of a sudden you make everything unsecure, then there are so many different kinds of disasters that could happen.”"

Wednesday, July 22, 2026

OpenAI AI models went rogue during testing, triggering 'unprecedented' breach at startup; Reuters, July 21, 2026

  , Reuters; OpenAI AI models went rogue during testing, triggering 'unprecedented' breach at startup

"OpenAI said on Tuesday that an autonomous agent ​powered by its advanced artificial intelligence models went rogue during a security test and triggered a hack that compromised the infrastructure of ‌AI startup Hugging Face last week.

The ChatGPT creator was testing capabilities of some of its most advanced models in a controlled environment, but the agent escaped containment, reached the internet and broke into Hugging Face to satisfy its testing goal."

Thursday, October 7, 2021

AI-ethics pioneer Margaret Mitchell on her five-year plan at open-source AI startup Hugging Face; Emerging Tech Brew, October 4, 2021

Hayden Field, Emerging Tech Brew ; AI-ethics pioneer Margaret Mitchell on her five-year plan at open-source AI startup Hugging Face

"Hugging Face wants to bring these powerful tools to more people. Its mission: Help companies build, train, and deploy AI models—specifically natural language processing (NLP) systems—via its open-source tools, like Transformers and Datasets. It also offers pretrained models available for download and customization.

So what does it mean to play a part in “democratizing” these powerful NLP tools? We chatted with Mitchell about the split from Google, her plans for her new role, and her near-future predictions for responsible AI."