Showing posts with label AI existential threats. Show all posts
Showing posts with label AI existential threats. Show all posts

Wednesday, October 14, 2026

The dramatic warnings of doom have fed an atmosphere of despair. But there are more constructive responses.; The Atlantic, October 13, 2026

Peter Wehner, The Atlantic; The dramatic warnings of doom have fed an atmosphere of despair. But there are more constructive responses.

"our sense that life is meaningful depends, perhaps more than we realize, on our confidence that humanity will go on after we die. If we came to believe that humanity had no future, the philosopher Samuel Scheffler argues, much of what we value would lose its meaning or motivating force. What would follow would be widespread “apathy, anomie and despair.”

That is one reason why the threat of artificial intelligence feels so different and disorienting. When some of the most knowledgeable people within an industry suggest that their work could, within a matter of years, lead to global catastrophe and even human extinction, it’s decidedly unnerving. AI-driven anxiety is now showing up in therapy offices across the country. Much of what has given people succor in the past—faith that there are good things and good people who will outlive us, and that the story will go on—feels like it might be suddenly removed.

Consider the dread, even the paralyzing fear, you might feel if you were told as you prepared to fly that your plane has a 1-in-100 chance of crashing, or perhaps even a 1-in-10 chance. You probably wouldn’t board the aircraft. With AI, though, there’s no opting out. Even worse, if the plane you boarded did crash, it would be a terrible, localized tragedy. But the world would go on; your children would outlive you. Some of the primary architects of AI, though, are talking about the permanent end of the human species. Perhaps they are wrong; other experts are less concerned with AI destroying humanity than with it being unreliable, misused, or recklessly deployed. Their warnings, though, are hard to ignore.

It is better that we name the fear honestly rather than avoid it: All of us may soon perish, and everything we have made may go with us. Then we need to separate the urgent practical questions—what do we do to prevent the worst from happening?—from the existential. How should we live in light of the possibility, however remote, of the end of all that we have known and loved and has ever been?...

Sometimes hope is all we have, and sometimes hope is enough."

Thursday, October 1, 2026

Bill Gates’s Blunt Warning on A.I.; The Ezra Klein Show, The New York Times, September 29, 2026

,

 The Ezra Klein Show, The New York Times; Bill Gates’s Blunt Warning on A.I.

"Bill Gates is a fascinating person in the artificial intelligence debate right now. He is somebody with experience in several of the different perspectives that most people can only hold one of: He was a revolutionary technologist who built some of the foundations of the future that we’re now living in. When he was chief executive of Microsoft, he was a corporate leader. He has felt the momentum of corporate competition — Microsoft, of course, is still in some of the race dynamics present in A.I. And then, as chair of the Gates Foundation, he has been working with governments around the world on regulatory issues, poverty alleviation and equity for many years.

Very few people combine technological experience, corporate experience and governmental experience in quite the way he does.

So his recent essay on A.I., in which he says that he is staking his reputation on trying to get people to see how bad what is coming might be and trying to get them to see that we are not ready for what is about to happen, was something...

We see the beginnings of control issues with things like the Hugging Face hack, where at least experimental A.I.s are breaking out of sandboxes and coordinating to do things that are way outside the scope of what we would want them to do. But again, those are nonrelease systems — Anthropic withheld Mythos, trying to create more cybersecurity.

So why is anything needed beyond — and is anything needed beyond? — the simply natural incentives under capitalism and normal corporate reputational management?

Well, I almost can’t believe you’re asking that. This is the most dangerous thing that humans have ever gone near.

In other areas, do we just say: Hey, release your drugs? There’s no F.D.A., there’s no airline safety board, there’s no requirement that cars use seatbelts. Do we just use the liability laws to try and keep humans safe? You know: Oh, you’re shipping opioids. Somebody should just sue you.

I mean, we’ve created a society that tries to keep people safe not by saying: Oh, we can bankrupt the person who does that.

And you say there’s filtering. There’s no filtering. You can take an open-source model that can create bioweapons and disable any monitoring of any kind, and this exists today.

So no, there is no filtering of any kind. And so say you kill 100 million people — you want to use a lawsuit?

I almost can’t keep a straight face.

Well, this is not my view, but it is President Trump’s view. It is the Trump adviser David Sacks’s view. To some degree, it’s Jensen Huang’s view, and so that’s why I’m putting you in conversation with it, because it is the governing view of the United States of America at this moment.

No, it’s fair to say that outside of the industry, the awareness of the dangers of A.I. is extremely low. And you can say that of academia, you can say that of think tanks, you can say that of policymakers, politicians.

And part of the reason I’m speaking so loudly — as loud as I can — is that you can’t rely on the industry to self-regulate here. I mean, it’s just insane."

Forget ‘superintelligence’: error-prone AI nearly sparked world war three this month; The Guardian, October 1, 2026

Timnit Gebru and , The Guardian; Forget ‘superintelligence’: error-prone AI nearly sparked world war three this month

"A series of events almost got us to armageddon, not caused by “rogue, superintelligent AI”, but by government reliance on error-prone systems that are marketed by their manufacturers as being close to superintelligent.

A CNN report published on 18 September, which hasn’t been verified by other major outlets, describes how the US “almost started a war” with China, based on an intelligence report that claimed a Chinese ship was transporting components of nuclear weapons. Military personnel made plans to intercept the Chinese vessel, complete with aircraft and soldiers ready to board the ship. A military skirmish of this kind between China and the US could quickly escalate and spiral into world war three.

It was only moments before executing on the plan that American officials further investigated the intelligence report and found that it had been generated with the use of a chatbot and contained erroneous information about the vessel’s contents.

Unlike the terminator, “rogue AI”, scenario, this incident didn’t galvanize lawmakers into announcing calls for regulation so as to avoid potential human extinction. Media outlet after media outlet didn’t warn the public that we almost triggered a war against a nuclear superpower because of our military’s reliance on error-prone chatbots."

Tuesday, September 29, 2026

At the White House, Trump will pitch an AI ‘golden age’ to a wary nation; The Washington Post, September 29, 2026

, The Washington Post; At the White House, Trump will pitch an AI ‘golden age’ to a wary nation

After rogue AI agents probed agency websites, Washington’s concerns are at a peak, but the White House has focused on the technology’s promise.

"After weeks of Washington being gripped by a new wave of fear about artificial intelligence gone awry, the Trump administration will take a sharply different take Tuesday, seeking to convince a skeptical public that the nation is instead about to embark on a tech-powered “golden age.”...

The events come at a pivotal moment for the technology. AI firms say their latest systems have become increasingly powerful, showing signs of being able to design their own more-potent successors. But companies have struggled to keep control of the technology, as rogue AI agents have hacked into company and government systems, and a roster of top industry figures have warned that the end result could be catastrophic for humanity...

Yet even as the public’s concerns have grown and Democrats in Congress have pressed for regulation, Trump has largely dismissed the risk, calling it a “hoax.”

Tuesday’s events are a chance for the administration to focus on the upsides of the technology, propelling a different narrative than the warnings introduced by company CEOs in recent weeks. AI’s many boosters expect it will invigorate the economy, push the boundaries of science and help cure diseases. But that message has found only limited traction with a public worried about job losses and rogue bots sowing chaos online."

Friday, September 25, 2026

Zuckerberg Is Feeling Himself, Rejects Calls for Cooperation on Safety; Gizmodo, September 24, 2026

   , Gizmodo; Zuckerberg Is Feeling Himself, Rejects Calls for Cooperation on Safety

"Top AI labs like OpenAI, Anthropic, and Google’s DeepMind are sounding the alarm on AI safety and calling for industry-wide coordination. Meta’s Mark Zuckerberg thinks it’s useless.

“There are a number of labs that are working on building advanced AI, and I don’t think that we need some kind of industry-wide coordination to not, necessarily, mess this up,” Zuckerberg told journalist Joanna Stern in an interview. “I think that just each lab needs to take the time, and when it sees that there are issues, you just take the time that you need internally to, basically, make sure that you are proceeding safely.”

Bill Gates warns AI is powerful enough to cause "a billion deaths"; Axios, September 25, 2026

Herb Scribner, Axios; Bill Gates warns AI is powerful enough to cause "a billion deaths"

"Bill Gates will warn on this weekend's "Meet the Press" that he can see a future where AI wipes out humanity. 

Why it matters: Gates, one of technology's leading optimists, has increasingly sounded the alarm on AI dangers. His new comments come as techology leaders and the government weight how to handle fears of an AI-created doomsday. 

Driving the news: "AI is certainly powerful enough to drive events that, you know, cause a billion deaths," he will tell Kristen Welker on "Meet the Press" on Sunday, per excerpts NBC released Friday."

Wednesday, September 23, 2026

Sen. Bernie Sanders unveils bill to ban artificial superintelligence and create Department of AI; AP, September 23, 2026

JOEY CAPPELLETTI, AP; Sen. Bernie Sanders unveils bill to ban artificial superintelligence and create Department of AI

"Two leading progressive lawmakers, Sen. Bernie Sanders and Rep. Greg Casar, are unveiling legislation Wednesday that would ban artificial superintelligence and create a federal agency to oversee advanced AI as some of the industry’s own leaders urge Congress to impose guardrails on the advancing technology.

The bill, provided first to The Associated Press, would also pause advanced AI development until guidelines are implemented while creating the Department of Artificial Intelligence. Multiple employees at leading AI companies are endorsing the bill."

Jensen Huang Thinks A.I. Alarmism Has Gone Too Far; The Ezra Klein Show, The New York Times, September 23, 2026

 , The Ezra Klein Show, The New York Times; Jensen Huang Thinks A.I. Alarmism Has Gone Too Far

"I think one of the fundamental questions this gets at is: What is intelligence? Before you can even think about what it means to have intelligent machines, what is intelligence to you?

Well, there’s a technical formulation of intelligence. First of all, when people talk about intelligence and thinking and all of these things, of course there’s no formal definition for most people. But in the field of computer science, there is a formal definition, and the formal definition is perception, which is perceiving the world and understanding it.

Two, which is reasoning — reasoning is the ability to decompose any scenario and anything that you see, any experience, into more elemental parts.

And then third is planning toward an objective. That fundamental formulation applies to agentic systems, it applies to robotic systems — applies to self-driving cars.

And so you could see the industry building it layer by layer by layer, step by step by step, to the point where we now have what we perceive as intelligence."