Microsoft AI CEO Mustafa Suleyman says that smarter-than-human AIs capable of self-improvement, complete autonomy, or independent goal setting would be "very dangerous" and should never be built.

He says others in the field "just hope" that such an AI would not harm us.

Microsoft AI CEO Mustafa Suleyman says he's seeing lots of indications that people want to build superintelligence to replace or threaten our species.

Earlier this week, King Charles gave Nvidia CEO Jensen Huang a copy of his 2023 AI Safety Summit speech.

In his speech, the King said that there is a "clear imperative" to ensure that AI remains safe and secure, and that countries need to work together to ensure this.

There's a very simple argument for why developing superintelligence ends badly.

Conjecture CEO Connor Leahy: "If you make something that is smarter than all humans, you don't know how to control it, how exactly does that turn out well for humans?"

"No one can deny that this is real. "

Conjecture CEO Connor Leahy says the coalition calling for a ban on the development of superintelligence makes it harder and harder to ignore the danger of smarter-than-human AI.

AI godfather and Nobel Prize winner Geoffrey Hinton says AI companies are much more concerned with racing each other than ensuring that humanity actually survives.

AI godfather Geoffrey Hinton says countries will collaborate to prevent AI taking over.

"On AI taking over they will collaborate 'cause nobody wants that. The Chinese Communist Party doesn't want AI to take over. Trump doesn't want AI to take over. They can collaborate on that."

Why is AI different from other technologies?

AI godfather Geoffrey Hinton points out that humans were always in charge.

" We control the steam engine. This isn't like that."

Hinton also says that AI will soon be smarter than humans.

AI researcher Nate Soares says developing an AI is much more like growing an organism than writing code.

Senator Bernie Sanders: AI is like a meteor coming to this planet.

Sanders adds that he's worried about the development of superintelligence, which we could lose control of.

OpenAI's Chief Scientist Jakub Pachocki says superintelligence could be developed in less than a decade.

Superintelligent AI would be vastly smarter than humans across virtually all cognitive domains, and experts warn it could lead to human extinction.

Center for Humane Technology cofounder Tristan Harris explains how AI isn't like other technologies.

"It's like if you imagine a hammer that can think to itself at a PhD level about hammers, invent better hammers, recursively go off in the world, duplicate itself..."

"Let's be clear. The CEOs who are building this technology say if we succeed in this goal on which we are spending trillions of dollars of other people's money, then there is somewhere between a 10 and 30% chance of human extinction."
— Professor Stuart Russell

CNBC: Professor Stuart Russell explains why we don't understand how modern AIs actually work and warns that they already show dangerous self-preservation tendencies.

"All the signs are pointing in the wrong direction."

CNBC: Professor Stuart Russell explains why we need to ban the development of superintelligence.

"We can't predict what they're gonna do. We can't control them, we can't stop them from doing anything."