Microsoft’s AI Chief, Mustafa Suleyman, says “it’s crazy to actually declare” that superintelligence will replace our species

by

OpenAI’s recent agreement with Microsoft could position Microsoft as a leader in the field of generative AI, potentially allowing them to develop advanced AI, known as artificial general intelligence, on their own or with other companies. Interestingly, Microsoft’s head of AI, Mustafa Suleyman, has recently expressed concerns about the rapid pace of AI development, its safety, and what it could mean for the future of humanity.

Artificial intelligence has become incredibly useful, fueling progress in fields like education, technology, healthcare, and entertainment. However, it also presents some serious issues, including concerns about privacy, security, and even potential long-term risks.

AI safety researcher Roman Yampolskiy, who leads the Cyber Security Laboratory at the University of Louisville, has warned that AI could very likely cause humanity to go extinct – he estimates the probability at 99.999999%, a concept he calls ‘p(doom)’. He believes the only way to truly prevent this is to stop developing AI completely. However, with massive investments already made in AI infrastructure, like huge data centers, it might be too late to do so.

Earlier this year, Microsoft’s AI chief, Mustafa Suleyman, also warned about the potential risks of highly advanced AI – AI that might even become ‘conscious’ – suggesting we’re not prepared for such technology. These concerns echo those of Google DeepMind’s CEO, Demis Hassabis, who appears worried about how quickly AI is developing.

More recently, Suleyman indicated that superintelligence AIs aren’t going to replace humanity.

I’ve previously described advanced AI as something akin to a new form of life, appearing conscious but not necessarily *being* conscious. We’re all struggling to find the right language to understand this technology, which is unlike anything we’ve encountered before. I believe the increasing focus on humanism – prioritizing human value – is a good starting point for a wider conversation. It should be fundamentally understood that the goal of developing superintelligence isn’t to replace or endanger humanity – that should be obvious. It’s concerning that this even needs to be stated, but I’m seeing evidence that not everyone shares that view.

Microsoft AI CEO, Mustafa Suleyman

Microsoft’s Suleyman says superintelligent AIs should not replace our species – “and it’s crazy to have to actually declare that” – but many in AI don’t agree. from r/OpenAI

This announcement follows Suleyman’s statement that Microsoft is significantly increasing its investment in artificial intelligence. They’ve created a new team, MAI Superintelligence, focused on achieving leading-edge AI capabilities. The executive explained:

Microsoft aims to independently develop its AI capabilities. This means building and training advanced AI models, using its own data and computing resources, to achieve the highest possible performance.

Unlike other AI research labs, Microsoft is focusing on creating a superintelligent AI that prioritizes human well-being, aiming to harness the benefits of scientific advancement while avoiding potential dangers. Suleyman believes this AI should assist people, not simply take their place.

FAQ

Is Microsoft free to pursue AGI independently from OpenAI?

As an analyst, I’m watching closely as Microsoft now has the freedom to develop superintelligence and Artificial General Intelligence (AGI) on its own terms. With a new agreement in place, they’re no longer tied to their large partnership with OpenAI and can move forward independently or with other companies as they see fit.

What does Microsoft hope to achieve with AGI?

Microsoft’s AI chief, Mustafa Suleyman, says the company aims to harness the power of advanced AI to achieve major scientific discoveries and improvements that benefit people, rather than taking their place.

Read More

2025-11-12 17:10