Microsoft's Nadella calls for AI 'emergency brake' under human control

Summarised from 3 outlets · Updated 10 Oct, 22:25 · Archive

Microsoft's chief executive has called for advanced AI systems to include an 'emergency brake' that authorised people can use to pause or shut them down.

Microsoft Chairman and CEO Satya Nadella has called for advanced artificial intelligence systems to include containment, independent controls and an 'emergency brake' that authorised people can use to pause or shut a model down mid-task. He wrote on social media that 'non-deterministic models' should be surrounded by 'strong, deterministic system design, human controls, and reliable operating procedures'.

Nadella's call for stronger safeguards aligns with warnings from other tech executives and researchers, including Microsoft co-founder Bill Gates, OpenAI CEO Sam Altman, Anthropic CEO Dario Amodei and SpaceX CEO Elon Musk, about insufficient AI safety protocols and claims that the technology is moving too fast. An alignment lead at Anthropic recently suggested there is a greater than 10 per cent chance that the technology could 'kill all humans' within the next decade.

President Donald Trump has dismissed AI extinction risks and instead emphasised that the industry needs to stay ahead of China. Trump recently introduced a new 'AI Force' led by Director of National Intelligence Jay Clayton to help facilitate the industry.

How it is being reported

• Satya Nadella says we should assume all AI models are ‘compromised’In a lengthy post on X, Microsoft's CEO laid out his views on the dangers posed by highly advanced AI models and how to confront those risks. Nadella says we can no longer accept a world where AI is treated as a "set of nested black boxes" whose advice and actions we simply accept or […]The Verge · 10 Oct, 23:10
• Microsoft’s Satya Nadella says AI models need an ‘emergency brake’In a Saturday morning post, Microsoft's CEO wrote that it’s time “to step back and assess the trust architecture” of AI.TechCrunch · 10 Oct, 22:47
• Microsoft's Nadella says AI needs an ‘emergency brake’ that humans controlNadella joined other tech moguls and researchers in calling for stronger safeguards and, in some cases, for the pacing of frontier development.CNBC · 10 Oct, 21:59

In this story: Microsoft · Satya Nadella · Bill Gates · Sam Altman · Elon Musk · Donald Trump · OpenAI · Anthropic

This summary was written by AI from the headlines and standfirsts above, and states as fact only what at least two outlets report. How we use AI · Report a problem