Sam Altman warns AI could go "very badly" as race accelerates

386     0
Sam Altman warns AI could go "very badly" as race accelerates
Sam Altman warns AI could go "very badly" as race accelerates

ChatGPT boss Sam Altman has warned that the future of AI could go ‘very badly’ if the technology’s rapid progress continues to be developed.

The OpenAI CEO shared his concerns in a series of posts on X, saying there were two outcomes the industry ‘must avoid’.

Writing on social media, Altman said: ‘First, we could lose control of the future of AI. That is unacceptable. We are unapologetically on Team Humanity and AI must always serve people.’

The 41-year-old continued by saying that ‘alignment and safety techniques’ must stay ahead of progress in model capabilities.

‘Second, we could end up in a world with too much concentration of power,’ he added.

‘If an extraordinarily powerful AI is used by one person or company to impress their worldview onto everyone else, the results could be extremely dystopian.’

13/09/2026 - LONDON - An artificial intelligence researcher who quit AI firm Anthropic has said people working on the technology were "genuinely frightened" about the speed of its advancements and what it could mean for humanity. "I believe that if we don’t slow down at the current rate of progress, there is a strong chance that we could all die in the immediate future," he said. Jacob Coxon was speaking to the BBC after his resignation post on the dangers of AI went viral on a backdrop of growing safety concerns about the industry. The 27-year-old’s former boss, Anthropic head Dario Amodei, recently called for AI development to slow down - though some have questioned the motivations behind this. The bosses of two rival AI firms, Sam Altman of OpenAI and Elon Musk of xAI, have both said they agree with Amodei’s proposal for industry-wide deceleration and regulation, as well as independent monitoring of AI model development. Amodei wrote in an essay on Saturday that developing the technology was not in question, but the risks associated with it were "serious", and that companies and governments must be given time to address them. Coxon ??? who worked at OpenAI before joining Anthropic ??? welcomed the suggestion of a slowdown but said it would need to be co-ordinated with China to avoid "a race at an international scale". "The people who work at these companies are completely serious when they ask for regulation because they find themselves trapped in a race. And they’re scared of the outcomes of that race," he told Sunday with Laura Kuenssberg. PICTURE: UNPIXS 13/09/2026 qhxidiqxkiqdhinv

Altman said that avoiding these two threats requires ‘walking a narrow middle path; for example, one country could gain too much power. Another example is one lab ending up with too much power’.

This comes after researcher Jacob Coxon resigned from Anthropic and publicly warned that artificial intelligence companies like OpenAI were ‘racing straight to self-improving superintelligence’.

Coxon claimed AI companies were ‘gambling with our lives’ and urged the public not to underestimate the technology.

He argued that future AI systems could become capable of hacking systems, transforming industries and acquiring significant power and resources.

Coxon also claimed that people building AI ‘earnestly believe that it could kill us all by the end of the decade’ – although that remains his characterisation of the industry’s private concerns, rather than an established prediction.

Open AI CEO Sam Altman speaks during the G20 Innovation Ministerial in Chapel Hill, North Carolina, on September 2, 2026. (Photo by Matt RAMEY / AFP via Getty Images) 16112963

In the wake of his comments, Anthropic’s chief executive Dario Amodei urged ‘frontier’ artificial intelligence companies to slow down.

Responding to his essay, Elon Musk said that ‘Dario is right’, while Altman said: ‘I agree with Dario that we need to pace the frontier.

‘This has been a primary topic of discussions we’ve had at OpenAI in recent weeks.

‘Committing to having independent evaluators with employee-like access is a great idea, and we will do the same. We’ll have more to share soon.’

US President Donald Trump, however, took a different view.

Speaking to the media, he said that ‘whoever wins AI, wins’, igniting talks of a race with China.

He also criticised industry figures for being ‘negative’ around the technology’s future.

Editorial Team

James Smith

Editor-in-Chief

Print page

Comments:

comments powered by Disqus