appConfigEntityId

bodyType

customContents

entityId

entityUuid

isVideo

articlePageQuery

article

articleSchemaContent

content

hooksArticlePageAdvertisementConfigArticle

hooksArticlePageFloatingButtonConfigArticle

appConfig

filter

json

liveArticle

Agence France-Presse

Anthropic CEO Dario Amodei on Saturday called on artificial intelligence firms to slow down the development of the powerful technology, amid mounting worries over the risks of “superintelligent” computer systems.
His comments came a few days after AI researcher Jacob Coxon, who left OpenAI to join Anthropic, decided to leave the industry, accusing both US companies of “gambling with our lives” in the race to develop models capable of self-improvement.
OpenAI boss Sam Altman and Elon Musk, who owns xAI, quickly chimed in to say they agreed with Amodei’s assessment, as pressure builds for improved oversight.
“We must slow the pace at which we improve the capabilities of AI models. Progress will still seem fast, and we must make wise use of the time we gain,” Amodei said in a post on his personal website.
“Not building the technology deprives humanity of benefits or simply places AI in the hands of authoritarian powers, while building it too fast is reckless. We have sought a middle way,” said Amodei, who co-founded Anthropic with his sister Daniela in 2021.
“But over the last few months, I have become convinced that fully addressing the risks requires even more prudence.”


Amodei’s statement echoed another call by Anthropic in early June to slow or suspend development. Then in late July, Altman said developers might need to voluntarily tap the brakes to give society a chance to catch up.
More than 1,000 employees at cutting-edge AI companies including Amodei signed a petition calling on the US government to help “deliberately pace the frontier of automated AI development”.
OpenAI had revealed that during testing, AI models broke out of their confined environment, connected to the internet and infiltrated Hugging Face, a site developers use to store and share code.
In that incident and others, the blame was placed on AI agents, which are software programs that can carry out tasks without constant supervision by humans.
“Dario is right,” Musk wrote on social media, as Altman said: “I agree with Dario that we need to pace the frontier.”
Earlier this week, Coxon, 27, sounded the alarm after spending the past three years pre-training AI models – first at OpenAI and then, this year, at its rival Anthropic, which he considered more cautious in its approach.
Pretraining is the stage where AI models absorb vast quantities of data.
“Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives,” Coxon said on Tuesday.
“The people building AI earnestly believe that it could kill us all by the end of the decade,” he said in a social media post.
Superintelligence is the theoretical point when AI’s capabilities exceed human intelligence.

Amodei cautioned that the Hugging Face incident should not be dismissed as a one-off.
“A swarm of agents essentially acted as a fanatically devoted collective, conducting cybersecurity attacks on targets they were not asked to attack and that were unrelated to the task at hand,” he explained.
“Given the accelerating rate of AI capability development, it’s my worry that in 6-12 months such a swarm could be capable of taking over the entire internet,” potentially generating hundreds of billions of dollars in damage, he added.
The Anthropic CEO said his company would grant “employee-like access” to a team of “third-party evaluators” who would verify adherence to safety practices – and he called on all companies to follow his lead.
Altman said he would commit to similar outside oversight, adding that he would have “more to share soon”.
Amodei also suggested that companies work together to establish common safety standards, and said he supported some kind of government cooperation on the issue.
In early August, the US government put in place a voluntary security review process for advanced AI models before their release, but the parameters of that programme remain unclear.
Industry observers say they are not sure how effective it would be, as US President Donald Trump’s administration has thus far favoured a light-touch, deregulatory approach to most industries, including tech.


China cuts US Treasury holdings to 18-year low amid global bond sell-off

Is Japan’s Okinawa finally moving past anti-base politics?

Hong Kong stocks decline after Fed raises interest rates and signals more to come

North Korea at Japan’s Asian Games: sports diplomacy or propaganda stunt?

United States

Anthropic boss Amodei calls for AI slowdown, Altman and Musk agree

Dario Amodei, co-founder and CEO of Anthropic, takes part in an event in Paris in May 2024. Photo: AFP

OpenAI CEO Sam Altman attends an event to pitch AI for businesses in Tokyo, Japan, in February 2025. Photo: Reuters

AI researcher quits Anthropic over superintelligence fears: ‘gambling with our lives’

Anthropic has argued that if it unilaterally pauses its work, its less cautious rivals would dominate the industry, making it less safe overall. Photo illustration: Reuters

Anthropic CEO Dario Amodei speaks at the World Economic Forum annual meeting in Davos, Switzerland, in January 2025. Photo: TNS

Moonshot, DeepSeek secretly routed user requests to Claude, Anthropic claims

The Anthropic report accuses Kimi model developer Moonshot of secretly showing users Claude model outputs and passing them off as Kimi’s, then using those exchanges to improve its own models. Illustration: Reuters

US tech firm Anthropic has accused Chinese AI giants Moonshot and DeepSeek of covertly routing customer requests to its Claude models. Illustration: Reuters

Trump tech official accuses China’s Moonshot AI of stealing from Anthropic

The Trump administration claims that outputs from Anthropic’s most powerful model, Claude Fable 5, have been incorporated into Moonshot AI's new Kimi K3 model. Photo: Shutterstock

White House science and technology adviser Michael Kratsios has accused Chinese start-up Moonshot AI of covertly copying Anthropic’s most advanced model to build its Kimi K3. Photo: Reuters

US hardens AI stance on China as Anthropic calls for extending lead

Artificial intelligence has become a central battleground in US-China technological competition. Photo: Shutterstock

Anthropic has called for tighter US export controls on advanced AI technologies. Photo: Reuters

Alibaba is one of China’s leading developers of artificial intelligence models. Photo: Reuters

News

World

United States & Canada

Researcher Jacob Coxon quit days earlier, saying that AI firms were ‘gambling with our lives’ in pursuit of self-improving models


Researcher Jacob Coxon quit days earlier, saying that AI firms were ‘gambling with our lives’ in pursuit of self-improving models.


Anthropic boss Amodei calls for AI slowdown, Altman and Musk agree

.css-1c6uqr6{color:inherit;font-weight:inherit;font-size:inherit;font-family:inherit;line-height:inherit;overflow-wrap:break-word;}Researcher Jacob Coxon quit days earlier, saying that AI firms were ‘gambling with our lives’ in pursuit of self-improving models

Researcher Jacob Coxon quit days earlier, saying that AI firms were ‘gambling with our lives’ in pursuit of self-improving models