We need to stop AI developing without humans, says Anthropic co-founder
Jack Clark tells BBC's Newsnight AI could get to the point where it develops without human input.
Coverage by Political Leaning
See how different sides of the spectrum reported this story
Notable Quotes
"The AI industry right now has a gas pedal, but it doesn’t have a brake pedal in the car, and we want to do some of the work to build that pedal."
— Jack Clark , Executive
"We think this is a topic that the world should be talking more about."
— Jack Clark , Executive
"The authors warn that while this threshold has not yet been crossed, it could come sooner than most institutions are prepared for."
— Jack Clark , Executive
"If it were possible to effectively slow the development of this technology to give ourselves more time to deal with its immense implications, we think that would likely be a good thing."
— Jack Clark , Executive
"We are not there yet, and recursive self-improvement is not inevitable."
— Jack Clark , Executive
"No, I don't think it is."
— Jack Clark , Executive
"I think it’s really important that people understand that it’s not just the biggest, most powerful language models that pose the security concerns."
— Nicolas Papernot , Academic
"It would be good for the world to have the option to show or temporarily pause AI work that may be dangerous."
— Jack Clark , Executive
"That collision, where recursive intelligence building itself ever faster meets the world of humans, relationships, and governance, is another part of this future we can’t predict."
— Jack Clark , Executive
"Training runs are far easier to conceal than missile silos, their inputs are general-purpose, and the incentive to defect quietly is enormous, because whoever continues while others pause could inherit the lead."
— Jack Clark , Executive
"Right now, it’s like the AI industry has a gas pedal but it doesn't have a brake pedal."
— Jack Clark , Executive
"Better regulation would keep AI systems in their lane."
— David Krueger , Academic
Key People
Specialist in responsible AI, advocating for better regulation of AI tools.
Former AI advisor to President Trump.
Former president of the United States known for his aggressive economic policies.
Elon Musk is the CEO of SpaceX and Tesla.
Jack Clark is the co-founder of Anthropic, a company focused on artificial intelligence.
Commentator from the Financial Times discussing AI's value delivery.
Marina Favaro is an executive at Anthropic, involved in AI safety discussions.
Lead researcher at the University of Toronto.
Tags
All Coverage
Jack Clark tells BBC's Newsnight AI could get to the point where it develops without human input.
Anthropic co-founder Jack Clark warns that AI systems like Claude are nearing the point where they could develop without human input, urging the industry to implement control mechanisms to prevent this.
Anthropic's call for a pause in AI development due to concerns over 'recursive self-improvement' faces skepticism, with critics questioning the feasibility and motives behind the proposal.
An analysis of Anthropic's proposal for a global slowdown in AI development, discussing the challenges and skepticism surrounding the idea of a coordinated pause in the industry.
Anthropic calls for global coordination among AI companies to create a mechanism for pausing advanced AI development in response to increasing safety risks, highlighting the potential for AI systems to design their own successors.
Anthropic advocates for a coordinated pause in AI development to allow for human oversight and risk assessment, emphasizing the need for a 'pause button' in AI progress.
The Week explores the debate on slowing down AI development, highlighting Jack Clark's warning about AI systems potentially developing without human input and the need for regulatory mechanisms.
Anthropic cautions that AI systems could soon advance without human involvement, urging the industry to implement safeguards to maintain control.
Anthropic co-founder Jack Clark highlights the rapid advancement of AI models, cautioning that they may soon improve autonomously and calling for a global pause in development to address potential risks.
Similar Stories
Related coverage based on topic and tags
EXCLUSIVE: Anthropic warns AI may pose 'existential risks to humanity' in IPO filing - Reuters
EXCLUSIVE: Anthropic warns AI may pose 'existential risks to humanity' in IPO filing Reuters
September 29, 2026 at 12:17 AMEXCLUSIVE: Anthropic leaders to control AI lab via 'Founder LLC' to promote public good over market forces - Reuters
EXCLUSIVE: Anthropic leaders to control AI lab via 'Founder LLC' to promote public good over market forces Reuters
September 29, 2026 at 12:09 AMAI's race to transform the world before the money runs out - Reuters
AI's race to transform the world before the money runs out Reuters
October 3, 2026 at 05:06 AMRegulating AI 'not the right place to start' says Bailey
AI needs "rigorous" testing and safeguards to contain risk, Andrew Bailey says.
September 30, 2026 at 10:20 AMTrump rules out joint US-China venture to develop AI
The US president continues to push back on calls to establish guardrails around artificial intelligence, arguing it will stifle growth.
September 29, 2026 at 04:09 PMEXCLUSIVE: Anthropic's IPO pitch embraces AI's promise and peril - reuters.com
EXCLUSIVE: Anthropic's IPO pitch embraces AI's promise and peril reuters.com
September 30, 2026 at 07:52 PM