We need to stop AI developing without humans, says Anthropic co-founder
Jack Clark tells BBC's Newsnight AI could get to the point where it develops without human input.
Coverage by Political Leaning
See how different sides of the spectrum reported this story
Notable Quotes
"The AI industry right now has a gas pedal, but it doesn’t have a brake pedal in the car, and we want to do some of the work to build that pedal."
— Jack Clark , Executive
"We think this is a topic that the world should be talking more about."
— Jack Clark , Executive
"The authors warn that while this threshold has not yet been crossed, it could come sooner than most institutions are prepared for."
— Jack Clark , Executive
"If it were possible to effectively slow the development of this technology to give ourselves more time to deal with its immense implications, we think that would likely be a good thing."
— Jack Clark , Executive
"We are not there yet, and recursive self-improvement is not inevitable."
— Jack Clark , Executive
"No, I don't think it is."
— Jack Clark , Executive
"I think it’s really important that people understand that it’s not just the biggest, most powerful language models that pose the security concerns."
— Nicolas Papernot , Academic
"It would be good for the world to have the option to show or temporarily pause AI work that may be dangerous."
— Jack Clark , Executive
"That collision, where recursive intelligence building itself ever faster meets the world of humans, relationships, and governance, is another part of this future we can’t predict."
— Jack Clark , Executive
"Training runs are far easier to conceal than missile silos, their inputs are general-purpose, and the incentive to defect quietly is enormous, because whoever continues while others pause could inherit the lead."
— Jack Clark , Executive
"Right now, it’s like the AI industry has a gas pedal but it doesn't have a brake pedal."
— Jack Clark , Executive
"Better regulation would keep AI systems in their lane."
— David Krueger , Academic
Key People
Specialist in responsible AI, advocating for better regulation of AI tools.
Former AI advisor to President Trump.
Former president of the United States known for his aggressive economic policies.
Elon Musk is the CEO of SpaceX and Tesla.
Jack Clark is the co-founder of Anthropic, a company focused on artificial intelligence.
Commentator from the Financial Times discussing AI's value delivery.
Marina Favaro is an executive at Anthropic, involved in AI safety discussions.
Lead researcher at the University of Toronto.
Tags
All Coverage
Jack Clark tells BBC's Newsnight AI could get to the point where it develops without human input.
Anthropic co-founder Jack Clark warns that AI systems like Claude are nearing the point where they could develop without human input, urging the industry to implement control mechanisms to prevent this.
Anthropic's call for a pause in AI development due to concerns over 'recursive self-improvement' faces skepticism, with critics questioning the feasibility and motives behind the proposal.
An analysis of Anthropic's proposal for a global slowdown in AI development, discussing the challenges and skepticism surrounding the idea of a coordinated pause in the industry.
Anthropic calls for global coordination among AI companies to create a mechanism for pausing advanced AI development in response to increasing safety risks, highlighting the potential for AI systems to design their own successors.
Anthropic advocates for a coordinated pause in AI development to allow for human oversight and risk assessment, emphasizing the need for a 'pause button' in AI progress.
The Week explores the debate on slowing down AI development, highlighting Jack Clark's warning about AI systems potentially developing without human input and the need for regulatory mechanisms.
Anthropic cautions that AI systems could soon advance without human involvement, urging the industry to implement safeguards to maintain control.
Anthropic co-founder Jack Clark highlights the rapid advancement of AI models, cautioning that they may soon improve autonomously and calling for a global pause in development to address potential risks.
Similar Stories
Related coverage based on topic and tags
Anthropic says AI labs need coordinated plan to halt development if risks rise - Reuters
Anthropic says AI labs need coordinated plan to halt development if risks rise Reuters
June 4, 2026 at 11:39 PMAnthropic urges US not to block state AI laws without setting federal standards - Reuters
Anthropic urges US not to block state AI laws without setting federal standards Reuters
June 10, 2026 at 09:49 PMAnthropic v. OpenAI: Behind the bitter battle for the future of AI - Reuters
Anthropic v. OpenAI: Behind the bitter battle for the future of AI Reuters
June 11, 2026 at 05:18 PMUS says it will speed development and use of AI for national security - Reuters
US says it will speed development and use of AI for national security Reuters
June 5, 2026 at 08:09 PM'World-first' vaccine designed by artificial intelligence
Cambridge scientists say they have, for the first time, tested a vaccine designed by AI.
June 4, 2026 at 11:29 PMApple's AI Siri will be held back by aging devices, Morgan Stanley says - Reuters
Apple's AI Siri will be held back by aging devices, Morgan Stanley says Reuters
June 9, 2026 at 07:07 PM