Jack Clark

"The AI industry right now has a gas pedal, but it doesn’t have a brake pedal in the car, and we want to do some of the work to build that pedal."

"We think this is a topic that the world should be talking more about."

"The authors warn that while this threshold has not yet been crossed, it could come sooner than most institutions are prepared for."

"If it were possible to effectively slow the development of this technology to give ourselves more time to deal with its immense implications, we think that would likely be a good thing."

"We are not there yet, and recursive self-improvement is not inevitable."

"No, I don't think it is."

"It would be good for the world to have the option to show or temporarily pause AI work that may be dangerous."

"That collision, where recursive intelligence building itself ever faster meets the world of humans, relationships, and governance, is another part of this future we can’t predict."

"Training runs are far easier to conceal than missile silos, their inputs are general-purpose, and the incentive to defect quietly is enormous, because whoever continues while others pause could inherit the lead."

"Right now, it’s like the AI industry has a gas pedal but it doesn't have a brake pedal."

"You want the option to be able to take your foot off the gas and put your foot on the brake."

"You want the option to be able to take your foot off the gas and put your foot on the brake."

"We have a narrow contracting dispute, but I don’t want that to get in the way of the fact that we care deeply about national security."

"We're releasing it to a subset of some of the world's most important companies and organizations so they can use this to find vulnerabilities."

"I think that's the kind of thing society is going to want to know and might want to eventually pass rules around."

"a way of shutting off AI software completely if it gets too dangerous was something society 'might want to eventually pass rules around'."

"a so-called 'kill switch' may be needed to protect humanity."