ChatGPT Whistleblower: They Offered Me $2m To Keep Quiet, No One Is Ready For What's Coming!
A former OpenAI forecaster who forfeited nearly his entire net worth rather than sign a silence clause explains, with uncomfortable specificity, why he believes there is a 70% chance this goes catastrophically wrong—and why the CEOs racing to build it probably know.
1 / 5at 5:07 · Yank's paraphrase
The scary open secret in the AI industry right now is that right now that is kind of just a hope. It's not something that we can be at all confident in.
AI Summary
Daniel Kokotajlo, a former OpenAI researcher who now runs the AI Futures Project nonprofit, speaks with the Diary of a CEO about his warnings on artificial superintelligence. He worked at OpenAI from 2022 until he resigned in 2024, where he focused on forecasting AI timelines and evaluating dangerous AI capabilities.
Yank Summary
What matters, in Yank’s words, each linked to where the source says it.
Kokotajlo refused to sign OpenAI's exit anti-disparagement clause, losing roughly $2 million — about 80% of his net worth — before public outcry forced the company to back down.
Kokotajlo puts the probability of things going 'horribly wrong' — up to and including human extinction — at around 70%, calling it the scary open secret of the AI industry.
The scary open secret in the AI industry right now is that right now that is kind of just a hope. It's not something that we can be at all confident in.
An insider admits that AI safety is currently built on hope rather than verified technical guarantees.
In context
real-world power that they don't need humans anymore. And they're smarter than us, they're more strategic, etc. At that point, we sort of have to hope that they are virtuous, that they have, you know, the goals that we wanted them to have, the values that we wanted them to have, etc. And the sort of scary open secret in the AI industry right now is that right now that is kind of just a hope. It's not something that we can be at all confident in, and in fact, there's lots of evidence and arguments that it we're not on track to achieve that. So there's lots of reason Like current
The scary open secret in the AI industry right now is that right now that is kind of just a hope. It's not something that we can be at all confident in.
Receipt
These powerful CEOs are literally afraid that if the other guy gets there first, he might become dictator — and that's why they're racing as hard as they can.
Fear of rivals gaining dictatorial power, not profit, is what actually drives the AI arms race among top CEOs.
In context
in like 2017 about how the reason why we made OpenAI was because we were worried that Demis Hassabis at Google was going to become dictator with AGI. Even back then they were this obviously about more than just money. Like these these powerful CEOs are literally afraid that if the other guy gets there first he might become dictator and they don't trust each other and so that's why they are racing as hard as they can so that they're the ones who get there first so to speak. >> Have you met Sam Altman? >> Yeah. >> And did did that shape your opinion of his incentives or what why he's doing
These powerful CEOs are literally afraid that if the other guy gets there first, he might become dictator and they don't trust each other — and so that's why they are they're racing as hard as they can. so that they're
Receipt
I basically told my wife: let's not have any more kids. It's too uncertain. I don't think they'll ever join the workforce.
The speaker's personal reproductive choice reveals how concretely he believes AI will collapse normal human futures.
In context
with a 70% chance that this goes horribly wrong like human extinction. That's one possibility. There's many more. >> It's quite chilling what you're saying. >> Yeah, it's uh gets me down sometimes. I basically told my wife like let's not have any more kids. It's too uncertain. I don't think they'll ever join the workforce. Everybody should be afraid that their jobs are going to be lost. And I know this because I went to OpenAI in 2022. What I did there was forecasting what the what the next couple years might look like. And unfortunately, most of the world is kind of asleep at the wheel
I basically told my wife: like let's not have any more kids. It's too uncertain. I don't think they'll ever join the workforce.
Receipt
In stories it always ends well, but this is real life — and I think we have to stare reality in the face and realize that it might not actually end well.
Fiction's reassuring endings offer false comfort; the speaker insists this real situation may genuinely end in catastrophe.
In context
going on inside these artificial brains and why they are the way that they are and it's really cool to see all the applications of this technology out in the world. But it really seems like we're on a pretty scary path and the more you think about it, the more worried you get and you know, in stories it always ends well, but this is real life. And I I think we have to sort of stare reality in the face and tell it and realize that like it might not actually end well, you know. >> Were there any recent dare I say I was going to say eureka
In stories it always ends well, but this is real life — and I I think we have to sort of stare reality in the face and tell it and realize that like it might not actually end well.
Receipt
"Do you think it's too late?" "No. If I thought it was too late, I wouldn't be here." "Where would you be?" "With my family."
A terse exchange reveals that his continued public warnings are the only thing standing between him and quiet retreat to loved ones.
In context
is the my current best guess as to the way out, you know, the way forward. Um but, I'm not like boycotting all the AIs. I'm I'm not like, you know, uh trying to I'm not refusing to like engage with it in that way. >> Do you think it's too late? >> No. I don't think it's too late. If I thought it was too late, I wouldn't be here. >> Hm. Where would you [clears throat] be? >> With my family. >> What's your closing message to the general public if you had to have a closing statement to them? Maybe I would say that like
"Do you think it's too late?" "No. If I thought it was too late, I wouldn't be here." >> Hm. "Where would you [clears throat] be?" >> "With my family."
Receipt
Didn’t see the line you wanted? Choose your own
Make something from it
Ask a question
Ask about anything in this video. We’ll try to provide an answer.