"You would prefer the human race to endure, right? You're hesitating. Yes? I don't know. I would... I would... This is a long hesitation. This is a long hesitation. There's so many questions involved in this. Should the human race survive? People haven't got it yet. People haven't understood what's coming. These technologies are dangerous societally. In the apocalyptic visions of AI, how real is the prospect of killer robots annihilating humanity? 20% likely. It's like, I don't know how else you explain this to the American people. We're going to take your job. We're going to take away... You're going to eviscerate your ability to have money and power. You know, I think AI will probably, like most likely, sort of lead to the end of the world. But in the meantime, there will be great companies created with serious machine learning. We at the AI Futures Project think that there's a 70% chance of all humans dead or something similarly bad. Whoa, whoa. Will you just... Okay. All humans dead. Correct. This is this mega transition from biological to digital intelligence from humans being the dominant species in the planet or the universe to not being, and we want that to go well. You know you're playing with fire when the people building it have a score called which is the percentage chance that this ends in disaster. What's your P-Doom number? I'm relatively an optimist, so I think there's a 25% chance that things go really, really badly. It all ends up being some version, you know, humans are headed towards the glue factory like a horse. That sort of probably makes me want to become a Luddite too. The AI is going to be in charge, to be totally frank, not humans. So what we need to do is, as fast as possible, adapt people to using AI and find ways to create jobs faster than we destroy them. We need a society-wide approach about how we're going to defend against this. I don't think there's a way of stopping it to take control if it wants to. The issue is, can we design it in such a way that it never wants to take control, but it's always benevolent?"