2026-09-12
2 小时 0 分钟Nate, thank you so much for doing this.
You've written the world's darkest book.
You've devoted your life to warning the world about the potential dangers of AI.
So let's just start by hearing your explanation of why AI is dangerous in addition to just being annoying.
Yeah, you know, the very basic common sense point is if you race to make machines
that are much smarter than any human, to make machines that are more capable at inventing
their own technology than humans are, And you race into this without really knowing what you're doing.
The most likely outcome is just that the machines
get loose and do their own thing and that humanity dies as a side effect, just like humanity has,
you know, killed lots of other animal species, not because we hate them, but just as a side effect.
And in some sense, a lot of people find it sort of obvious or intuitive
that if you just like make these really smart, really powerful machines, why would they care about us?
And I think that intuition basically is right.
There's a lot of arguments you can have on each side.
You can get in the technical details.
But my book is basically just getting into those details and saying like, yep, it sort of holds up.
If we make smarter machines without knowing what we're doing, it's just going to go poorly.
Are we actually going to make machines capable of what you're describing?
You know, the companies are trying to.
They talk about how they are pursuing superintelligence in the true sense of the word.