Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFold

戴米斯·哈萨比斯——规模化、超越人类的AI,LLM之上的AlphaZero,AlphaFold

Dwarkesh Podcast

2024-02-28

1 小时 1 分钟
PDF

单集简介 ...

Here is my episode with Demis Hassabis, CEO of Google DeepMind We discuss: * Why scaling is an artform * Adding search, planning, & AlphaZero type training atop LLMs * Making sure rogue nations can't steal weights * The right way to align superhuman AIs and do an intelligence explosion Watch on YouTube. Listen on Apple Podcasts, Spotify, or any other podcast platform. Read the full transcript here. Timestamps (0:00:00) - Nature of intelligence (0:05:56) - RL atop LLMs (0:16:31) - Scaling and alignment (0:24:13) - Timelines and intelligence explosion (0:28:42) - Gemini training (0:35:30) - Governance of superhuman AIs (0:40:42) - Safety, open source, and security of weights (0:47:00) - Multimodal and further progress (0:54:18) - Inside Google DeepMind Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
更多

单集文稿 ...

  • So I wouldn't be surprised if we had AGI-like systems within the next decade.

  • It was pretty surprising to almost everyone,

  • including the people who first worked on the scaling hypotheses, that how far it's gone.

  • In a way, I look at the large models today,

  • and I think they're almost unreasonably effective for what they are.

  • It's an empirical question whether that will hit an asymptote or brick wall.

  • I think no one knows.

  • When you think about superhuman intelligence, is it still controlled by a private company?

  • As Gemini becoming more multimodal, and we start ingesting audio, visual data as well as text data.

  • I do think our systems are going to start to understand the physics of the real world better.

  • The world's about to become very exciting, I think,

  • in the next few years as we start getting used to the idea of what true multimodality means.

  • Okay, today it is a true honor to speak with Demis Osavis, who is the CEO of DeepMind.

  • Demis, welcome to the podcast.

  • Thanks for having me.

  • First question, given your neuroscience background, How do you think about intelligence?

  • Specifically, do you think it's like one higher level general reasoning circuit,

  • or do you think it's thousands of independent sub-scales and heuristics?

  • Well,

  • it's interesting