Mark Zuckerberg — Llama 3, $10B models, Caesar Augustus, & 1 GW datacenters

马克·扎克伯格——羊驼3号,100亿美元规模的模型,凯撒·奥古斯都,以及1GW的数据中心

Dwarkesh Podcast

2024-04-18

1 小时 17 分钟
PDF

单集简介 ...

Mark Zuckerberg on: - Llama 3 - open sourcing towards AGI - custom silicon, synthetic data, & energy constraints on scaling - Caesar Augustus, intelligence explosion, bioweapons, $10b models, & much more Enjoy! Watch on YouTube. Listen on Apple Podcasts, Spotify, or any other podcast platform. Human edited transcript with helpful links here. Timestamps (00:00:00) - Llama 3 (00:08:32) - Coding on path to AGI (00:25:24) - Energy bottlenecks (00:33:20) - Is AI the most important technology ever? (00:37:21) - Dangers of open source (00:53:57) - Caesar Augustus and metaverse (01:04:53) - Open sourcing the $10b model & custom silicon (01:15:19) - Zuck as CEO of Google+ Sponsors If you’re interested in advertising on the podcast, fill out this form. * This episode is brought to you by Stripe, financial infrastructure for the internet. Millions of companies from Anthropic to Amazon use Stripe to accept payments, automate financial processes and grow their revenue. Learn more at stripe.com. * V7 Go is a tool to automate multimodal tasks using GenAI, reliably and at scale. Use code DWARKESH20 for 20% off on the pro plan. Learn more here. * CommandBar is an AI user assistant that any software product can embed to non-annoyingly assist, support, and unleash their users. Used by forward-thinking CX, product, growth, and marketing teams. Learn more at commandbar.com. Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
更多

单集文稿 ...

  • Mark, welcome to the podcast.

  • Hey, thanks for having me.

  • Big fan of your podcast.

  • Oh, thank you.

  • That's very nice of you to say.

  • Okay, so let's start by talking about the releases that will go out when this interview goes out.

  • Tell me about the models.

  • Tell me about MetaAI.

  • What's new?

  • What's exciting about them?

  • Yeah, sure.

  • So, you know,

  • I think the main thing that most people in the world are going to see is the new version of MetaAI,

  • right?

  • So it's, you know, the most important thing about what we're doing is the upgrade to the model.

  • We're rolling out Llama 3.

  • We're doing it both as open source for the dev community, and it is now going to be powering Met AI.

  • So there's a lot that I'm sure we'll go into around Llama 3,

  • but I think the bottom line on this is that with Llama 3,

  • we now think that Met AI is the most intelligent AI assistant that people can use that's freely available.