Benjamin Mann is a co-founder of Anthropic, an AI startup dedicated to building aligned, safety-first AI systems. Prior to Anthropic, Ben was one of the architects of GPT-3 at OpenAI. He left OpenAI driven by the mission to ensure that AI benefits humanity. In this episode, Ben opens up about the accelerating progress in AI and the urgent need to steer it responsibly.
*In this conversation, we discuss:*
1. The inside story of leaving OpenAI with the entire safety team to start Anthropic
2. How Metaโs $100M offers reveal the true market price of top AI talent
3. Why AI progress is still accelerating (not plateauing), and how most people misjudge the exponential
4. Benโs โeconomic Turing testโ for knowing when weโve achieved AGIโand why itโs likely coming by 2027-2028
5. Why he believes 20% unemployment is inevitable
6. The AI nightmare scenarios that concern him mostโand how he believes we can still avoid them
7. How focusing on AI safety created Claudeโs beloved personality
8. What three skills heโs teaching his kids instead of traditional academics
*Brought to you by:*
SauceโTurn customer pain into product revenue: https://sauce.app/lenny
LucidLinkโReal-time cloud storage for teams: https://www.lucidlink.com/lenny
FinโThe #1 AI agent for customer service: https://fin.ai/lenny
*Transcript:* https://www.lennysnewsletter.com/p/anthropic-co-founder-benjamin-mann
*My biggest takeaways (for paid newsletter subscribers):* https://www.lennysnewsletter.com/i/168107911/my-biggest-takeaways-from-this-conversation
*Where to find Ben Mann:*
โข X: https://x.com/8enmann
โข LinkedIn: https://www.linkedin.com/in/benjamin-mann/
โข Website: https://benjmann.net/
*Where to find Lenny:*
โข Newsletter: https://www.lennysnewsletter.com
โข X: https://twitter.com/lennysan
โข LinkedIn: https://www.linkedin.com/in/lennyrachitsky/
*In this episode, we cover:*
(00:00) Introduction to Benjamin
(04:43) The AI talent war
(06:28) AI progress and scaling laws
(10:50) Defining AGI and the economic Turing test
(12:26) The impact of AI on jobs
(17:45) Preparing for an AI future
(24:05) Founding Anthropic
(27:06) Balancing AI safety and progress
(29:10) Constitutional AI and model alignment
(34:21) The importance of AI safety
(43:40) The risks of autonomous agents
(45:40) Forecasting superintelligence
(48:36) How hard is it to align AI?
(53:19) Reinforcement learning from AI feedback (RLAIF)
(57:03) AI’s biggest bottlenecks
(01:00:11) Personal reflections on responsibilities
(01:02:36) Anthropicโs growth and innovations
(01:07:48) Lightning round and final thoughts
*Referenced:*
โข Dario Amodei on LinkedIn: https://www.linkedin.com/in/dario-amodei-3934934/
โข Anthropic CEO: AI Could Wipe Out 50% of Entry-Level White Collar Jobs: https://www.marketingaiinstitute.com/blog/dario-amodei-ai-entry-level-jobs
โข Alexa+: https://www.amazon.com/dp/B0DCCNHWV5
โข Azure: https://azure.microsoft.com/
โข Sam Altman on X: https://x.com/sama
โข Opus 3: https://www.anthropic.com/news/claude-3-family
โข Claudeโs Constitution: https://www.anthropic.com/news/claudes-constitution
โข Greg Brockman on X: https://x.com/gdb
โข Anthropicโs Responsible Scaling Policy: https://www.anthropic.com/news/anthropics-responsible-scaling-policy
โข Agentic Misalignment: How LLMs could be insider threats: https://www.anthropic.com/research/agentic-misalignment
โข Anthropicโs CPO on what comes next | Mike Krieger (co-founder of Instagram): https://www.lennysnewsletter.com/p/anthropics-cpo-heres-what-comes-next
โข AI prompt engineering in 2025: What works and what doesnโt | Sander Schulhoff (Learn Prompting, HackAPrompt): https://www.lennysnewsletter.com/p/ai-prompt-engineering-in-2025-sander-schulhoff
โข Unitree: https://www.unitree.com/
โข Arthur C. Clarke: https://en.wikipedia.org/wiki/Arthur_C._Clarke
โข How Reinforcement Learning from AI Feedback Works: https://www.assemblyai.com/blog/how-reinforcement-learning-from-ai-feedback-works
โข RLHF: https://en.wikipedia.org/wiki/Reinforcement_learning_from_human_feedback
โข Jared Kaplan on LinkedIn: https://www.linkedin.com/in/jared-kaplan-645843213/
โข Mooreโs law: https://en.wikipedia.org/wiki/Moore%27s_law
โข Machine Intelligence Research Institute: https://intelligence.org/
โข Raph Lee on LinkedIn: https://www.linkedin.com/in/raphaeltlee/
โข โThe Last Questionโ: https://en.wikipedia.org/wiki/The_Last_Question
โข Beth Barnes on LinkedIn: https://www.linkedin.com/in/elizabethmbarnes/
โข โThe Last Questionโ: https://en.wikipedia.org/wiki/The_Last_Question
โข Good Strategy, Bad Strategy | Richard Rumelt: https://www.lennysnewsletter.com/p/good-strategy-bad-strategy-richard
โข Pantheon on Netflix: https://www.netflix.com/title/81937398
*…References continued at:* https://www.lennysnewsletter.com/p/anthropic-co-founder-benjamin-mann
_Production and marketing by https://penname.co/._
_For inquiries about sponsoring the podcast, email [email protected]._
Lenny may be an investor in the companies discussed.
source
