episode · Checking source
Anthropic Head of Pretraining on Scaling Laws, Compute, and the Future of AI
Y Combinator Startup Podcast
Ever wonder what it actually takes to train a frontier AI model?YC General Partner Ankit Gupta sits down with Nick Joseph, Anthropic's Head of Pre-training, to explore the engineering challenges behind training Claude—from managing thousands of GPUs and debugging cursed bugs to balancing compute between pre-training and RL. We cover scaling laws, data strategies, team composition, and why the hardest problems in AI are often infrastructure problems, not ML problems.
View originalEver wonder what it actually takes to train a frontier AI model?YC General Partner Ankit Gupta sits down with Nick Joseph, Anthropic's Head of Pre-training, to explore the engineering challenges behind training Claude—from managing thousands of GPUs and debugging cursed bugs to balancing compute between pre-training and RL. We cover scaling laws, data strategies, team composition, and why the hardest problems in AI are often infrastructure problems, not ML problems.
- Published
- October 1, 2025
- Status
- active
- GUID hash
- e133c06ec065613c700c688967c37668043511aac73a8e9c4167967c1c13bef0
- Archive key
- anthropic-head-of-pretraining-on-scaling-laws-compute-and-the-future-of-ai--entry_2869d8153fdabe441c32d5f6dcc6
- Archive id
- entry_2869d8153fdabe441c32d5f6dcc6