Nathan Lambert

[Administrator]

Personal website - natolambert.com

youtube.com/@natolambert

x.com/natolambert

linkedin.com/in/natolambert

Blog - interconnects.ai

 

[Administrator]

Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI

Nov 21, 2024

In this episode of The Cognitive Revolution, we dive deep into frontier post-training techniques for large language models with Nathan Lambert from the Allen Institute for AI. Nathan discusses the groundbreaking Tulu 3 release, which matches Meta's post-training performance using the LlAMA base model. We explore supervised fine-tuning, preference-based reinforcement learning, and the innovative reinforcement learning from verifiable reward technique. Nathan provides unprecedented insights into the practical aspects of model development, compute requirements, and data generation strategies. This technically rich conversation illuminates previously opaque aspects of LLM development, achieved by a small team of 10-15 people. Join us for one of our most detailed and valuable discussions on state-of-the-art AI model development.