Skip to yearly menu bar Skip to main content


Poster

Beyond Multi-Token Prediction: Pretraining LLMs with Future Summaries

Divyat Mahajan ⋅ Sachin Goyal ⋅ Badr Youbi Idrissi ⋅ Mohammad Pezeshki ⋅ Ioannis Mitliagkas ⋅ David Lopez-Paz ⋅ Kartik Ahuja
2026 Poster

Abstract

Video

Chat is not available.