Skip to yearly menu bar Skip to main content


Poster

Beyond Length: Quantifying Long-Range Information for Long-Context LLM Pretraining Data

Haoran Deng ⋅ Yingyu Lin ⋅ Zhenghao Lin ⋅ Xiao Liu ⋅ Yizhou Sun ⋅ Yian Ma ⋅ Yeyun Gong
2026 Poster

Abstract

Video

Chat is not available.