Skip to yearly menu bar Skip to main content


Poster

Distilling to Hybrid Attention Models via KL-Guided Layer Selection

Yanhong Li ⋅ Songlin Yang ⋅ Shawn Tan ⋅ Mayank Mishra ⋅ Rameswar Panda ⋅ Jiawei Zhou ⋅ Yoon Kim
2026 Poster

Abstract

Video

Chat is not available.