Resonance RoPE: Improving Context Length Generalization of Large Language Models

Jan 1, 2024·
Suyuchen Wang
,
Ivan Kobyzev
,
Peng Lu
,
Mehdi Rezagholizadeh
,
Bang Liu
· 0 min read
Type
Publication
Findings of the Association for Computational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting, August 11-16, 2024