tracked author

Huayang Li

Author of HiLS-Attention with paper-time affiliation Tencent HY Team. Homepage identifies Huayang Li as a NAIST PhD student and records earlier full-time research work at Tencent AI Lab; high-confidence X is linked from the homepage and matched by profile evidence.

1 archived notes X: high Homepage GitHub X

Related Notes

按论文归档时间排序，展示该作者在本站已经出现的材料。

Jul 09, 2026

Hierarchical Sparse Attention Done Right: Toward Infinite Context Modeling

HiLS Attention 把 chunk wise sparse attention 的选择问题改写为可端到端训练的 hierarchical softmax：每个 chunk 用 landmark token 生成压缩 key 和 entropy bias，query 先给 chunk 分配总 attention mass，再在被选 chunk 内做 token level attention。它在 345M 到 7B 实验中同...

2607.02980-hils-attention-infinite-context Sparse Attention Long Context