tracked author

Yan Wang (王琰)

Equal-contribution author and project lead of FlashMemory-DeepSeek-V4, with paper-time affiliation Independent Researchers. Author of HiLS-Attention with paper-time affiliation Tencent HY Team. Personal homepage identifies WANG Yan (王琰) as a principal research scientist at Tencent AI Lab and lead of the Model Architecture Exploration Group working on infinite-memory architectures.

2 archived notes X: not-found Homepage

Related Notes

按论文归档时间排序，展示该作者在本站已经出现的材料。

归档 Jul 09, 2026

Hierarchical Sparse Attention Done Right: Toward Infinite Context Modeling

HiLS Attention 用 landmark 压缩键、熵偏置与分层 softmax 训练 chunk 选择器，使 8K 训练的 345M 模型在 4M RULER 单针检索仍得 96 分，并在 512K 单 H800、batch size 1 的同 Triton 基线上将 prefill 与 decode 分别加速 13.5 倍和 15.7 倍。

待审阅 2607.02980-hils-attention-infinite-context Sparse Attention Long Context

归档 Jul 05, 2026

FlashMemory-DeepSeek-V4: Lightning Index Ultra-Long Context via Lookahead Sparse Attention

预测未来 token 的 KV chunk 需求，将冷 KV 移到 CPU 并按需预取，压缩物理 KV footprint。

待审阅 2606.09079-flashmemory-deepseek-v4-lookahead-sparse-attention KV Cache Sparse Attention Long Context