tracked author

Pengyu Zhao

Lead author marker in the MiniMax Sparse Attention TeX comments and recurring senior MiniMax author. Public evidence identifies him as LLM Lead / Head of Research at MiniMax; the X account bio and posts align with MiniMax M-series work.

1 archived notes X: high X

Related Notes

按论文归档时间排序,展示该作者在本站已经出现的材料。

Jun 24, 2026

MiniMax Sparse Attention

MiniMax Sparse Attention (MSA) 是 MiniMax M3 的长上下文技术核心:它在 GQA (Grouped Query Attention,分组查询注意力) 之上增加轻量 Index Branch,为每个 query token 和每个 GQA group 选择少量 KV blocks,再由 Main Branch 对被选 block 做精确 softmax attention;论文的强证据在于 109...

2606.13392-minimax-sparse-attention-m3 Sparse AttentionLong ContextMoE Architecture