tracked author

Yuxiong He

Recurring DeepSpeed author in the local archive: ZeRO coauthor and DeepSpeed Ulysses coauthor. Snowflake author page identifies her as former Microsoft Partner Research and Product Manager who co-founded and led DeepSpeed; X bio directly references Microsoft and deepspeed.ai.

2 archived notes X: high Homepage X

Related Notes

按论文归档时间排序，展示该作者在本站已经出现的材料。

归档 Jun 21, 2026

DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models

用 sequence sharded 与 head sharded 之间的 all to all 布局转换扩展极长序列训练。

待审阅 2309.14509-deepspeed-ulysses-long-sequence-training Distributed Training Long Context Attention Kernel

归档 Jun 18, 2026

ZeRO: Memory Optimizations Toward Training Trillion Parameter Models

按 data parallel rank 分片 optimizer state、gradient 与 parameter，降低大模型训练的显存复制。

待审阅 1910.02054-zero-memory-optimizations-trillion-parameter-models Training Memory Distributed Training