tracked author

Pieter Abbeel

Ring Attention coauthor and Hao Liu's PhD advisor according to OpenReview. UC Berkeley pages identify him as professor, Berkeley Robot Learning Lab director and BAIR co-director. No high-confidence personal GitHub account is recorded.

1 archived notes X: high HomepageX

Related Notes

按论文归档时间排序,展示该作者在本站已经出现的材料。

Jun 19, 2026

Ring Attention with Blockwise Transformers for Near Infinite Context

Ring Attention 的核心贡献是把 exact Transformer 的长序列瓶颈从“单卡必须驻留整段序列输出”改成“每张设备只驻留本地 query block,并让 key/value block 沿 ring 轮转”:它复用 blockwise exact attention 的在线 softmax 统计量,在不近似 attention 的前提下把最大上下文长度扩展到接近设备数倍;代价边界在于 exact attent...

2310.01889-ring-attention-blockwise-transformers-near-infinite-context Long ContextDistributed TrainingAttention Kernel