tracked author

Qian Liu (刘乾)

TRM and OTB coauthor. Homepage identifies him as a researcher at TikTok AI Innovation Center and links GitHub/Twitter; GitHub profile currently shows `coding @xai-org`, so the archive keeps both TikTok and xAI as current-public-profile signals.

2 archived notes X: high HomepageGitHubX

Related Notes

按论文归档时间排序,展示该作者在本站已经出现的材料。

Jun 21, 2026

Trust Region Masking for Long Horizon LLM Reinforcement Learning

这篇论文把 long horizon LLM RL 中 pi roll 与 pi theta 的实现级分布差异形式化为 surrogate objective error:经典 trust region bound 随长度呈 $O(T^2)$ 并迅速失效,作者给出更紧的 KL/TV 组合界,指出 max token divergence 是单靠 sequence average KL 无法替代的控制量,并提出 Trust Region...

2512.23075-trust-region-masking-long-horizon-llm-rl Training StabilityRL AlgorithmRollout Optimization