论文成果
全部论文
完整列表，包括已接收论文、审稿中投稿、预印本与书籍。最新书目信息请参见我的 Google Scholar 主页.
32 总计
23 已发表
9 审稿中
会议论文
- arXiv + 审稿中2026On-Policy Residual Learning for Diffusion Language Models Yifan Yu, Yuqing Jian, Jisen Li, Yuezhou Hu, Tianyi Zhang, Xiaoxia Wu, Rui-Jie Zhu, Junxiong Wang, , Fan Lai, James Zou, Chenfeng Xu
- NeurIPS 2026 Workshop RTCA2026When Does a Speech Model Know to Hand Off? Reading Competence from Hidden States for Real-Time Escalation Ruoyu He, Jisen Li, Anthony Ji, Changyi Yang, Zetian Li, Runduo Ma, Zhen Zhang,
- NeurIPS2026Orthros: Phase-Aware Heterogeneous Attention for Efficient Transformers Yuhong Chou, Zehao Liu, Yuqi Pan, Qian Liu, Xianwei Chen, , Jibin Wu
- EMNLP2026Osprey: Target-agnostic Pre-training Makes Stronger Drafters in Speculative Decoding Fengxiang Bie, Yuqing Jian, Yifan Yu, , Zelei Shao, Ben Athiwaratkun, Shuaiwen Leon Song, Chenfeng Xu, Xiaoxia Wu, Tianyi Zhang
arXiv:2609.09338.
- NeurIPS2026OSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization , Donglin Zhuang*, Jisen Li, Ziyan Chen, Shuaiwen Leon Song, Ben Athiwaratkun, Xiaoxia Wu
开源首月获得 500 多个 GitHub Star。
- COLM2026I-DLM: Introspective Diffusion Language Models Yifan Yu, Yuqing Jian, Junxiong Wang, , Donglin Zhuang, Xinyu Fang, Sri Yanamandra, Xiaoxia Wu, Qingyang Wu, Shuaiwen Leon Song, Tri Dao, Ben Athiwaratkun, James Zou, Fan Lai, Chenfeng Xu
面向扩散语言模型的内省式跨步解码。
- COLM2026Squeeze Evolve: Unified Multi-Model Orchestration for Verifier-Free Evolution Monishwaran Maheswaran, Leon Lakhani, , Shijia Yang, Junxiong Wang, Coleman Hooper, Yuezhou Hu, Rishabh Tiwari, Jue Wang, Harman Singh, Qingyang Wu, Yuqing Jian, Ce Zhang, Kurt Keutzer, Tri Dao, Xiaoxia Wu, Ben Athiwaratkun, James Zou, Chenfeng Xu
面向无验证器进化的统一多模型编排。
- ICLR2026
- ICML2026Aurora: When RL Meets Adaptive Speculative Training — A Unified Training-Serving System Junxiong Wang*, Fengxiang Bie*, Jisen Li, Zelei Shao, Yubo Wang, Yinghui Liu, Qingyang Wu, Avner May, Sri Yanamandra, Ce Zhang, Tri Dao, Percy Liang, Ben Athiwaratkun, Shuaiwen Leon Song, , Chenfeng Xu, Xiaoxia Wu
- MLSys2026KITTY: Accurate and Efficient 2-bit KV Cache Quantization with Dynamic Channel-wise Precision Boost Haojun Xia, Xiaoxia Wu, Jisen Li, Robert Wu, Junxiong Wang, Jue Wang, Chenxi Li, Aman Singhal, Alay Dilipbhai Shah, Alpay Ariyak, Donglin Zhuang, , Ben Athiwaratkun, Zhen Zheng, Shuaiwen Leon Song
- Together AI 博客2026CoderForge-Preview: SOTA open dataset for training efficient coding agents Alpay Ariyak*, Junda Zhang, Junxiong Wang, Shang Zhu, Federico Bianchi, Sanjana Srivastava, Ashwinee Panda, Siddhant Bharti, Chenfeng Xu, John Heo, Xiaoxia Shirley Wu, James Zou, Percy Liang, Leon Song, Ce Zhang, Ben Athiwaratkun, , Qingyang Wu*
项目核心负责人。
- NeurIPS 2025 Workshop on Efficient Reasoning2025
- ICML2025
- NeurIPS2024CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning Yibo Yang, Xiaojie Li, , Shuaiwen Leon Song, Jianlong Wu, Liqiang Nie, Bernard Ghanem
- USENIX ATC2024
- VLDB2024
- ICSE2020
期刊论文
- IEEE TPAMI2025RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Models Fengxiang Bie, Yibo Yang, , Adam Ghanem, Minjia Zhang, Zhewei Yao, Xiaoxia Wu, Connor Holmes, Pareesa Golnari, David A. Clifton, Yuxiong He, Dacheng Tao, Shuaiwen Leon Song
综述论文栏目。
- Sensors (MDPI)2021Binary Neural Network for Automated Visual Surface Defect Detection Wenzhe Liu, Jiehua Zhang, Zhou Su, , Li Liu
工业过程智能感知与监测专刊。
审稿中
- arXiv + 审稿中2026
- arXiv + 审稿中2026
- arXiv + 审稿中2026
- arXiv + 审稿中 · COLM 20262026Sketched Linear Contrastive Learning: Approximation, Optimization, and Statistical Scaling Ziyan Chen, , Dingxuan Zhou
- arXiv + 审稿中2026From One-Pass SGD to Data Reuse: Mini-Batch Scaling Laws in Sketched Linear Regression Ziyan Chen, , Dingxuan Zhou
- arXiv + 审稿中2026
- 博士学位论文 · 悉尼大学2026Efficient Compression Algorithm-System Co-Design for Large-Scale Model Training and Inference
悉尼大学工程学博士学位论文。
- arXiv + 审稿中2026Imitate Optimal Policy: Prevail and Induce Action Collapse in Policy Gradient , Yibo Yang, Ziyan Chen, Fengxiang Bie, Haojun Xia, Xiaoxia Wu, Robert Wu, Ben Athiwaratkun, Bernard Ghanem, Shuaiwen Leon Song
预印本
- arXiv2026
- arXiv2023DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales Zhewei Yao, Reza Yazdani Aminabadi, Olatunji Ruwase, Samyam Rajbhandari, Xiaoxia Wu, Ammar Ahmad Awan, Jeff Rasley, Minjia Zhang, Conglong Li, Connor Holmes, , Michael Wyatt, Molly Smith, Lev Kurilenko, Heyang Qin, Masahiro Tanaka, Shuai Che, Shuaiwen Leon Song, Yuxiong He
- arXiv2023DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies Shuaiwen Leon Song, Bonnie Kruft, Minjia Zhang, Conglong Li, Shiyang Chen, Chengming Zhang, Masahiro Tanaka, Xiaoxia Wu, Jeff Rasley, Ammar Ahmad Awan, Connor Holmes, Martin Cai, Adam Ghanem, , et al.
- arXiv2026Linear RNN Scaling Laws: When Longer Sequences Beat More Sequences Ziyan Chen, , Peilin Liu, Ding-Xuan Zhou
书籍
- 天津大学出版社