Zhuoshi Pan (盘卓实 in Chinese) is currently a graduate student at School of Information Science and Technology (SIST) in Tsinghua University (THU), supervised by Prof. H. Vicky Zhao. He got the B.E. degree from School of Information Science and Technology (SIST), Tsinghua University (THU) in 2023.

His researches focus on LLM data synthesis, especially for math and agent domain.

🔥 News

  • 2025.03:   One paper about LLM financial data synthesis was accepted by ACL’25 Main Paper|Code. Thanks for the first author Huisheng Wang!
  • 2025.03:   One paper about LLM reasoning data synthesis was accepted by ACL’25 Findings Paper|Code. Thanks for all collaborators!
  • 2025.01:   One paper about efficient conversation agent was accepted by ICLR’25 Paper|Code. Thanks for all collaborators!
  • 2024.12:   One paper about backdoor attack was accepted by NeurIPS’24 Paper|Code. Thanks for all collaborators!
  • 2024.03:   LLMLingua-2 was accepted by ACL’24 Findings Paper|Code|Demo. Thanks for all collaborators!

📝 Publications

sym

ScaleDiff: Scaling Difficult Problems for Advanced Mathematical Reasoning | [Under Review]
Qizhi Pei, Zhuoshi Pan (co-first author), Honglin Lin, Xin Gao, Yu Li, Zinan Tang, Conghui He, Rui Yan, Lijun Wu

| Hugging Face

sym

Can One Domain Help Others? A Data-Centric Study on Multi-Domain Reasoning via Reinforcement Learning | [Under Review]
Yu Li, Zhuoshi Pan (co-first author), Honglin Lin, Mengyuan Sun, Conghui He, Lijun Wu

sym

REST: Stress Testing Large Reasoning Models by Asking Multiple Problems at Once | [Under Review]
Zhuoshi Pan, Qizhi Pei, Yu Li, Qiyao Sun, Zinan Tang, H. Vicky Zhao, Conghui He, Lijun Wu

| Project Page

sym

LEMMA: Learning from Errors for MatheMatical Advancement in LLMs | [ACL’25 Finding]
Zhuoshi Pan, Yu Li, Honglin Lin, Qizhi Pei, Zinan Tang, Wei Wu, Chenlin Ming, H. Vicky Zhao, Conghui He, Lijun Wu

| Hugging Face

sym

Secom: On memory construction and retrieval for personalized conversational agents | [ICLR’25]
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H Vicky Zhao, Lili Qiu, Jianfeng Gao

Project |

sym

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression | [ACL’24 Finding]
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin, Victor Rühle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang

Project | | Hugging Face

sym

TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection | [EMNLP’25 Main]
Wei Wu, Zhuoshi Pan (co-first author), Chao Wang, Liyi Chen, Yunchu Bai, Tianfu Wang, Kun Fu, Zheng Wang, Hui Xiong

sym

From Trojan Horses to Castle Walls: Unveiling Bilateral Backdoor Effects in Diffusion Models | [NeurIPS’24]
Zhuoshi Pan, Yuguang Yao (co-first author), Gaowen Liu, Bingquan Shen, H. Vicky Zhao, Ramana Rao Kompella, Sijia Liu

Project |

🎖 Honors and Awards

  • 2025, First-Class Overall Excellence Award, THU.
  • 2024, First-Class Overall Excellence Award, THU.
  • 2020~2022, Academic Excellence Scholarship, THU.
  • 2019, Freshman Scholarship, THU.

📖 Educations

  • 2023.09 - Now, Graduate student in the School of Information Science and Technology (SIST), Tsinghua University (THU).
  • 2019.09 - 2023.06, Undergraduate student in the School of Information Science and Technology (SIST), Tsinghua University (THU).