Zhuoshi Pan (盘卓实 in Chinese) is currently a graduate student at School of Information Science and Technology (SIST) in Tsinghua University (THU), supervised by Prof. H. Vicky Zhao. He got the B.E. degree from School of Information Science and Technology (SIST), Tsinghua University (THU) in 2023.
His researches focus on inference efficiency and data efficiency for LLM.
🔥 News
- 2025.08: One paper about efficient LLM inference was accepted by EMNLP’25 Paper|Code. Thanks for the first author Wei Wu!
- 2025.03: One paper about LLM financial data synthesis was accepted by ACL’25 Main Paper|Code. Thanks for the first author Huisheng Wang!
- 2025.03: One paper about LLM reasoning data synthesis was accepted by ACL’25 Findings Paper|Code. Thanks for all collaborators!
- 2025.01: One paper about efficient conversation agent was accepted by ICLR’25 Paper|Code. Thanks for all collaborators!
- 2024.12: One paper about backdoor attack was accepted by NeurIPS’24 Paper|Code. Thanks for all collaborators!
- 2024.03: LLMLingua-2 was accepted by ACL’24 Findings Paper|Code|Demo. Thanks for all collaborators!
📝 Publications
TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection | [EMNLP’25 Main]
Wei Wu, Zhuoshi Pan (co-first author), Chao Wang, Liyi Chen, Yunchu Bai, Tianfu Wang, Kun Fu, Zheng Wang, Hui Xiong
LEMMA: Learning from Errors for MatheMatical Advancement in LLMs | [ACL’25 Finding]
Zhuoshi Pan, Yu Li, Honglin Lin, Qizhi Pei, Zinan Tang, Wei Wu, Chenlin Ming, H. Vicky Zhao, Conghui He, Lijun Wu
Secom: On memory construction and retrieval for personalized conversational agents | [ICLR’25]
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H Vicky Zhao, Lili Qiu, Jianfeng Gao
Project |
LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression | [ACL’24 Finding]
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin, Victor Rühle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang
Project | 
From Trojan Horses to Castle Walls: Unveiling Bilateral Backdoor Effects in Diffusion Models | [NeurIPS’24]
Zhuoshi Pan, Yuguang Yao (co-first author), Gaowen Liu, Bingquan Shen, H. Vicky Zhao, Ramana Rao Kompella, Sijia Liu
Project |
🎖 Honors and Awards
- 2024, First-Class Overall Excellence Award, THU.
- 2020~2022, Academic Excellence Scholarship, THU.
- 2019, Freshman Scholarship, THU.
📖 Educations
- 2023.09 - Now, Graduate student in the School of Information Science and Technology (SIST), Tsinghua University (THU).
- 2019.09 - 2023.06, Undergraduate student in the School of Information Science and Technology (SIST), Tsinghua University (THU).