Jiashuo Liu（刘家硕）
Email: liujiashuo.77@bytedance.com and liujiashuo77@gmail.com
Address: DingHao (DH-B), Beijing, China
I'm a Research Scientist at ByteDance Seed, as a member of TopSeed Program, working with Wenhao Huang. I received my Ph.D. from the Department of Computer Science and Technology at Tsinghua University, advised by Professors Peng Cui and Bo Li. Previously, I was a visiting student researcher at Stanford University, working with Professor Jose Blanchet; and at the Cambridge Centre for AI in Medicine, working with Professor Mihaela van der Schaar.I obtained my Bachelor's degree from Tsinghua University.
Research
I focus on building next-generation LLM evaluation systems and large-scale, data-centric AI. I believe LLM evaluation should be reliable, efficient, and anchored in realistic real-world tasks, and it must rest on a deep understanding of data.
Specific topics include:
Current Academic Collaborators:Specific topics include:
- Reliable LLM Eval: We design new perturbation algorithms and future prediction tasks with completely no data contamination to reliably assess the true capabilities of Agentic LLMs. Together with Prof. Mengdi Wang, our FutureX project,described by Elon Musk as the "Best Measure of Intelligence"(media), has received over 50 million views on X(Twitter).
- Efficient LLM Eval: We design algorithms to efficiently and accurately evaluate LLM's performance.
- Realistic LLM Eval: We use realistic, professional and valuable tasks to benchmark LLM's true value in helping with daily works. Together with Prof. Hongseok Namkoong, our FinSearchComp has received over 20 million views on X(Twitter), and is recently adopted in MiniMax-M2's report.
- LLM Calibration: We design RL algorithms to calibrate LLM's confidence estimation, enabling LLM's to say "I don't know".
Jose Blanchet (Stanford MS&E), Emmanuel Candès (Stanford Statistics), Hongseok Namkoong (Columbia DRO), Mihaela van der Schaar (Cambridge CCAIM), and Mengdi Wang (Princeton ECE).
Current Interns:
Zerui Cheng (Princeton University, reliable evaluation), Jiayun Wu (CMU, LLM calibration)
Education/Experience
- 2020-2025: Ph.D. in Computer Science, Tsinghua University
- 2016-2020: B.Eng in Computer Science, Tsinghua University
- 2024/6-2024/11: Visiting Student Researcher at the University of Cambridge
- 2023/10-2024/3: Visiting Student Researcher at Stanford University
Template adapted from Danqi Chen's.