Portrait of Zichong Li

Zichong Li

Graduating 2027 · Open to full-time research roles

I am a Ph.D. student in Machine Learning at Georgia Institute of Technology, advised by Prof. Tuo Zhao. I received my bachelor's and master's degrees from the University of Science and Technology of China. My research focuses on efficient and reliable large language model training, including optimizer and architecture design for pretraining, as well as training algorithms for mid- and post-training.

Highlights

Recent milestones, newest first.

  1. May 2026

    Joined NVIDIA — Applied Deep Learning Research Intern

    Working on token-efficient reinforcement learning for LLM reasoning with Wei Ping.

  2. 2026

    NorMuon selected as an ICML 2026 Spotlight Top 2.2%

    Our optimizer set new records on the modded-nanogpt speedrun leaderboard and was adopted in Andrej Karpathy's nanochat.

  3. 2025

    Interned at Microsoft — two papers accepted at ICML 2026

    The work led to NorMuon and Shuffle the Context (long-context adaptation via RoPE-perturbed self-distillation), both published at ICML 2026.

  4. 2024

    Interned at Microsoft — released compact Phi MoE models

    SlimMoE (COLM 2025) shipped as Phi-mini-MoE and Phi-tiny-MoE on Hugging Face — 6M+ total downloads.

  5. 2024

    Two RLHF papers accepted at NeurIPS 2024

    Adaptive preference scaling for preference optimization, and robust reward learning from corrupted human feedback.

Experience

Research internships at industry labs.

NVIDIA

Current May 2026 – Present

Applied Deep Learning Research Intern · Mentor: Wei Ping

Token-efficient reinforcement learning for LLM reasoning — getting more capability per training and inference token.

Microsoft

June 2025 – Aug 2025

Research Intern · Mentor: Chen Liang

Long-context adaptation of LLMs — RoPE-perturbed self-distillation, published as Shuffle the Context at ICML 2026.

Microsoft

May 2024 – Aug 2024

Research Intern · Mentor: Chen Liang

Structured compression and distillation of large MoE models — shipped as Phi-mini-MoE and Phi-tiny-MoE (6M+ downloads), published as SlimMoE at COLM 2025.

Publications

* denotes equal contribution.

Language models

  1. ICML 2026Spotlight · Top 2.2%

    NorMuon: Making Muon More Efficient and Scalable

    Zichong Li*, Liming Liu*, Chen Liang, Weizhu Chen, Tuo Zhao

    New records on the modded-nanogpt speedrun; adopted in Andrej Karpathy's nanochat.

  2. ICML 2026

    Shuffle the Context: RoPE-Perturbed Self-Distillation for Long-Context Adaptation

    Zichong Li, Chen Liang, Liliang Ren, Tuo Zhao, Yelong Shen, Weizhu Chen

  3. ICLR 2026

    COSMOS: A Hybrid Adaptive Optimizer for Efficient Training of Large Language Models

    Liming Liu, Zhenghao Xu, Zixuan Zhang, Hao Kang, Zichong Li, Chen Liang, Weizhu Chen, Tuo Zhao

  4. COLM 2025

    SlimMoE: Structured Compression of Large MoE Models via Expert Slimming and Distillation

    Zichong Li, Chen Liang, Zixuan Zhang, Ilgee Hong, Young Jin Kim, Weizhu Chen, Tuo Zhao

    Released as Microsoft's open Phi-mini-MoE and Phi-tiny-MoE — 6M+ downloads.

  5. arXiv 2025

    LLMs Can Generate a Better Answer by Aggregating Their Own Responses

    Zichong Li, Xinyu Feng, Yuheng Cai, Zixuan Zhang, Tianyi Liu, Chen Liang, Weizhu Chen, Haoyu Wang, Tuo Zhao

  6. IEEE TMC 2025

    Mitigating Tail Latency for On-Device Inference with Load-Balanced Heterogeneous Models

    Mu Yuan, Lan Zhang, Di Duan, Liekang Zeng, Miao-Hui Song, Zichong Li, Guoliang Xing, Xiang-Yang Li

  7. NeurIPS 2024

    Adaptive Preference Scaling for Reinforcement Learning with Human Feedback

    Ilgee Hong*, Zichong Li*, Alexander Bukharin, Yixiao Li, Haoming Jiang, Tianbao Yang, Tuo Zhao

  8. NeurIPS 2024

    Robust Reinforcement Learning from Corrupted Human Feedback

    Alexander Bukharin, Ilgee Hong, Haoming Jiang, Zichong Li, Qingru Zhang, Zixuan Zhang, Tuo Zhao

Point processes & other

  1. ICML 2024

    Beyond Point Prediction: Score Matching-based Pseudolikelihood Estimation of Neural Marked Spatio-Temporal Point Process

    Zichong Li, Qunzhi Xu, Zhenghao Xu, Yajun Mei, Tuo Zhao, Hongyuan Zha

  2. ICML 2023

    SMURF-THP: Score Matching-based Uncertainty Quantification for Transformer Hawkes Process

    Zichong Li, Yanbo Xu, Simiao Zuo, Haoming Jiang, Chao Zhang, Tuo Zhao, Hongyuan Zha

  3. ICDE 2023

    Efficient Deep Ensemble Inference via Query Difficulty-dependent Task Scheduling

    Zichong Li, Lan Zhang, Mu Yuan, Miaohui Song, Qi Song

  4. WWW 2023

    CoTel: Ontology-Neural Co-Enhanced Text Labeling

    Miaohui Song, Lan Zhang, Mu Yuan, Zichong Li, Qi Song, Yijun Liu, Guidong Zheng

  5. ICML 2020

    Transformer Hawkes Process

    Simiao Zuo, Haoming Jiang, Zichong Li, Tuo Zhao, Hongyuan Zha

    A standard method for neural temporal point processes — co-developed as an undergraduate.

  6. Software

    PRIMAL: A Linear Programming-based Sparse Learning Library in R and Python

    Qianli Shen*, Zichong Li*, Yujia Xie, Tuo Zhao

Education

Georgia Institute of Technology

Aug 2023 – Present · Atlanta, GA

Ph.D. in Machine Learning

Advisor: Prof. Tuo Zhao

University of Science and Technology of China

Rank 1 / 56 Sept 2020 – June 2023 · Hefei, China

M.S. in Data Science

Advisor: Prof. Lan Zhang

University of Science and Technology of China

Admitted at 14 Sept 2016 – June 2020 · Hefei, China

B.S. in Mathematics and Applied Mathematics · School of the Gifted Young

Entered university at 14 through USTC's selective early-entrance program; graduated at 18.