I am a PhD student in ShanghaiTech University under the supervision of Prof. Ye Shi, who is an expert in the field of nonconvex optimization. My research interest includes reinforcement learning, diffusion models, constrained optimization and implicit models (e.g, deep equilibrium model and neural ode).

🔥 News

• 2024.07: I received the Outstanding Teaching Assistant Award in ShanghaiTech University!
• 2024.05: One paper accepted by ICML 2024!
• 2023.12: I gave a talk “Reduced Policy Optimization for Continuous Control with Hard Constraints” in the seminar of RLChina!
• 2023.12: I received the Outstanding Student Award in ShanghaiTech University!
• 2023.09: Two papers accepted by NeurIPS 2023!

📝 Publications

Arxiv Preprint

Diffusion-based Reinforcement Learning via Q-weighted Variational Policy Optimization

Shutong Ding, Ke Hu, Zhenhao Zhang, Kan Ren, Weinan Zhang, Jingyi Yu, Jingya Wang, Ye Shi

[paper] [project]

ICML 2024 Poster

Guidance with Spherical Gaussian Constraint for Conditional Diffusion

Lingxiao Yang, Shutong Ding, Yifan Cai, Jingyi Yu, Jingya Wang, Ye Shi

[paper] [project]

NeurIPS 2024 Poster

Reduced Policy Optimization for Continuous Control with Hard Constraints

Shutong Ding, Jingya Wang, Yali Du, Ye Shi

[paper] [project]

NeurIPS 2023 Poster

Two Sides of The Same Coin: Bridging Deep Equilibrium Models and Neural ODEs via Homotopy Continuation

Shutong Ding, Tianyu Cui, Jingya Wang, Ye Shi

[paper] [project]

🎖 Honors and Awards

• 2024.07, Outstanding Teaching Assistant Award in ShanghaiTech University
• 2023.12, Outstanding Student Award in ShanghaiTech University
• 2023.11, NeurIPS 2023 Scholar Award
• 2021.06, Outstanding Graduates of Fuzhou University
• 2020.11, Lan Qiao Cup: Python Programming National Finals First Prize (Rank 9 in China)
• 2019.08, Robotics Workshop in University of Florida, “BEST TEAM” Award (As the captain)
• 2019.05, ACM Silver Award (Fujian Province)

📖 Educations

• 2021.09 - present, ShanghaiTech University, Shanghai.
• 2017.09 - 2021.06, Fuzhou University, Fuzhou.

💼 Services

• Reviewer: CVPR 2024, NIPS 2024
• Teaching Assistant: Convex Optimization [SI251] (2022 Autumn, 2024 Spring) in ShanghaiTech University

💬 Invited Talks

• 2023.12, Reduced Policy Optimization for Continuous Control with Hard Constraints, RLChina.