I am a Ph.D. student at the Institute for Artificial Intelligence, Peking University. I am working under the supervision of Prof. Song-Chun Zhu and Prof. Yaodong Yang. Before that, I obtained my bachelor degree from the Department of Electronics and Information Engineering at Huazhong University of Science and Technology (HUST). My research interests include reinforcement learning, world model and their intersection with fundamental science. Please do not hesitate to reach out to me!
🔥 News
📝 Publications
Differentiable Information Enhanced Model-Based Reinforcement Learning
Xiaoyuan Zhang, Xinyan Cai, Bo Liu, Weidong Huang, Song-Chun Zhu, Siyuan Qi, Yaodong Yang
AAAI 2025 (Oral) [Paper]
Social World Model-Augmented Mechanism Design Policy Learning
Xiaoyuan Zhang* , Yizhe Huang*, Chengdong Ma, Zhixun Chen, Long Ma, Yali Du, Song-chun Zhu, Yaodong Yang, Xue Feng (* equal contribution)
NeurIPS 2025 [Paper]
World Models Should Prioritize the Unification of Physical and Social Dynamics
Xiaoyuan Zhang* , Chengdong Ma*, Yizhe Huang, Weidong Huang, Siyuan Qi, Song-Chun Zhu, Xue Feng, Yaodong Yang (* equal contribution)
NeurIPS 2025 Position Paper [Paper]
CivRealm: A learning and reasoning odyssey in Civilization for decision-making agents
Siyuan Qi, Shuo Chen, Yexin Li, Xiangyu Kong, Junqi Wang, Bangcheng Yang, Pring Wong, Yifan Zhong,Xiaoyuan Zhang, Zhaowei Zhang, Nian Liu, Wei Wang, Yaodong Yang, Song-Chun Zhu
ICLR 2024 (Spotlight) [Paper]
Off-Agent Trust Region Policy Optimization
Ruiqing Chen*, Xiaoyuan Zhang*, Yali Du, Yifan Zhong, Zheng Tian, Fanglei Sun, Yaodong Yang (* equal contribution)
IJCAI 2024 [Paper]
Enhancing LLM-Based Social Bot via an Adversarial Learning Framework
Fanqi Kong, Xiaoyuan Zhang, Xinyu Chen, Yaodong Yang, Song-Chun Zhu, Xue Feng
EMNLP 2025 (Oral) [Paper]
🎖 Honors and Awards
- Honour Bachelor (Top academic honor for graduates in HUST on outstanding academic performance)