Bio: Shiyu Zhao is currently an Associate Professor at the School of Engineering at Westlake University and the Director of the Intelligent Unmanned Systems Laboratory. His research interests lie in the theories of estimation, control, and reinforcement learning and their applications to intelligent robotic systems especially multi-robot systems and micro aerial vehicles. He is currently an Associate Editor for the journals of IEEE Robotics and Automation Letters and Unmanned Systems. He also serves as an Associate Editor for many international conferences such as IEEE ICRA, IROS, CDC, ACC, ICCA, and ICUAS. He is a member of the IEEE Control Systems Society Conference Editorial Board Committee. He was the UK Regional Chair of ICCA2018 and Program Chair of ICCA2019. His new textbook "Mathematical Foundations of Reinforcement Learning" will be jointly published by Tsinghua University Press and Springer Nature Press in 2024.
Shiyu Zhao received his BE and ME degrees from Beijing University of Aeronautics and Astronautics in 2006 and 2009, respectively. He got his PhD degree in Electrical Engineering from the National University of Singapore in 2014. He was a postdoc researcher at the Technion - Israel Institute of Technology and University of California, Riverside from 2014 to 2016. In 2016, he became a Lecturer in Aerospace Systems in the Department of Automatic Control at the University of Sheffield, UK. He joined Westlake University in 2019.
(Sep 2023) AE for IEEE-RAL: I recently became an Associate Editor for IEEE Robotics and Automation Letters. This journal has a very efficient and high-standard reviewing process. High-quality robotics-related submissions are welcome.
(Sep 2023) 1000+ stars: My textbook "Mathematical foundation of reinforcement learning" has received more than 1000 stars in GitHub.
(Aug 2023) Textbook major update: The second version of the draft of my textbook "Mathematical foundation of reinforcement learning" is online now!! Compared to the first version, which was online one year ago, the second version has been improved in various ways. It is almost the same as the printed version. See the GitHub page for details.
(Jun 2023) Nature Communications: Our recent research work entitled "Mean-shift exploration in shape assembly of robot swarms" has been published by Nature Communications: https://www.nature.com/articles/s41467-023-39251-5 (June, 2023)
(Dec 2022) Lecture videos: My new lecture videos and slides on the course "Mathematical Foundations of Reinforcement Learning" are online now. For the videos (in Chinese), please check: https://space.bilibili.com/2044042934
(Aug 2022) Textbook: My new textbook (draft) entitled "Mathematical Foundations of Reinforcement Learning" is online now. The GitHub homepage of this book is here. This book aims to provide a mathematical but friendly introduction to the fundamental concepts, basic problems, and classical algorithms in reinforcement learning.