Lectures

Lecture Date Topics Materials
1 2025/9/3 Introduction slides
2 2025/9/10 Robot Kinematics TBD
3 2025/9/17 Motion Planning, Task and Motion Planning TBD
4 2025/9/24 Kinodynamic Motion planning, Trajectory Generation, Feedback Control TBD
5 2025/10/1 Optimal Control TBD
6 2025/10/8 Introduction of Reinforcement Learning, Imitation Learning TBD
7 2025/10/15 Markov Decision Process, Policy Iteration and Value Iteration TBD
8 2025/10/22 Monte Carlo, Temporal Difference and Monte Carlo Tree Search TBD
9 2025/10/29 Model-free RL: Policy Gradient, Q learning, REINFORCE, Actor Critic TBD
10 2025/11/5 On-policy DRL (PPO), Off-policy DRL (SAC), offline RL, RL finetuning TBD
11 2025/11/12 Model-based RL TBD
12 2025/11/19 Sim2real transfer, Real2Sim2Real Learning, Adaptation TBD
13 2025/11/26 Intelligent exploration, Visual Imitation Learning TBD
14 2025/12/3 Special topic: Bimanual Dexterous Manipulation TBD
15 2025/12/10 Special topic: Loco-manipulation TBD