1 | 2025/9/3 | Introduction | slides |
2 | 2025/9/10 | Robot Kinematics | TBD |
3 | 2025/9/17 | Motion Planning, Task and Motion Planning | TBD |
4 | 2025/9/24 | Kinodynamic Motion planning, Trajectory Generation, Feedback Control | TBD |
5 | 2025/10/1 | Optimal Control | TBD |
6 | 2025/10/8 | Introduction of Reinforcement Learning, Imitation Learning | TBD |
7 | 2025/10/15 | Markov Decision Process, Policy Iteration and Value Iteration | TBD |
8 | 2025/10/22 | Monte Carlo, Temporal Difference and Monte Carlo Tree Search | TBD |
9 | 2025/10/29 | Model-free RL: Policy Gradient, Q learning, REINFORCE, Actor Critic | TBD |
10 | 2025/11/5 | On-policy DRL (PPO), Off-policy DRL (SAC), offline RL, RL finetuning | TBD |
11 | 2025/11/12 | Model-based RL | TBD |
12 | 2025/11/19 | Sim2real transfer, Real2Sim2Real Learning, Adaptation | TBD |
13 | 2025/11/26 | Intelligent exploration, Visual Imitation Learning | TBD |
14 | 2025/12/3 | Special topic: Bimanual Dexterous Manipulation | TBD |
15 | 2025/12/10 | Special topic: Loco-manipulation | TBD |