CloseHelpPrint
Kies de Nederlandse taal
Course module: 202200112
202200112
AI for Autonomous Robots: Deep Learning and Reinforcement Learning
Course info
Course module202200112
Credits (ECTS)5
Course typeCourse
Language of instructionEnglish
Contact personprof.dr.ing. F.C. Nex
E-mailf.nex@utwente.nl
Lecturer(s)
Examiner
dr. J.R. Bergado
Examiner
prof.dr.ing. F.C. Nex
Contactperson for the course
prof.dr.ing. F.C. Nex
Examiner
Dr. habil. Y. Yang
Academic year2022
Starting block
2B
Application procedureYou apply via OSIRIS Student
Registration using OSIRISYes
Aims
After the successful completion of the course, the student:
  • Design, develop, test and evaluate deep learning algorithms for different tasks of autonomous robots
  • Design, develop, test and evaluate reinforcement learning algorithms for different tasks of autonomous robots
  • Experiment on how to design and embed these algorithms on on-board units hosted on the robot and extract real-time information for the autonomous deployment of the robot.
Content
This course will discuss the principles of deep learning and reinforcement learning. It will introduce the use of Convolutional Neural Network (CNN) architectures with specific regard to supervised, semi-supervised, and unsupervised training techniques. Semantic segmentation of images (2D) and point clouds (3D) using deep learning algorithms as well as object detection and tracking using deep learning algorithms from images will be debated as specific applications. The potential of Visual SLAM, stereo and single-image 3D reconstruction using deep learning will be discussed too, with specific regard to their use in collision avoidance and autonomous navigation. The strategies on how to embed and optimize these algorithms on onboard units for their real-time deployment will be given. This course will also introduce the classic reinforcement learning algorithms, which employ a system of rewards and penalties to compel the autonomous robot to solve a problem by itself. In particular, Markov Decision Process and Q-learning and their applications in autonomous navigation will be presented.
Participating study
Master Robotics
Participating study
Master Interaction Technology
Required materials
-
Recommended materials
Book
Multimodal Scene Understanding: Algorithms, Applications and Deep Learning, Elsevier, 2019. ISBN 978-0-12-817358-9
Book
Advanced Methods and Deep Learning in Computer Vision, Elsevier, 2021. ISBN 9780128221495
Instructional modes
Assessment
Presence dutyYes

Assignment
Presence dutyYes

Lecture

Practical

Presentation(s)

Self study with assistance

Self study without assistance

Tutorial

Tests
Oral exam, Group assignment

CloseHelpPrint
Kies de Nederlandse taal