Table of contents

  1. About the Course
  2. Prerequisites
  3. Textbooks
  4. Logistics
    1. Homeworks
    2. Project
  5. Disability Accommodations & Emergencies
  6. This is not a usual semester.

About the Course

This advanced-topic course studies the roles of perception, learning, and control in the context of designing autonomous robotic systems under various levels of modeling certainty/uncertainty for either the agents or the environment. We will provide an overview of fundamental tools and methods from control, learning, and vision and try to delineate how these methods should be integrated as a “closed loop” in several representative robotic systems/scenarios for navigation, locomotion, manipulation, and human/machine interaction. The goal of the course is to survey cutting-edge practice in robotics and identify new challenges and opportunities of interdisciplinary research for next-generation intelligent robots.


Undergraduate linear algebra (Math 110), statistics (Stat 134), and probability (EE126). Background in signal processing (EE123), optimization (EE 227), machine learning (CS189/289), and computer vision (CS 280) may allow you to appreciate better certain aspects of the course material, but not necessary all at once. The course is open to senior undergraduates, with consent from the instructor. If you’re curious about whether you would benefit from this course, contact the instructor for details.


J. Wright and Y. Ma, High Dimensional Data Analysis with Low Dimensional Models: Principles, Computation and Applications, Cambridge University Press, 2021.


The course will be graded based on class participation (10%), homework (50%) and a course project (40%).


There will be about 4 or 5 bi-weekly homeworks for the first 10 weeks. Each homework contains both a written part and a programming part.


For the course project, you can work on a topic of your choice – experimental, theoretical, or a combination of both. Be creative! The topic should be closely related to the course material, and each team need to submit a midterm project proposal and give a 10 min presentation. The proposal and presentation should show adequate literature survey on related topics, provide good motivations and even preliminary results to support the ideas. You may work alone, or in a team of 2-3 students. For teams of 3, you will be expected to document who did what. Your deliverables will be a short (15 min) talk during the final exam week and a 8-page conference paper style project report. If you did experimental work, you will also need to submit your code

Disability Accommodations & Emergencies

If you need disability-related accommodations in this class, please inform us immediately. Please see the professors or Simon privately after class or send us an email.

This is not a usual semester.

We understand that this semester will have its unique challenges. We are here to support you throughout the semester, both as students and as people. Life happens, and we want to make sure you are still receiving a quality education despite the current state of the world. Please communicate with us if you are experiencing extenuating circumstances and need extra support. We’re here for you.