Date	Topic	Reading	Items due
week 1 (Tue: 01/27)	Syllabus   Logistics   AI overview: goals, history, progress, challenges   Lecture Slides 1   Small Assignment#1 (short essay)
week 1 (Thur: 01/29)	Intelligent Agents and Environments   Lecture Slides 2   Small Assignment#2	Reading:	Small Assignment#2 (due by 01/29)
week 2 (Tue: 02/03)	Structure of Intelligent Agent   Implementing a Simple Agent on a 2D map   Lecture Slides 3	Reading:	Small Assignment#1 (due by 02/03)
week 2 (Thur: 02/05)	Posing AI problem solving as search   Lecture Slides 4   Project Assignment#1 (released on 02/05)	Reading:
week 3 (Tue: 02/10)	Search algorithms to solve AI problems   Blind Search: BFS, DFS   Lecture Slides 5   Small Assignment#3	Reading:	Small Assignment#3 (due on 02/10)
week 3 (Thur: 02/12)	Blind Search: IDS   Blind Search: BFS and DFS implementation issues   Lecture Slides 6	Reading:	Project Assignment#1 (due on 02/12)
week 4 (Tue: 02/17)	Blind Search: BFS and DFS implementation for mapbot   Blind Search: Analysis of BFS   Lecture Slides 7   Project Assignment#2 (released on 02/17)	Reading:
week 4 (Thur: 02/19)	Blind Search: Analysis of DFS and IDS   Blind Search: Uniform Cost Search (UCS)   Lecture Slides 8	Reading:
Week 5 (Tue: 02/24)	Informed Search: Greedy Best-First Search   Informed Search: A* Search   Lecture Slides 9   Small Assignment#4	Reading:	Small Assignment#4 (due on 02/24)
week 5 (Thur: 02/26)	Local Search   Local Search: Hill-Climbing (Steepest Ascent and Steepest Descent)   Lecture Slides 10	Reading:	Project Assignment#2 (due on 02/26)
week 6 (Tue: 03/03)	Local search: Random Restart   Local search: Local Beam Search   Local search: Simulated Annealing   Local search: Genetic Algorithm   Lecture Slides 11   Project Assignment#3 (released on 03/03)	Reading:
week 6 (Thur: 03/05)	Adversarial Search   Minimax Algorithm   Lecture Slides 12   Small Assignment#5	Reading:	Small Assignment#5 (due on 03/05)
week 7 (Tue: 03/10)	Adversarial Search   α-β Pruning   Lecture Slides 13   Small Assignment#6	Reading:	Small Assignment#6 (due on 03/11)   Project Assignment#3 (extended: due on 03/12)
week 7 (Thur: 03/12)	Midterm Exam#1 (paper-based in-class exam)		Midterm Exam (due on 03/12)
week 8 (Tue: 03/17)	Spring Break (classes do not meet)
week 8 (Thur: 03/19)	Spring Break (classes do not meet)
week 9 (Tue: 03/24)	Adversarial Search   α-β Pruning Implementation   Lecture Slides 14   Small Assignment#7	Reading:
week 9 (Thur: 03/26)	Constraint Satisfaction Problem (CSP)   Midterm exam review   Lecture Slides 15   Small Assignment#8   Project Assignment#4 (released on 03/26)	Reading:	Small Assignment#8 (due on 03/26)
week 10 (Tue: 03/31)	Backtracking Search for CSP   Introduction to Reinforcement Learning (RL)   Lecture Slides 16   Lecture Slides 17a	Reading:   An overview of Reinforcement Learning - Sutton & Barto'2020
week 10 (Thur: 04/02)	Introduction to Reinforcement Learning (continued)   Lecture Slides 17b	Reading:   Pi-0.5: A Vision-Language-Action (VLA) Model - Physical Intelligence'2025
week 11 (Tue: 04/07)	Markov Decision Process (MDP)   Lecture Slides 18   Small Assignment#9: familiarizing with Gymnasium framework	Reading:   Gymnasium Framework Environments	Project Assignment#4 (due on 04/07)
week 11 (Thur: 04/09)	Dice Game: A Simple 2 State MDP   Value Iteration Algorithm (on simple MDP)   Lecture Slides 19   Notebook: value iteration algorithm for a simple dice game	Reading:   Value Iteration Algorithm - Sutton & Barto	Small Assignment#9 (due on 04/10)
week 12 (Tue: 04/14)	Value Iteration Algorithm (on complex MDP)   Lecture Slides 20   Project Assignment#5 (released on 04/14)	Reading:   Value Iteration Algorithm - Sutton & Barto
week 12 (Thur: 04/16)	Policy Iteration Algorithm   Lecture Slides 21   Notebook: policy iteration algorithm on a simple dice game	Reading:   Policy Iteration Algorithm - Sutton & Barto	Project Assignment#5 (due on 04/21)
week 13 (Tue: 04/21)	Model-Based Reinforcement Learning   Model-Free Reinforcement Learning   Temporal Difference Learning   Q-Learning   Lecture Slides 22	Reading:   Temporal Difference Learning - Sutton & Barto
week 13 (Thur: 04/23)	Q-Learning (implementation)   Lecture Slides 23	Reading:   Q-Learning - Sutton & Barto	Small Assignment#10 (due on 04/28)
week 14 (Tue: 04/28)	Discrete Probability Distribution   Joint Probability Distribution   Marginal Probability Distribution   Conditional Probability Distribution   Lecture Slides 24	Reading:   Q-Learning Algorithm - Sutton & Barto
week 13 (Thur: 04/30)	Bayes' Rule   Application of Bayes' Rule   Lecture Slides 25   Small Assignment#11: Bayes' rule activity	Reading:	Small Assignment#11 (due on 05/03)
Week 16 (Wed: 05/13)	Final Exam   Wednesday, 5/13/2026   12:00 PM - 1:50 PM   Science Connector Building, SCB 0101	Reading: