## Winter 2014

Lecture notes will be linked to this web page, in PDF format. The reader for PDF files is available free from Adobe for UNIX, Apple Macintosh, and Windows.

### Schedule

 Lec. Date Topic Readings Slides To-do 1 Jan. 5 Introduction RN, Chapter 1 & 2 Slides 2 Jan. 7 Search (uninformed) RN, Chapter 3 Slides 3 Jan. 12 Search (informed) RN, Chapter 3 Slides 4 Jan. 14 Search (optimization) RN, Section 4.1 Slides Homework 1: (new version with correction posted Jan.19 9:45am, see yellow highlight on p.2) Instructions Sample code (save using extension .py instead of .txt) Readme file. 5 Jan. 19 Constraint satisfaction RN, Chapter 6 Slides 6 Jan. 21 Search (under uncertainty) RN, Sec. 4.2-4.5 Slides 7 Jan. 26 Game playing (Minimax) RN, Chapter 5 Slides Homework 1 due. 8 Jan. 28 Game playing (Monte-Carlo search trees) RN, Chapter 5 Slides 9 Feb. 2 Logical reasoning (propositional logic) RN, Chapter 7 Slides Homework 2: Instructions Change log: Minor modications to Q2 logical statements shown in yellow (Feb.5, 9:53) These are optional, you can use the original formulation, though this may yield a different solution; we will accept both. Base code Change log: Fixed solve_sudoku() call in sudoku.py (Feb.3) New error message for the human player (Feb.4, 15:14) 10 Feb. 4 Logical reasoning (first-order logic) RN, Chapters 8, 9 Slides Project code and instructions now available (Version 2 posted Mar.11, deals with infinite moves). 11 Feb. 9 Sequential logical reasoning (classical planning) RN, Chapter 10 Slides 12 Feb. 11 Probabilistic reasoning (basics) RN, Chapter 13 Slides Homework 2 due next day (Feb.12). 13 Feb. 16 Midterm Exam (CONFIRMED) Practice questions with some solutions. Old midterm. 14 Feb. 18 Probabilistic reasoning (Bayesian networks) RN, Sec. 14.1, 14.2, 14.4 Slides 15 Feb. 23 Probabilistic reasoning (Bayesian networks cont'd) RN, Sec. 14.1, 14.2, 14.4 Slides Homework 3: Instructions 16 Feb. 25 Learning probabilistic models with complete data RN, Sec. 20.1-20.2 (up to p.719) Slides Mar. 2 Study week. Mar. 4 Study week. 17 Mar. 9 Learning probabilistic models with missing data RN, Sec. 20.3 Slides Homework 3 due. 18 Mar. 11 Reasoning with temporal probabilistic models (HMMs) RN, Sec. 15.1-15.3 Slides Homework 4: Instructions (Ignore the last question.) 19 Mar. 16 Learning temporal probabilistic models (Baum-Welch) RN, Sec. 20.3 Slides 20 Mar. 18 Learning from examples RN, Chapter 18 Slides 21 Mar. 23 Reasoning with utilities RN, Chapter 16 Slides Homework 4 due. 22 Mar. 25 Learning utilities from exploration (Bandits) RN, Sec. 21.3 Slides 23 Mar. 30 Sequential reasoning (Markov Decision Processes) RN, Sec. 17.1 - 17.3 Slides Final project code due. Report due on Apr.1. See evaluation form. 24 Apr. 1 Sequential reasoning (Markov Decision Processes, cont'd) Slides Homework 5: Instructions Apr. 6 Easter Monday 25 Apr. 8 Learning sequential decisions (Reinforcement Learning) RN, Chapter 21 Slides Tutorial on problem solving with probabilistic models (Today: 4-6pm, MC103) 26 Apr. 13 Reasoning under uncertainty (POMDPs) / AI present and future RN, Sec. 17.4-5, Ch. 26, 27 Slides Homework 5 due. Apr.16 Final Exam (9am-12pm)