Some lecture notes will be linked to this web page, in PDF format. The reader for PDF files is available free from Adobe for UNIX, Apple Macintosh, and Windows.

Lec. |
Date |
Topic |
Lecture Material |
Homeworks and Readings |

Introduction to machine learning. |
Slides | Read this paper. Review basic notions of algebra and probabilities. Suggested readings: Ch.1-2 of Bishop, Ch.1 of Hastie et al., Ch.2 of Shalev-Schwartz et al. |
||

Linear regression. |
Slides | Suggested readings: Ch.2 (Sec.2.1-2.4, 2.9) of Hastie et al. Ch.3 of Bishop (Sec.3.1-3.2) Ch.9 of Shalev-Schwartz |
||

Linear regression. |
Slides Mini-project #1 now available. |
Suggested readings: Ch.3 (Sec.3.1-3.4, 3.9) of Hastie et al. Ch.3 of Bishop (Sec.3.1-3.2). Ch.5 and 11 of Shalev-Schwartz |
||

Linear classification. |
Slides | Suggested readings: Ch.4 of Hastie et al. Ch.4 of Bishop (Sec.4.1-4.3). Sec.9.3 of Shalev-Schwartz |
||

Linear classification (cont'd) |
Slides | Suggested readings: Sec. 6.6.3 of Hastie et al. Ch.4 of Bishop (Sec.4.1-4.3). Sec.24.1-24.3 Shalev-Schwartz A paper by Ng & Jordan (NIPS, 2001). Ch.13 (Sec.13.1-13.4) of the book Introduction to Information Retrieval. |
||

Performance analysis and error estimation. |
Slides | Suggested readings: Ch.7 of Hastie et al. Wagstaff (2012) paper |
||

Practical session with python and scikit-learn. |
Slides Notebook from the session Mini-project #1 due. |
|||

Decision trees |
Slides Mini-project #2 now available. |
Suggested readings: Sec.14.4 of Bishop. Sec.9.2 of Hastie et al. |
||

Instance-based learning |
Slides | Suggested readings: Sec.2.5 of Bishop. Sec.13.3 of Hastie et al. Ch.19 of Shalev-Schwartz |
||

Ensemble methods |
Slides | Suggested readings: Sec.8.7, Ch.10 of Hastie et al. Ch.14 of Bishop Ch.10 of Shalev-Schwartz |
||

Support vector machines |
Slides | Suggested readings: Ch.7 of Bishop. Ch.12 (Sec.12.1-12.4) of Hastie et al. Ch.15 of Shalev-Schwartz For more on convex optimization: see book by S. Boyd and L. Vandenberghe |
||

Support vector machines (cont'd) |
Slides | |||

Feature construction and selection |
Slides Mini-project #2 due. |
|||

Unsupervised learning |
Slides Mini-project #3 now available. |
|||

Neural networks |
Slides | Suggested readings Ch.11 of Hastie et al. Ch.5 of Bishop Ch.14 of Shalev-Schwartz |
||

Neural networks (cont'd) |
Slides | |||

Deep learning |
Slides | |||

Deep learning + Tutorial |
Slides Theano tutorial |
|||

Problem solving session |
Mini-project #3 due. | |||

Online / streaming data |
Slides Mini-project #4 now available. |
|||

Parallelization for large-scale ML |
Slides | |||

Midterm (confirmed). |
||||

Semi-supervised learning |
Slides | |||

Missing data. |
Slides | |||

Final project presentation session |
||||

Wrap-up |
Slides Final project report due Dec.11 (11:59pm) on CMT Track #4. |