Statistical Learning Theory


09810CS 565300 -- Autumn 2009

Tuesday 13:10-15:00 & Thursday 13:10-14:00
234 CS Building


Home   Schedule   Projects   Resource

Schedule

Week Topics Matrials Assignments & Exams
1

9/15, 9/17		 Introduction

PRML Chapter 1, Chapter 2.5, Appendix C
Lecture notes and Matlab code: SLT09_Week01.zip
You need to install Netlab to run the demo programs

Difference versions of slides for PRML Chapters 1 and 2:
Professor Bishop: Ch1 and Ch2
INRIA PRML Reading Group: Ch1 and Ch2
Professor Mori: Ch1 and Ch2.5

Other notes:
  1. The Discipline of Machine Learning by Tom Mitchell
  2. Professor Tyng-Luh Liu's Probability Review
  3. Some useful notes from Stanford: Linear Algebra Review and Multivariate Gaussians
-
2

9/22, 9/24 		Linear Models for Regression Lecture notes and Matlab code: SLT09_Week02.zip

Difference versions of slides for PRML Chapter 3:
Professor Bishop: Ch3 and
INRIA PRML Reading Group: Ch3 and
Professor Mori: Ch3 and

Assignment 1 is out: (PDF) or (TeX)
Due Wednesday, October 7, at 11:59pm.
3

9/29, 10/1 		Instructor in Conference
Classes Cancelled		 - -
4

10/6, 10/8 		Linear Models for Regression Lecture notes and Matlab code: SLT09_Week04.zip
 -
5

10/13, 10/15		 Linear Models for Classification Lecture notes and Matlab code: SLT09_Week05.zip Assignment 2 is out: (PDF) or (TeX)
Due Monday, October 19, at 11:59pm.
6

10/20, 10/22		 Linear Models for Classification Lecture notes: SLT09_Week06.pdf -
7

10/27, 10/29		 Linear Models for Classification Lecture notes: SLT09_Week07.pdf Assignment 3 is out: ps3.zip
Due Monday, November 2, at 11:59pm.
8

11/3, 11/5		 Neural Networks Lecture notes: SLT09_Week08.pdf

I was asked about the relation between positive definite Hessian matrices and convex functions. Here is an informal proof. 		-
9

11/10, 11/12		 Kernel Methods Lecture notes: SLT09_Week09.pdf Assignment 4 is out: ps4.zip
Due Monday, November 23, at 11:59pm.
10

11/17, 11/19 		Gaussian Process, Sparse Kernel Machines Lecture notes: SLT09_Week10.pdf -
11

11/24, 11/26		 Sparse Kernel Machines Lecture notes: SLT09_Week11.pdf -
12

12/1, 11/3		 Sparse Kernel Machines Lecture notes: SLT09_Week12.pdf -
13

12/8, 12/10		 Sparse Kernel Machines Midterm Exam Solutions
Lecture notes: SLT09_Week13.pdf 		Assignment 5 is out: ps5.zip
Due Wednesday, December 16, at 11:59pm.
14

12/15, 12/17		 Mixture Models Lecture notes: SLT09_Week14.pdf -
15

12/22, 12/24		 Mixture Models and EM - Assignment 6 is out: ps6.zip
Due Wednesday, December 30, at 11:59pm.
16

12/29, 12/31		 Sampling Methods - -
17

1/5, 1/7		 Combining Models Professor Tyng-Luh Liu's Lecture Notes on Boosting, Decision Trees, and Random Forests -
18 Term Project Presentation
January 14		 Professor Tyng-Luh Liu's Lecture Notes on Manifold Learning -