IS517: Methods of Data Science

Time: Tuesdays, 9:00 AM – 11:50 AM Location: 46 Sch of Info Sciences Bldg

Course Overview

Modern computing has opened up powerful new approaches to statistical modeling and analysis, which together form the methodological core of data science. This course surveys techniques for both predictive and descriptive learning, drawing on ideas from statistics, computer science, and artificial intelligence. A central theme is predictive modeling: fitting models to data in order to predict future outcomes. On the regression side, we study linear models — including modern approaches for working with large numbers of variables — together with smoothing techniques, additive models, and local regression. For classification, we cover logistic regression, regularization, discriminant analysis, splines, support vector machines, generalized additive models, naive Bayes, mixture models, and nearest-neighbor methods as time permits. Throughout the semester, each method is placed within the broader "data science lifecycle" — the set of practices through which scientific findings are discovered and communicated.

The course moves at a brisk pace and emphasizes hands-on computing exercises using Python and other relevant languages.


Regression Classification Regularization SVMs Unsupervised Learning Deep Learning

Class Project

This is a group project. Ideally, every group should have two students. If this is not possible, please discuss with the instructor.

The project proposal will describe the proposed dataset(s), the original research question(s), and the proposed method of solution. This will likely be the novel application of a regression or classification technique from class. It is at most one page in length.

The final project will carry out the research in the proposal. There will be a project proposal presentation describing the research question(s), dataset(s), method, and possibly the expected results. There will be a final project presentation describing the research question(s), dataset(s), method, and comparing the expected and actual results.

Schedule

Week Date Topic Readings Materials
1Aug 26Syllabus + Data Science Intro [Slides] [Code] [Assignment]
2Sep 2ClassificationISL Ch. 4, PML Ch. 3 [Slides] [Code] [Assignment]
3Sep 9Linear RegressionISL Ch. 3, PML Ch. 10 [Slides] [Code] [Assignment]
4Sep 16ResamplingISL Ch. 5, PML Chs. 4 and 6 [Slides] [Code] [Assignment]
5Sep 23Tree-Based MethodsISL Ch. 8, PML Ch. 3 [Slides] [Code] [Assignment]
6Sep 30Support Vector MachinesISL Ch. 9, PML Ch. 3 [Slides] [Code] [Assignment]
7Oct 7Non-Linear Models for RegressionISL Ch. 7, PML Ch. 10 [Slides] [Code] [Assignment]
8Oct 14Project Proposal Presentations [Schedule]
10Oct 28Unsupervised Learning 1ISL Ch. 10, PML Chs. 4 and 5 [Slides] [Code] [Assignment]
11Nov 4Unsupervised Learning 2ISL Ch. 10, PML Ch. 5 [Slides] [Code] [Assignment]
12Nov 11Deep LearningPML Chs. 12 and 13 [Slides] [Code] [Assignment]
13Nov 18Final Project Presentations (In-person) [Schedule]
14Dec 2Final Project Presentations (Online) [Schedule]
15Dec 9Final Project Report Due