cfsruiz/dat_bos_03

Data Science Course at GA Boston: 03

Welcome to the General Assembly Data Science Handout page. Here I'll be assembling handouts, walkthrough and links for everyone to have some references to follow-up after class.

####Final Project Details

Key Dates

• Feb 6: Project Presentations
• Feb 20: Data Review and Processing Presentations
• Last Day of Class: Final Presentations

###General Resources ####Books

• Python for Data Analysis
• Elements of Statistical Learning (great reference for the theory behind a lot of the techniques)
• Machine Learning For Hackers (R code examples and walkthroughs)

###Lesson 1: Introduction to Data Science & Basic Data Manipulation

####Slides

• Lesson 1 Slides

####Handouts

• Unix Basics: Intro to the Command Line

####Links

• How To Start Thinking Like a Data Scientist
• Data Science Workflow
• Video Tutorials for Command Line Basics
• Command Line Data Manipulation
• Git Tutorial from Atlassian
• Git Tutorial from CodeSchool

###Lesson 2: Data Storage and Extraction

####Slides

• Lesson 2 Slides

####Handouts

• MySQL Tutorial
• Introduction to Python
• Python Exercises

####Links

• Comparison of NoSQL Databases
• Interactive Python Tutorial
• Introduction to Python
• Python Data Structures

###Lesson 3: Python and Data Manipulation

####Handouts

• Python Exercises

####Links

• Introduction to Pandas

###Lesson 4: Data Visualization ####Assignment 1: Due Jan 9

####Handouts

• Pandas and Data Viz Notebook

####Slides

• Lesson 4 Slides

####Links

• Linear Algebra in 4 Pages
• Narrative Visualization: Telling Stories With Data
• Bokeh
• Vincent
• Python ggplot
• Matplotlib

Lesson 5: Introduction to Machine Learning

####Slides

• Lesson 5 Slides

####Handouts

• Sklearn and KNearest Neighbors

####Links

• Scikits-learn User Guide
• A Few Useful Things to Know About Machine Learning

Lesson 6: Linear Regression

####Assignment 1: Due Jan 24 ####Slides

• Lesson 6 Slides

####Handouts

• Linear Regression

####Links

• A Few Useful Things to Know About Machine Learning
• Statsmodels Documentation
• Python 538 Model

Lesson 7: Logistic Regression and Regularization

####Slides

• Lesson 7 Slides

####Links

• Logistic Regression Walkthrough
• Logistic Regression w/ Statsmodel - Well Switching in Bangledesh
• Odds Ratio Explanation
• Fast Logistic Regression: Mahout
• Fast Logistic Regression: Vowpal Wabbit
• Fast Logistic Regression: LIBLINEAR

Lesson 8: Naive Bayes and Bayesian Estimators

Slides

• Lesson 8 Slides

Exercise

• Naive Bayes Implementation

####Links

• Insult Detection Kaggle Submission
• Holy Trinity of Bayesian Estimation
• History of Bayes
• Mathematical Exploration of Bayes Theorem
• Naive Bayes v. Logistic Regression

Lesson 9: Decision Trees and Random Forests

####Slides

• Lesson 9 Slides

####Handouts

• Random Forest on Text Data

Links

• Random Forests in Python
• Random Forests for Kaggle
• Random Forests and Performance Metrics

Lesson 10: Classification Review

####Slides

• Lesson 10 - Review Slides

####Handouts

• In Class Review

####Links

• Choosing a ML Classifier
• Machine Learning Cheat Sheet for Sklearn

Lesson 11: Ensemble Learning

####Slides

• Lesson 11 - Ensemble Learning
• Lesson 11 - K Means

####Handouts

• Random Forest on Text Data

####Links

• [KMeans IPython Notebook] (http://nbviewer.ipython.org/urls/raw.github.com/temporaer/tutorial_ml_gkbionics/master/2%2520-%2520KMeans.ipynb)
• Text Clustering in Sklearn
• Cloudera ML KMeans

Lesson 12: K-Means Clustering

Exercise

• [K Means Clustering Implementation] (https://github.com/arahuja/GADS7/tree/master/src/lesson12/kmeans)

Lesson 13: PCA and Unsupervised Learning

####Slides

• Lesson 13 - PCA and SVD

###Links

• A Tutorial on PCA
• Stanford PCA Tutorial

Lesson 14: Recommendation Systems

• Lesson 14 - RecSys

Links

• Walkthrough of Hulu's Recommendation System
• Xavier Amatriain @ Netflix
• Yhat Beer Recommendation
• Mendeley RecSys
• Crab RecSys

Exercise

• Recommendation Exercises

Lesson 15: Further Topics in Unsupervised Learning

####Slides

• Lesson 15: More Unsupervised Learning

####Links

• LDA from EChen Blog
• Denoising Autoencoders in Theano
• Deep Learning Reading List

Lesson 16: Hadoop

####Slides

• Lesson 16: Hadoop

Handouts

• Installing Hadoop
• Hadoop and Data Processing

Links

• Yahoo Hadoop Tutorial
• Hadoop and Pig at Twitter
• MapReduce Use Cases
• Hadoop Streaming in Python

Lesson 17: Distributed Data Processing

####Slides

• Lesson 17: Spark

Handouts

• Spark on EC2

Links

• Spark Examples
• Ampcamp Slides and Exercises
• Spark is a Crossover Hit For Data Scientists

Readings

• Machine Learning at Scale at Collective
• Ad Click Prediction: a View from the Trenches at Google
• A Few Useful Things to Know About Machine Learning

Lesson 18/19: Distributed Data Processing

Links

• Sketching Data Structures
• Probabilistic Data Structures for Web Analytics and Data Mining
• Streaming Algorithms and Sketches
• Fast, Cheap, and 98% Right: Cardinality Estimation for Big Data
• Algebra for Analytics