jackyan540/cs181-homework2

Spring 2021 Machine Learning (CS 181) Homework 2

cs181-homework2

Spring 2021 Machine Learning (CS 181) Homework 2

Problem Topics

Solutions contained in the personal-solutions folder

1. Exploring the Bias-Variance Tradeoff
2. Maximum Likelihood Estimation in Classification (for a generative K-class model)
3. Comparing 4 different classifiers: (1) softmax regression, (2) generative classifier with a shared covariance matrix, (3) generative classifier with a separate covariance matrix, and (4) kNN classifier

---

Code

Implementation contained in the code folder

problem1-Gradient-Descent.py

• Using gradient descent, fits a sigmoid logistic regression model for three different bases

T2_P3.py

• Controller file that tests the implementation for the 4 different classifiers
• The classifier implementations are contained in T2_P3_LogisticRegression.py, T2_P3_GaussianGenerativeModel.py, and T2_P3_KNNModel.py