This project is to build optimization techniques from scratch for Linear models The notebook features building a classifier based on synthetic data and optimzation techniques like
- Gradient descent
- Stochastic Gradient descent
- Stochastic Gradient descent with Momentum
- RMSprop