thetechdude124/adam-optimization-from-scratch

📈Implementing the ADAM optimizer from the ground up with PyTorch and comparing its performance on six 3-D objective functions (each progressively more difficult to optimize) against SGD, AdaGrad, and RMSProp.

💡An Introduction.

Hey. I'm Aditya, and I'm an 18 year old senior at the enhanced program at the Woodlands Secondary School + The Knowledge Society alumni.

I'm an aspiring deep learning researcher working towards mastery both in the field and beyond. My mission is to leverage artificial intelligence to create tangible impact on difficult, real-world problems. Currently building better knowledge distillation methods to expand neural network reach in low-compute settings for those who need it most - accelerating ML impact on critical real-world problems in the 21st century.

Key goals: Producing groundbreaking, field-accelerating AI research. Changing the lives of one billion people by solving critical problems. Crafting high-standards, excellent work in all tasks and endeavours. Becoming the absolute best possible version of myself possible.

Check out my website (http://adityadewan.com/) and subscribe to my newsletter (linked on the site) for my full portfolio and resume.

Here's what I'm currently doing:

• Junior Machine Learning Developer at The Rounds, working on LLM R&D.
• Working on enhanced knowledge distillation methods (continuing my research from Team Canada-ISEF 2023).
• Founding the Woodlands Research Institute.

Most of my work is on Google Colab rather than GitHub. Feel free to check out my website, and let me know your thoughts!