This repository contains Keras implementation of the LAMB optimizer described in this article https://arxiv.org/abs/1904.00962 ( Reducing BERT Pre-Training Time from 3 Days to 76 Minutes )
dimakarp1996 / lamb-keras Goto Github PK
View Code? Open in Web Editor NEWKeras implementation of the LAMB optimizer