This repository provides an example implementation of transformer model training using a Databricks cluster with GPU-backed instances. Clone this repository as a Databricks Repo and follow the instructions in the included notebook.
marshackvb / horovod_transformers Goto Github PK
View Code? Open in Web Editor NEWAn example implementation of distributed training of transformer models on Databricks using Horovod and Petastorm.