threadreaper / gpt-neo Goto Github PK
View Code? Open in Web Editor NEWThis project forked from eleutherai/gpt-neo
An implementation of model parallel GPT2& GPT3-like models, with the ability to scale up to full GPT3 sizes (and possibly more!), using the mesh-tensorflow library.
Home Page: https://www.eleuther.ai
License: MIT License