rokgerzelj / sophia Goto Github PK
View Code? Open in Web Editor NEWThis project forked from kyegomez/sophia
Effortless plugin and play to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
Home Page: https://discord.gg/qUtxnK2NMf
License: Apache License 2.0