huanglk Goto Github PK

bigscience

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

cs224n-winter-2017

All lecture notes, slides and assignments from CS224n: Natural Language Processing with Deep Learning class by Stanford

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

leeroy

一个基于pytorch-lightning和huggingface的NLP模型训练框架。

lightning-transformers

Flexible components pairing 🤗 Transformers with Pytorch Lightning

lm_dataformat

nebullvm

Plug and play modules to optimize the performances of your AI systems 🚀

open-assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

transpeeder

train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism

trlx

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)