Lei Zhang's Projects
A scalable & efficient active learning/data selection system for everyone.
Training and serving large-scale neural networks with auto parallelization.
Instruct-tune LLaMA on consumer hardware
Applied AI experiments and examples for PyTorch
This repo includes ChatGPT prompt curation to use ChatGPT better.
A curated list of research in machine learning systems (MLSys). Paper notes are also provided.
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.
Repository of helm charts for deploying DataHub on a Kubernetes cluster
Enhance Your English Writing
Spatial-Temporal Federated Learning for Lifelong Person Re-identification on Distributed Edges. (FedSTIL)
This is an official Tensorflow-2 implementation of Federated Continual Learning with Inter-Client Weighted Transfer
InternLM has open-sourced a 7 billion parameter base model, a chat model tailored for practical scenarios and the training system.
Efficient Triton Kernels for LLM Training
Large Language Model (LLM) Systems Paper List
The examples and use cases about Kafka, Spark, Flink, SpringBoot, etc. 组件及框架使用实例
Ryan's blog for study & personal resources review. 技术栈文档
MLE-Agent is designed to be a pair agent for machine learning engineers or researchers
DeepSpeed+Ray based LLaMA2 SFT/RLHF training framework
《Machine Learning Systems: Design and Implementation》- Chinese Version
High-availably monitor for Apache Kudu by Prometheus
Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
Ring attention implementation with flash attention
Person re-identification datasets across time & space for federated continual learning.
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
Scene recognition tool based on pytorch. Provide training, test and deployment functions, as well as many pretrained models.
A native PyTorch Library for large model training