wm901115nwpu Goto Github PK

apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

awesome-latex-drawing

Drawing Bayesian networks, graphical models, and technical frameworks in LaTeX.

awesome-llm

Awesome-LLM: a curated list of Large Language Model

awesome-llm-compression

Awesome LLM compression research papers and tools.

awesome-llm-inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

beamertheme

Define a simple beamer theme

clrspython

cuda-programming-guide-in-chinese

This is a Chinese translation of the CUDA programming guide

deeplearningsystem

Deep Learning System core principles introduction.

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

deepspeed-mii

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

deepspeedexamples

Example models using DeepSpeed

depyf

depyf is a tool to help you understand and adapt to PyTorch compiler torch.compile.

flash-attention

Fast and memory-efficient exact attention

intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

iree

A retargetable MLIR-based machine learning compiler and runtime toolkit.

learn_pytorch2.0

leetcode

LeetCode Problems' Solutions

libtree

ldd as a tree

llama-factory

Unify Efficient Fine-tuning of 100+ LLMs

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

mamba

megatron-lm

Ongoing research training transformer models at scale

mmcv

OpenMMLab Computer Vision Foundation

mmdeploy

OpenMMLab Model Deployment Framework

mmengine

OpenMMLab Foundational Library for Training Deep Learning Models

mmrazor

OpenMMLab Model Compression Toolbox and Benchmark.

nemo

NeMo: a framework for generative AI

neural-compressor

Provide unified APIs for SOTA model compression techniques, such as low precision (INT8/INT4/FP4/NF4) quantization, sparsity, pruning, and knowledge distillation on mainstream AI frameworks such as TensorFlow, PyTorch, and ONNX Runtime.

nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers