seekpoint,yuanke,github

accelerate

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

accelerate-deepspeed-test

Testing DeepSpeed integration in 🤗 Accelerate

annotated-transformer

An annotated implementation of the Transformer paper.

apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

autoTVM神经网络推理代码优化搜索演示，基于tvm编译开源模型centerface，并使用autoTVM搜索最优推理代码，　最终部署编译为c++代码，演示平台是cuda，可以是其他平台，例如树莓派，安卓手机，苹果手机．Thi is a demonstration of how to use autoTVM to search and optimize a neural network inference code. the main process of this program is , firstly use tvm to compile opensource model centerface , then use autotvm to auto search the best in

awesome-chinese-llm

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

bitsandbytes

8-bit CUDA functions for PyTorch

builder

Continuous builder and binary build scripts for pytorch

chatglm-6b

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

chatglm-rlhf-lora-rm-ppo

ChatGLM-6B添加了RLHF的实现，以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成，以及指定context推荐的RLHF的实现

chatglm2-6b

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

chatrwkv

ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

chinese-llama-alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

chinese-llama-alpaca-2

中文LLaMA-2 & Alpaca-2大语言模型 (Chinese LLaMA-2 & Alpaca-2 LLMs)

codegeex

CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)

colossalai

Making large AI models cheaper, faster and more accessible

cuda-samples

Samples for CUDA Developers which demonstrates features in CUDA Toolkit

cutlass

CUDA Templates for Linear Algebra Subroutines

datasets

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

deeplearningsystem

Deep Learning System core principles introduction.

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

deepspeed-mii

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

deepspeedexamples

Example models using DeepSpeed

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

dist_tuto.pth

Official code for "Writing Distributed Applications with PyTorch", PyTorch Tutorial

embedchain

The Open Source RAG framework

emscripten

Emscripten: An LLVM-to-WebAssembly Compiler

fastertransformer

Transformer related optimization, including BERT, GPT

fastgpt

FastGPT is a knowledge-based platform built on the LLM, offers out-of-the-box data processing and model invocation capabilities, allows for workflow orchestration through Flow visualization!

fastllm

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

seekpoint Goto Github PK

yuanke's Projects

Recommend Projects

Recommend Topics

Recommend Org