mard1no Goto Github PK

cv-cuda

CV-CUDA™ is an open-source, graphics processing unit (GPU)-accelerated library for cloud-scale image processing and computer vision.

data

A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.

datastruct

deeprec

DeepRec is a recommendation engine based on TensorFlow.

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

designpattern

C++11全套设计模式-23种指针的用法(a full DesignPattern implement with c++11)

di-engine

OpenDILab Decision AI Engine

dockerfiles

docs

Documentations for PaddlePaddle

dynolog

Dynolog is a telemetry daemon for performance monitoring and tracing. It exports metrics from different components in the system like the linux kernel, CPU, disks, Intel PT, GPUs etc. Dynolog also integrates with pytorch and can trigger traces for distributed training applications.

ece408

edgegpt

Reverse engineered API of Microsoft's Bing Chat AI

eetq

Easy and Efficient Quantization for Transformers

efficient-llms-survey

Efficient Large Language Models: A Survey

excalidraw

Virtual whiteboard for sketching hand-drawn like diagrams

fairring

Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large scales

fast_io

Significantly faster input/output for C++20

fastertransformer

Transformer related optimization, including BERT, GPT

fbgemm

FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/

fbtt-embedding

This is a Tensor Train based compression library to compress sparse embedding tables used in large-scale machine learning models such as recommendation and natural language processing. We showed this library can reduce the total model size by up to 100x in Facebook’s open sourced DLRM model while achieving same model quality. Our implementation is faster than the state-of-the-art implementations. Existing the state-of-the-art library also decompresses the whole embedding tables on the fly therefore they do not provide memory reduction during runtime of the training. Our library decompresses only the requested rows therefore can provide 10,000 times memory footprint reduction per embedding table. The library also includes a software cache to store a portion of the entries in the table in decompressed format for faster lookup and process.

flash-attention

flash-linear-attention

Fast implementations of causal linear attention for autogressive language modeling

flash_attention_inference

Performance of the C++ interface of flash attention, flash attention v2 and self decoding attention in large language model (LLM) inference scenarios.

flashinfer

FlashInfer: Kernel Library for LLM Serving

flexgen

Running large language models like OPT-175B/GPT-3 on a single GPU. Up to 100x faster than other offloading systems.

float8_experimental

This repository contains the experimental PyTorch native float8 training UX

fp6_llm

An efficient GPU support for LLM inference with 6-bit quantization (FP6).

free-programming-books

:books: Freely available programming books

fuser

A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")

gemma_pytorch

The official PyTorch implementation of Google's Gemma models