garlguo Goto Github PK

amagold

cd-grab

CD-GraB is a distributed gradient balancing framework that aims to find distributed data permutation with provably better convergence guarantees than Distributed Random Reshuffling (D-RR). https://arxiv.org/pdf/2302.00845.pdf.

chocosgd

Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356

deblurgan

Image Deblurring using Generative Adversarial Networks

deeplearning-500-questions

深度学习500问，以问答形式对常用的概率知识、线性代数、机器学习、深度学习、计算机视觉等热点问题进行阐述，以帮助自己及有需要的读者。 全书分为18个章节，50余万字。由于水平有限，书中不妥之处恳请广大读者批评指正。 未完待续............ 如有意合作，联系[email protected] 版权所有，违权必究 Tan 2018.06

grab

Source code for the GraB paper.

homophilic_directed_scalefree_networks

Inequalities in Homophilic Directed ScaleFree Networks

htorch

librarydatacenter

This is my group project for creating a distributed library datacenter on MongoDB, Redis, and Hadoop Distributed File System for Distributed Database Systems course on my study-away program in Tsinghua University

mezo

MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333

optimization_and_sampling_for_bayesian_inference

Adaptive MCMC and CMA-ES Python code

pathways

pyhessian

PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks

pytorch-optimizer

torch-optimizer -- collection of optimizers for Pytorch

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

quest

Turn-based RPG adventure game implemented in OCaml & Python NumPy (Python codes not uploaded)

ranking_with_slot_constraints

ranking_with_slot_constraints_rebuttal

sensitivesparsezo

shogun

Shōgun

shrinkbench

PyTorch library to facilitate development and standardized evaluation of neural network pruning methods.

statistical-learning-methods

Implement Statistical Learning Methods, Li Hang the hard way. 李航《统计学习方法》一书的硬核 Python 实现

text_similarity

Text Similarity

transformers-arithmetic

transformers-language-modeling

Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3

transformers-nlp

Transformer Models in NLP

wentao-homepage