quentin-anthony Goto Github PK
Name: Quentin Anthony
Type: User
Company: The Ohio State University
Bio: High-Performance Deep Learning PhD student at OSU NOWLAB
Location: Columbus, OH
Name: Quentin Anthony
Type: User
Company: The Ohio State University
Bio: High-Performance Deep Learning PhD student at OSU NOWLAB
Location: Columbus, OH
CSE 6341 Au19 publicly available code
A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
BERT for Distributed PyTorch + AMP Training
Repo for climate deep learning codes
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Example models using DeepSpeed
Tensorflow/keras implementation for image transformation from low-resolution (LR) image to super-resolved one, including single wide-field (WF) image super-resolution prediction and SIM reconstruction.
A collection of easyconfig files that describe which software to build using which build options with EasyBuild.
A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.
Fast and memory-efficient exact attention
GRACE - GRAdient ComprEssion for distributed deep learning
HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of Merlin-KV is to store key-value feature-embeddings on high-bandwidth memory (HBM) of GPUs and in host memory. It also can be used as a generic key-value storage.
Distributed training framework for TensorFlow, Keras, PyTorch, and MXNet.
Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
IOR and mdtest
MAGMA - a GPT-style multimodal model that can understand any combination of images and language. NOTE: The freely available model from this repo is only a demo. For the latest multimodal and multilingual models from Aleph Alpha check out our website https://app.aleph-alpha.com
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Ongoing research training transformer language models at scale, including: BERT & GPT-2
minGPT in JAX
Machine Learning Engineering Open Book
Models and examples built with TensorFlow
The simplest, fastest repository for training/finetuning medium-sized GPTs.
NeMo: a toolkit for conversational AI
Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k communication volume which is asymptotically optimal) with the decentralized parallel Stochastic Gradient Descent (SGD) optimizer, and its convergence is proved theoretically and empirically.
Tensors and Dynamic neural networks in Python with strong GPU acceleration
A beautiful, simple, clean, and responsive Jekyll theme for academics
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.