Jiatao Gu's Projects
rllab is a framework for developing and evaluating reinforcement learning algorithms, fully compatible with OpenAI Gym.
Recurrent Neural Network library for Torch7's nn
The official implementation of Autoregressive Image Generation using Residual Quantization (CVPR '22)
Topic analysis using RSM or PVDM.
RWKV-2 is a RNN with transformer-level performance. It can be directly trained like a GPT transformer (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)
Search Engine Guided Non-Parametric Neural Machine Translation
A general-purpose encoder-decoder framework for Tensorflow
Bypassing the Black-Box Operation with Evolutionary Synthetic Gradients
A new shapenet rendering 2D image dataset that also contains deph map, normal map and albedo map.
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
Official project page of paper "Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning"
4D Spatio-Temporal Semantic Segmentation on a 3D video (a sequence of 3D scans)
Official implementation of `Splatter Image: Ultra-Fast Single-View 3D Reconstruction'
PyTorch implementation of Transformer-based Neural Machine Translation
A working implementation of text-to-3D dreamfusion, powered by stable diffusion.
High-Resolution Image Synthesis with Latent Diffusion Models
This is the code used for the paper "Inferring algorithmic patterns with a stack augmented recurrent network", by Armand Joulin and Tomas Mikolov.
Scripts for batch rendering models using Blender. Tested with models from stanfords shapenet library.
Starless is a CPU black hole raytracer in numpy suitable for both informative diagrams and decent wallpaper material.
sketch + style = paints :art:
Open-Source Computer Graphics Library
TED parallel Corpora is growing collection of Bilingual parallel corpora, Multilingual parallel corpora and Monolingual corpora extracted from TED talks www.ted.com for 109 world languages.
A library for generalized sequence to sequence models
Tensorial Radiance Fields, a novel approach to model and reconstruct radiance fields
Demonstration of recurrent neural network implemented with Theano
A unified framework for 3D content generation.
Lightning fast & tiny C++/CUDA neural network framework