Jiong WANG's Projects
We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. Meanwhile, we created a new branch to build a Tabular LLM.(我们分别统一了丰富的IFT数据(如CoT数据,目前仍不断扩充)、多种训练效率方法(如lora,p-tuning)以及多种LLMs,三个层面上的接口,打造方便研究人员上手的LLM-IFT研究平台。同时tabular_llm分支构建了面向表格智能任务的LLM。
Instruct-tune LLaMA on consumer hardware
:sparkles::sparkles:Latest Papers and Datasets on Multimodal Large Language Models, and Their Evaluation.
Awesome-AI4Earth: a curated list of machine learning in Earth System, especially for weather and climate.
Code for CVPR 2022 paper "Bailando: 3D dance generation via Actor-Critic GPT with Choreographic Memory"
This is the official implementation of BEVFormer, a camera-only framework for autonomous driving perception, e.g., 3D object detection and semantic map segmentation.
The checkboard project of Machine Learning
The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.
A web app for ranking computer science departments according to their research output in selective venues, and for finding active faculty across a wide range of areas.
Diffusion Probabilistic Downscaling Model
This is an official implementation for "Are Transformers Effective for Time Series Forecasting?"
Make human motion capture easier.
PyTorch codes for "Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priors", ACM MM2022
A HTML/CSS Template for FreeMan Projects
Official Repository for FreeMan dataset
Project Page for FreeMan
Materials for human action generation
Knowledge Distillation Algorithms implemented with PyTorch
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
MMGeneration is a powerful toolkit for generative models, based on PyTorch and MMCV.
OpenMMLab 3D Human Parametric Model Toolbox and Benchmark
OpenMMLab Pose Estimation Toolbox and Benchmark.
Open MMLab Image and Video Super-Resolution Toolbox, , including SRResNet, SRGAN, ESRGAN, EDVR, etc.
MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model
A Scalable Pipeline for Making Steerable Multi-Task Mid-Level Vision Datasets from 3D Scans [ICCV 2021]
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following ability and in-context learning.
Python code for "Probabilistic Machine learning" book by Kevin Murphy
Code for "ShineOn: Illuminating Design Choices for Practical Video-based Virtual Clothing Try-on", accepted at WACV 2021 Generation of Human Behavior Workshop.