Our 2D-Assisted Self-supervised Learning (2DASL) is available at: https://arxiv.org/abs/1903.09359
This project is created by Tu Xiaoguang ([email protected]) and Luo Yao ([email protected]). Any questions pls open issues for our project, we will reply quickly.
To facility the research in the community of 3D face reconstruction and 3D face alignment, we release our source code, including the pytorch code for testing (training code will be available upon the acceptance of our paper), the matlab code for 3D plot, 3D face rendering and evaluation.
Landmark detection (left: only 68 landmarks are plotted to show), 3D face reconstruction (middle) and Dense face alignment (right)
Face swapping
Facial expression retargeting
We add the matlab evaluation code with the metric Normalized Mean Error (NME) in the folder "evaluation", including:
- We compare the results of our 2DASL with PRNet on the sparse 68 key points on both 2D&3D coordinates.
- We compare the results of our 2DASL with 3DDFA on all points for the task of dense alignment (both 2D and 3D coordinates) and 3D face recnostruction.
- The Iterative Closest Point (ICP) algorithm, which is used to find the nearest points between two 3D models is included in our code.
Usage: Download the "visualize.rar" package at: https://pan.baidu.com/s/1M0sg3eqrtzxxMJqmAzczRw using the password: "h26t". Or download the package here: https://drive.google.com/file/d/1414VE7oiusKxeyx0LYZOv042c8DfhFPf/view?usp=sharing Putting the package under the folder "evaluation", extracting it and then run the scripts: "nme_for_*".
- The 2DASL models for stage1 and stage2, in the folder "models".
- The test code to obtain 3D vertex for ALFW2000-3D images.
- The code to plot 2D facial landmarks.
Usage: python-3.6.6, pytorch-0.4.1. Just run the script "main_visualize_plot_4chls.py" in the folder "test_codes".
- The code for 3D face rendering, i.e., drawing 3d reconstruction mask.
- The code for plotting dense face alignment.
- The code for writing .obj file, the .obj files could be opend by the software meshlab.
Usage: Download the "visualize.rar" package at: https://pan.baidu.com/s/1M0sg3eqrtzxxMJqmAzczRw using the password: "h26t". Or download the package here: https://drive.google.com/file/d/1414VE7oiusKxeyx0LYZOv042c8DfhFPf/view?usp=sharing Putting the package under the folder "3D_results_plot", extracting it and then run the script "test_good_byXgtu.m".
Thanks for the authors of 3DDFA and PRNet for making their excellent works publicly available.
If you find our code is useful for your research, pls cite our work:
@article{tu2019joint,
title={Joint 3D Face Reconstruction and Dense Face Alignment from A Single Image with 2D-Assisted Self-Supervised Learning},
author={Tu, Xiaoguang and Zhao, Jian and Jiang, Zihang and Luo, Yao and Xie, Mei and Zhao, Yang and He, Linxiao and Ma, Zheng and Feng, Jiashi},
journal={arXiv preprint arXiv:1903.09359},
year={2019}
}