honglouyemeng/awesome-3d-face-reconstruction

Awesome-3D-Face-Reconstruction

A list of 3D face reconstruction resources. We try to keep it updated every week or two with the latest papers.

Papers

2021

• [VariTex] VariTex: Variational Neural Face Textures, ICCV2021, Marcel C. Buhler et al. [PDF][Code]

• [CEST] Self-Supervised 3D Face Reconstruction via Conditional Estimation, ICCV2021, Y. Wen et al. [PDF][Code]

• [LHFFT] Learning High-Fidelity Face Texture Completion Without Complete Face Texture, ICCV2021, J. Kin et al.[PDF] [Code]

• [SSL-Ray Tracing] Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray Tracing, ICCV2021, A. Dib et al. [PDF][Code]

• [H3D-Net] H3D-Net: Few-Shot High-Fidelity 3D Head Reconstruction, ICCV2021, E. Ramon et al. [PDF][Code]

• [3DIAS] 3D Shape Reconstruction with Implicit Algebraic Surfaces, ICCV2021, M. Yavartanoo et al.[PDF][Code]

• [INORig] Riggable 3D Face Reconstruction via In-Network Optimization, CVPR2021, Z. Bai et al. [PDF][Code]

• [3DCS] 3DCaricShop: A Dataset and a Baseline Method for Single-View 3D Caricature Face Reconstruction, CVPR2021, Y. Qiu et al. [PDF][Code]

• [IGARen] Inverting Generative Adversarial Renderer for Face Reconstruction, CVPR2021, J. Piao et al. [PDF][Code]

• [LMF-IaV] Learning Complete 3D Morphable Face Models From Images and Videos, CVPR2021, A Tewari et al. [PDF][Code]

• [SGAN-AF] Lifting 2D StyleGAN for 3D-Aware Face Generation, CVPR2021, Y. Shi et al. [PDF][Code]

• [MonR] Monocular Reconstruction of Neural Face Reflectance Fields, CVPR2021, A. Tewari et al.[PDF][Code]

• [AP-WI] Learning To Aggregate and Personalize 3D Face From In-the-Wild Photo Collection, CVPR2021, Z. Zhang et al. [PDF] [Code]

• [WSPT-3DR] Weakly-Supervised Photo-realistic Texture Generation for 3D Face Reconstruction, arXiv, X. Yin et al.[PDF][Code]

• [FFD-WI] Learning Free-Form Deformation for 3D Face Reconstruction from In-The-Wild Images, arXiv, H. Jung et al.[PDF][Code]

• [HFM-SSL] Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray Tracing, arXiv, A. Dib et al.[PDF][Code]

• [TOF/TONF] To fit or not to fit: Model-based Face Reconstruction and Occlusion Segmentation from Weak Supervision, arXiv, C. Li et al. [PDF][Code]

• [Fast-GANFIT] Fast-GANFIT: Generative Adversarial Network for High Fidelity 3D Face Reconstruction, arXiv, B. Gecer et al. [PDF][Code]

• [WSM-Face] Weakly-Supervised Multi-Face 3D Reconstruction, arXiv，J. Zhang et al. [PDF][Code]

• [U-Net] Hybrid Approach for 3D Head Reconstruction: Using Neural Networks and Visual Geometry, ICPR2021, O. Bouafif et al. [PDF][Code]

• [JFA-CNN] Joint Face Alignment and 3D Face Reconstruction with Efficient Convolution Neural Networks, ICPR2021, K. Li et al.[PDF][Code]

• [Muti-Attribute] Multi-Attribute Regression Network for Face Reconstruction, ICPR2021, X. Li et al.[PDF][Code]

• [Real-Time] Real-Time 3d Face Reconstruction From Single Image Using End-To-End Cnn Regression, ICIP2021, S. Wang et al. [PDF][Code]

• [SADRNet] SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction, TIP2021, Z. Ruan et al. [PDF][Code]

• [Prior-Guided] Prior-Guided Multi-View 3D Head Reconstruction, TMM2021, X. Wang et al. [PDF][Code]

• [AniDetai-WildI] Learning an animatable detailed 3D face model from in-the-wild images, ACMTG2021, Y. Feng et al. [PDF][Code]

• [Muti-SSL] Multi-view self-supervised learning for 3D facial texture reconstruction from single image, IVC2021, X. Zeng et al. [PDF][Code]

• [Multi-Gran] Multi-Granularity Feature Interaction and Relation Reasoning for 3D Dense Alignment and Face Reconstruction, ICASSP2021, L. LI et al. [PDF][Code]

• [LDR-NPM] Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model, GM2021, H. Cai et al. [PDF][Code]

• [PFR-DRTrac] Practical Face Reconstruction via Differentiable Ray Tracing, GRF2021, A. Dib et al. [PDF][Code]

• [LDet-CNN] Learning-detailed 3D face reconstruction based on convolutional neural networks from a single image, NCA2021, A. Khan et al.[PDF][Code]

• [E-Aware] Expression-Aware Face Reconstruction via a Dual-Stream Network, TMM2021, X. Chai et al. [PDF][Code]

2020

• [ReDA] ReDA:Reinforced Differentiable Attribute for 3D Face Reconstruction, CVRP2020, W. Zhu et al.[PDF][Code]

• [Uncertainty-Aware] Uncertainty-Aware Mesh Decoder for High Fidelity 3D Face Reconstruction, CVPR2020, G. Lee et al.[PDF][Code]

• [High-Fidelity] Towards High-Fidelity 3D Face Reconstruction From In-the-Wild Images Using Graph Convolutional Networks, CVPR2020, J. Lin et al.[PDF][Code]

• [FaceScape] FaceScape: A Large-Scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Prediction, CVPR2020, H. Yang et al. [PDF][Code]

• [Semi-Supervised] Semi-Supervised 3D Face Representation Learning From Unconstrained Photo Collections, CVPR2020, Z. Gao et al. [PDF][Code]

• [AvatarMe] AvatarMe: Realistically Renderable 3D Facial Reconstruction "In-the-Wild", CVPR2020, A. Lattas et al. [PDF][Code]

• [RetinaFace] RetinaFace: Single-Shot Multi-Level Face Localisation in the Wild, CVPR2020, J. Deng et al. [PDF][Code]

• [Towards-FAS] Towards Fast, Accurate and Stable 3D Dense Face Alignment，ECCV2020, J. Guo et al.[PDF][Code]

• [Fine-grained] Beyond 3DMM Space: Towards Fine-grained 3D Face Reconstruction, ECCV2020, X. Zhu et al.[PDF][Code]

• [SSM--Occlusion] Self-Supervised Monocular 3D Face Reconstruction by Occlusion-Aware Multi-view Geometry Consistency, ECCV2020, J. Shang et al.[PDF][Code]

• [Personalized] Personalized Face Modeling for Improved Face Reconstruction and Motion Retargeting, ECCV2020, B. Chaudhuri et al. [PDF][Code]

• [GCN] Faster, Better and More Detailed: 3D Face Reconstruction with Graph Convolutional Networks, ACCV2020, S. Cheng et al.[PDF][Code]

• [PGNet] Learning 3D Face Reconstruction with a Pose Guidance Network, ACCV2020, P. Liu et al. [PDF][Code]

• [2D-GANs] Do 2D GANs Know 3D Shape? Unsupervised 3D shape reconstruction from 2D Image, arXiv, X. Pan et al.[PDF][Code]

• [3DFaceGAN] 3DFaceGAN: Adversarial Nets for 3D Face Representation, Generation, and Translation, arXiv, S. Moschoglou et al. [PDF][Code]

• [AFR] Adaptive 3D Face Reconstruction from a Single Image, arXiv, K. Li et al. [PDF][Code]

• [Mugshots] 3D face reconstruction from mugshots: Application to arbitrary view face recognition, Neu2020, J. Liang et al.[PDF][Code]

• [Distinctive Features] 3D Face Reconstruction From Single 2D Image Using Distinctive Features, ACCESS2020, H. M. Rehan Afzal et al.[PDF][Code]

• [SSL-Detailed] Self-Supervised Learning of Detailed 3D Face Reconstruction, TIP2020, Y. Chen et al.[PDF][Code]

• [Robust3D] Robust3D: a robust 3D face reconstruction application, NCA2020, Z Lv et al.[PDF][Code]

• [3DFR-Wild] 3D Face Reconstruction from A Single Image Assisted by 2D Face Images in the Wild, TMM2020, X. Tu et al.[PDF][Code]

• [Past-Presnt-Future] 3D Morphable Face Models—Past, Present, and Future, ACMTG2020, B. Egger et al.[PDF][Code]

• [Two-Payhway] A Novel Two-Pathway Encoder-Decoder Network for 3D Face Reconstruction, ICASSP2020, X. Liu et al. [PDF][Code]

• [DNN] Dual Neural Networks Coupling Data Regression with Explicit Priors for Monocular 3D Face Reconstruction, TMM2020, X. Fan et al. [PDF][Code]

2019

• [GANFIT] GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstruction, CVPR2019, B. Gecer et al.[PDF][Code]
• [WSL--I2I] Accurate 3D Face Reconstruction With Weakly-Supervised Learning: From Single Image to Image Set, CVPR2019, Y. Deng et al. [PDF][Code]
• [High-Fidelity] Towards High-Fidelity Nonlinear 3D Face Morphable Model, CVPR2019, L. Tran et al. [PDF][Code]
• [MVF-Net] MVF-Net: Multi-View 3D Face Morphable Model Regression, CVPR2019, F. Wu et al.[PDF][Code]
• [DRL-3DF] Disentangled Representation Learning for 3D Face Shape， CVPR2019, Z. Jiang et al. [PDF][Code]
• [D3DF] Dense 3D Face Decoding Over 2500FPS: Joint Texture & Shape Convolutional Mesh Decoders, CVPR2019, Y. Zhou et al. [PDF][Code]
• [C2FF] Coarse-to-Fine 3D Face Reconstruction, CVPR2019, L. Galteri et al. [PDF][Code]
• [Regress SE] Learning to Regress 3D Face Shape and Expression From an Image Without 3D Supervision, CVPR2019, S. Sanyal et al. [PDF][Code]
• [MMFace] MMFace: A Multi-Metric Regression Network for Unconstrained Face Reconstruction, CVPR2019, H. Yi et al. [PDF][Code]
• [DF2Net] DF2Net: A Dense-Fine-Finer Network for Detailed 3D Face Reconstruction, ICCV2019, X. Zeng et al. [PDF][Code]
• [3DFace-2DVideos] 3D Face Shape Regression From 2D Videos with Multi-Reconstruction and Mesh Retrieval, ICCV2019, X. Shao et al. [PDF][Code]
• [DMADNet] Dual Attention MobDenseNet(DAMDNet) for Robust 3D Face Alignment, ICCV2019, L. Jiang et al. [PDF][Code]
• [FDO-3DMM-GAN Face De-Occlusion Using 3D Morphable Model and Generative Adversarial Network, ICCV2019, X. Yuan et al. [PDF][Code]
• [MVF-SNet] Multi-View 3D Face Reconstruction in the Wild Using Siamese Networks, ICCV2019, E. RAmon et al. [PDF]Code
• [Smei-Supervised] Semi-Supervised Monocular 3D Face Reconstruction With End-to-End Shape-Preserved Domain Transfer, ICCV2019, J. Piao et al. [PDF][Code]
• [3D-DRSD] 3D Face Modeling From Diverse Raw Scan Data, ICCV2019, F. Liu et al. [PDF][Code]
• [Alignment-GCN] 3D Dense Face Alignment via Graph Convolution Networks, arXiv, H. Wei et al. [PDF][Code]
• [Cascaded regression] Cascaded regression using landmark displacement for 3D face reconstruction, PRL2019, F. Wu et al. [PDF][Code]
• [Fusion-MLD] Efficient and Accurate Face Shape Reconstruction by Fusion of Multiple Landmark Databases, ICIP2019, Y. Tian et al.[PDF][Code]
• [Landmark Updating] Single View 3D Face Reconstruction with Landmark Updating, MIPR2019, P. Liu et al. [PDF][Code]
• [2D-NeuralNet] 3D face model reconstructing from its 2D images using neural networks, ATIT2019, O. Aleksandroav et al. [PDF][Code]
• [3DF-Wild-Images] On Learning 3D Face Morphable Model from In-the-Wild Images, TPAMI2019, L. Tran et al. [PDF][Code]
• [SSB] A Self-Supervised Bootstrap Method for Single-Image 3D Face Reconstruction, WACV2019, Y. Xing et al. [PDF][Code]
• [2D-germetric] What does 2D geometric information really tell us about 3D face shape?, IJCV2019, A. Bas et al. [PDF][Code]

2018

• [DF-JFR-R] Disentangling Features in 3D Face Shapes for Joint Face Reconstruction and Recognition, CVPR2018, F. Liu et al. [PDF][Code]
• [RGB-D] Texture Mapping for 3D Reconstruction With RGB-D Sensor, CVPR2018, Y. Fu et al. [PDF][Code]
• [Extreme3DFR] Extreme 3D Face Reconstruction: Seeing Through Occlusions, CVPR2018, A. T. Tran et al. [PDF][Code]
• [Unsupervised-Training] Unsupervised Training for 3D Morphable Model Regression, CVPR2018, K. Genova et al. [PDF][Code]
• [SP3DFR] Sparse Photometric 3D Face Reconstruction Guided by Morphable Models, CVPR2018, X. Cao et al.[PDF][Code]
• [SSML-250HZ] Self-Supervised Multi-Level Face Model Learning for Monocular Reconstruction at Over 250 Hz, CVPR2018, A. Terwari et al. [PDF][Code]
• [Noliner-3DMM] Nonlinear 3D Face Morphable Model, CVPR2018, L. Tran et al. [PDF][Code]
• [J3DFR-PMRNet] Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Network, ECCV2018, Y. Feng et al. [PDF][Code]
• [G3DF-CMA] Generating 3D Faces using Convolutional Mesh Autoencoders, ECCV2018, A. Ranjan et al. [PDF][Code]
• [MobileFace] MobileFace: 3D Face Reconstruction with Efficient CNN Regression, ECCV2018, N. Chinaev et al.[PDF][Code]
• [MFR-Tracking-Applications] State of the Art on Monocular 3D Face Reconstruction, Tracking, and Applications, CGF2018, M. Zollhfer et al. [PDF][Code]
• [Geometry Details] 3D Face Reconstruction With Geometry Details From a Single Image, TIP2018, L. Jiang et al. [PDF][Code]
• [Muliti-view] Multi-view 3D face reconstruction with deep recurrent neural networks, IMAVIS2018, P. Dou et al. [PDF][Code]
• [CNN-RealTime] CNN-Based Real-Time Dense Face Reconstruction with Inverse-Rendered Photo-Realistic Face Images, TPAMI2018, Y. Guo et al. [PDF][Code]
• [3DFR-LFI] 3D Face Reconstruction from Light Field Images: A Model-free Approach, ECCV2018, M. Feng et al. [PDF][Code]
• [HFMFR-UM] High-Fidelity Monocular Face Reconstruction Based on an Unsupervised Model-Based Face Autoencoder, TPAMI2018, A. Tewari et al. [PDF][Code]
• [Low-Resolution] 3D Face Reconstruction from Low-Resolution Images with Convolutional Neural Networks, ICVIP2018, R. Winkler et al. [PDF][Code]
• [ExpNet] ExpNet: Landmark-Free, Deep, 3D Facial Expressions, FG2018, F. Chang et al. [PDF][Code]

2017

• [End2End] End-To-End 3D Face Reconstruction With Deep Neural Networks, CVPR2017, P. Dou et al. [PDF][Code]
• [DFR-Single] Learning Detailed Face Reconstruction From a Single Image, CVPR2017, E. Richardson et al. [PDF][Code]
• [Large Pose] Large Pose 3D Face Reconstruction From a Single Image via Direct Volumetric CNN Regression, CVPR2017, A. S. Jackson et al. [PDF][Code]
• [3DMM-Wild] 3D Face Morphable Models "In-The-Wild", CVPR2017, J .Booth et al. [PDF][Code]
• [RRD-3DMM] Regressing Robust and Discriminative 3D Morphable Models with a very Deep Neural Network, CVPR2017, A. T. Tran et al. [PDF][Code]
• [MoFA] MoFA: Model-Based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction, ICCV2017, A. Tewari et al. [PDF][Code]
• [UFG-I2I] Unrestricted Facial Geometry Reconstruction Using Image-To-Image Translation, ICCV2017, M. Sela et al. [PDF][Code]

Before 2017

• [3DFR-SD] 3D Face Reconstruction by Learning from Synthetic Data, INSPEC2016, E. Richardson et al. [PDF][Code]
• [SingelReference] 3D Face Reconstruction from a Single Image Using a Single Reference Face Shape, TPAMI2010, I. Kemelmacher-Shlizerman et al. [PDF][Code]
• [QualityMeasures] Automated 3D Face Reconstruction From Multiple Images Using Quality Measures, CVPR2016, M. Piotraschke et al. [PDF][Code]

Datasets

• AFLW
• AFLW2000-3D
• BAM!
• CelebA
• CelebA-HQ
• CelebAMask-HQ
• CASIA-WebFace
• CACD
• COMA
• 4DFAB
• FFHQ
• Florence
• FaceWarehouse
• FaceScape
• FDDB
• FRGC
• Helen
• IJB-A
• LSUN
• LFW
• LS3D-W
• Multi-PIE
• NoW Benchmark
• UMDFaces
• VGGFace2
• VoxCeleb2
• WIDER FACE
• 300W

Evaluation Metrics