rozgo/surfacenet

The official PyTorch implementation for paper "SurfaceNet: Adversarial SVBRDF Estimation from a Single Image"

SurfaceNet: Adversarial SVBRDF Estimation from a Single Image

Giuseppe Vecchio, Simone Palazzo and Concetto Spampinato

Overview

This is the repo where the official PyTorch implementation for paper "SurfaceNet: Adversarial SVBRDF Estimation from a Single Image" will be released.

Our super trained monkeys 🐒 are working night and day to clean up the code, stay tuned...

Abstract

In this paper we present SurfaceNet, an approach for estimating spatially-varying bidirectional reflectance distribution function (SVBRDF) material properties from a single image. We pose the problem as an image translation task and propose a novel patch-based generative adversarial network (GAN) that is able to produce high-quality, high-resolution surface reflectance maps. The employment of the GAN paradigm has a twofold objective: 1) allowing the model to recover finer details than standard translation models; 2) reducing the domain shift between synthetic and real data distributions in an unsupervised way.

An extensive evaluation, carried out on a public benchmark of synthetic and real images under different illumination conditions, shows that SurfaceNet largely outperforms existing SVBRDF reconstruction methods, both quantitatively and qualitatively. Furthermore, SurfaceNet exhibits a remarkable ability in generating high-quality maps from real samples without any supervision at training time.

Method

Citation

@inproceedings{vecchio2021surfacenet,
  title={SurfaceNet: Adversarial SVBRDF Estimation from a Single Image},
  author={Vecchio, Giuseppe and Palazzo, Simone and Spampinato, Concetto},
  booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision},
  pages={12840--12848},
  year={2021}
}