Two-Shot SVBRDF Capture for Stationary Materials

Miika Aittala Tim Weyrich Jaakko Lehtinen
Aalto University University College London Aalto University
NVIDIA

ACM Transactions on Graphics 34(4) (Proc. SIGGRAPH 2015)

Teaser


Paper and supplemental material

Supplemental material for browsing on the web:

Extended supplemental material:

New! Oculus Rift viewer for the results, including displacement mapping, shadows, 3D meshes and proper filtering. Courtesy of Jussi Knuuttila.

Abstract

Material appearance acquisition usually makes a trade-off between acquisition effort and richness of reflectance representation. In this paper, we instead aim for both a light-weight acquisition procedure and a rich reflectance representation simultaneously, by restricting ourselves to one, but very important, class of appearance phenomena: texture-like materials. While such materials' reflectance is generally spatially varying, they exhibit self-similarity in the sense that for any point on the texture there exist many others with similar reflectance properties. We show that the texturedness assumption allows reflectance capture using only two images of a planar sample, taken with and without a headlight flash. Our reconstruction pipeline starts with redistributing reflectance observations across the image, followed by a regularized texture statistics transfer and a non-linear optimization to fit a spatially-varying BRDF (SVBRDF) to the resulting data. The final result describes the material as spatially-varying, diffuse and specular, anisotropic reflectance over a detailed normal map. We validate the method by side-by-side and novel-view comparisons to photographs, comparing normal map resolution to sub-micron ground truth scans, as well as simulated results. Our method is robust enough to use handheld, JPEG-compressed photographs taken with a mobile phone camera and built-in flash.

Acknowledgments

This work was supported by the Academy of Finland (grant 277833), the Helsinki Doctoral Programme in Computer Science (HeCSE), and the UK Engineering and Physical Sciences Research Council (grant EP/K023578/1).

BibTeX

@article{Aittala2015,
author = {Aittala, Miika and Weyrich, Tim and Lehtinen, Jaakko},
title = {Two-shot SVBRDF Capture for Stationary Materials},
journal = {ACM Trans. Graph.},
issue_date = {August 2015},
volume = {34},
number = {4},
month = jul,
year = {2015},
issn = {0730-0301},
pages = {110:1--110:13},
articleno = {110},
numpages = {13},
url = {http://doi.acm.org/10.1145/2766967},
doi = {10.1145/2766967},
acmid = {2766967},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {SVBRDF, appearance capture, reflectance, texture synthesis},
}