Abstract
We propose an inverse rendering model for light fields to recover surface normals, depth, reflectance, and natural illumination. Our setting is fully uncalibrated, with the reflectance modeled with a spatially constant Blinn–Phong bidirectional reflectance distribution function (BRDF) and illumination as an environment map. While previous work makes strong assumptions in this difficult scenario, focusing solely on specific types of objects such as faces or imposing very strong priors, our approach leverages only the light field structure, where a solution consistent across all subaperture views is sought. The optimization is based primarily on shading, which is sensitive to fine geometric details that are propagated to the initial coarse depth map. Despite the problem being inherently ill posed, we achieve encouraging results on synthetic as well as real-world data.
© 2021 Optical Society of America
Full Article | PDF ArticleMore Like This
Nicolas Prouteau, Clément Joubert, Benjamin Bringier, and Majdi Khoudeir
J. Opt. Soc. Am. A 40(4) 792-802 (2023)
Xucheng Wang, Chenning Tao, Rengmao Wu, Xiao Tao, Peng Sun, Yong Li, and Zhenrong Zheng
J. Opt. Soc. Am. A 37(7) 1236-1243 (2020)
Tianqi Luo, Di Lin, Merlin Mah, Connor Hashemi, James R. Leger, and Joseph J. Talghader
J. Opt. Soc. Am. A 38(7) 1041-1050 (2021)