James Leger, Editor-in-Chief
Xin Jin, Li Liu, and Qionghai Dai
and Qionghai Dai
Key Lab of Broadband Network and Multimedia, Graduate School at Shenzhen, Tsinghua University of Shenzhen, 518055, China
*Corresponding author: firstname.lastname@example.org
Recovering the real light field, including the light field intensity distributions and continuous volumetric data in the object space, is an attractive and important topic with the developments in light-field imaging. In this paper, a blind light field reconstruction method is proposed to recover the intensity distributions and continuous volumetric data without the assistant of prior geometric information. The light field reconstruction problem is approximated to be a summation of the localized reconstructions based on image formation analysis. Blind volumetric information derivation is proposed based on backward image formation modeling to exploit the correspondence among the deconvoluted results. Finally, a light field is blindly reconstructed via the proposed inverse image formation approximation and wave propagation. We demonstrate that the method can blindly recover the light field intensity with continuous volumetric data. It can be further extended to other light field imaging systems if the backward image formation model can be derived.
© 2018 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
Nicola Viganò, Henri Der Sarkissian, Charlotte Herzog, Ombeline de la Rochefoucauld, Robert van Liere, and Kees Joost Batenburg
Opt. Express 26(18) 22574-22602 (2018)
Yanqin Chen, Xin Jin, and Bo Xiong
Opt. Express 28(3) 3057-3072 (2020)
Michael Broxton, Logan Grosenick, Samuel Yang, Noy Cohen, Aaron Andalman, Karl Deisseroth, and Marc Levoy
Opt. Express 21(21) 25418-25439 (2013)
Chang Liu, Jun Qiu, and Ming Jiang
Opt. Express 25(10) 11377-11388 (2017)
Noy Cohen, Samuel Yang, Aaron Andalman, Michael Broxton, Logan Grosenick, Karl Deisseroth, Mark Horowitz, and Marc Levoy
Opt. Express 22(20) 24817-24839 (2014)
X. Jin, L. Liu, Y. Chen, and Q. Dai, “Point spread function and depth-invariant focal sweep point spread function for plenoptic camera 2.0,” Opt. Express 25(9), 9947–9962 (2017).
E. Y. Lam, “Computational photography with plenoptic camera and light field capture: tutorial,” J. Opt. Soc. Am. A 32(11), 2021–2032 (2015).
S. Shroff and K. Berkner, “Wave analysis of a plenoptic system and its applications,” Proc. SPIE 8667, 86671L (2013).
M. Broxton, L. Grosenick, S. Yang, N. Cohen, A. Andalman, K. Deisseroth, and M. Levoy, “Wave optics theory and 3-D deconvolution for the light field microscope,” Opt. Express 21(21), 25418–25439 (2013).
T. E. Bishop and P. Favaro, “The light field camera: extended depth of field, aliasing, and superresolution,” IEEE Trans. Pattern Anal. Mach. Intell. 34(5), 972–986 (2012).
D. C. L. Fong and M. Saunders, “LSMR: an iterative algorithm for sparse least-squares problems,” SIAM J. Sci. Comput. 33(5), 2950–2971 (2011).
T. Georgiev and A. Lumsdaine, “Focused plenoptic camera and rendering,” J. Electron. Imaging 19(2), 1–28 (2010).
Y. Boykov, O. Veksler, and R. Zabih, “Fast approximate energy minimization via graph cuts,” IEEE Trans. Pattern Anal. Mach. Intell. 23(11), 1222–1239 (2001).
E. H. Adelson and J. Y. A. Wang, “Single lens stereo with a plenoptic camera,” IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 99–106 (1992).
C. C. Paige and M. A. Saunders, “LSQR: an algorithm for sparse linear equations and sparse least squares,” ACM Trans. Math. Softw. 8(1), 43–71 (1982).
L. Liu, X. Jin, and Q. Dai, “Image formation analysis and light field information reconstruction for plenoptic Camera 2.0,” Pacific-Rim Conference on Multimedia (PCM)2017, Sept. 28–29, Harbin, China.
A. Lumsdaine and T. Georgiev, “The focused plenoptic camera,” in Proceedings of IEEE International Conference on Computational Photography (ICCP, 2009), pp. 1–8.
T. Georgiev and A. Lumsdaine, “Superresolution with plenoptic 2.0 cameras,” in Frontiers in Optics 2009/Laser Science XXV/Fall 2009, OSA Technical Digest (CD) (Optical Society of America) (2009), paper STuA6.
R. M. Haralick and L. G. Shapiro, Computer and Robot Vision (Addison-Wesley Longman Publishing Co., 1992), pp. 28–48, vol. I.
C. Guo, H. Li, I. Muniraj, B. Schroeder, J. Sheridan, and S. Jia, “Volumetric light-field encryption at the microscopic scale,” in Frontiers in Optics 2017, OSA Technical Digest (online) (Optical Society of America, 2017), paper JTu2A.94.
R. Ng, M. Levoy, M. Bredif, G. Duval, M. Horowitz, and P. Hanrahan, “Light field photography with a hand-held plenopic camera,” Technical Report, Stanford University (2005).
R. Ng, “Digital light field photography,” Ph.D. thesis, Stanford University (2006).
N. Antipa, S. Necula, R. Ng, and L. Waller, “Single-shot diffuser-encoded light field imaging,” in 2016 IEEE International Conference on Computational Photography (ICCP), Evanston, IL, pp. 1–11 (2016).
Y. Zhang, Z. Li, W. Yang, P. Yu, H. Lin, and J. Yu, “The light field 3D scanner,” in 2017 IEEE International Conference on Computational Photography (ICCP), Stanford, CA, pp. 1–9 (2017).
S. Shroff and K. Berkner, “High resolution image reconstruction for plenoptic imaging systems using system response,” in Imaging and Applied Optics Technical Papers, OSA Technical Digest (online) (Optical Society of America (2012)), paper CM2B.2.
S. Shroff and K. Berkner, “Plenoptic system response and image formation,” in Imaging and Applied Optics, OSA Technical Digest (online) (Optical Society of America, 2013), paper JW3B.1.
OSA participates in Crossref's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.
Alert me when this article is cited.
Click here to see a list of articles that cite this paper
Download Full Size | PPT Slide | PDF
Table 1 Spatial similarity measurement between the reconstructed intensity images at different depths
Table 2 Spatial similarity measurement between the reconstructed intensity images for “S” and “F”
Table 3 Spatial similarity measurement between images of “P,” “S,” and “F” reconstructed from noisy imaging result
Equations on this page are rendered with MathJax. Learn more.
Spatial similarity measurement between the reconstructed intensity images at different depths
Spatial similarity measurement between the reconstructed intensity images for “S” and “F”
Spatial similarity measurement between images of “P,” “S,” and “F” reconstructed from noisy imaging result