Accurate depth estimation in structured light fields

Zewei Cai; Xiaoli Liu; Giancarlo Pedrini; Wolfgang Osten; Xiang Peng

doi:10.1364/OE.27.013532

Accurate depth estimation in structured light fields

Zewei Cai, Xiaoli Liu, Giancarlo Pedrini, Wolfgang Osten, and Xiang Peng

Optics Express
Vol. 27,
Issue 9,
pp. 13532-13546
(2019)
•https://doi.org/10.1364/OE.27.013532

Get Citation
Copy Citation Text
Zewei Cai, Xiaoli Liu, Giancarlo Pedrini, Wolfgang Osten, and Xiang Peng, "Accurate depth estimation in structured light fields," Opt. Express 27, 13532-13546 (2019)

Export Citation
- BibTex
- Endnote (RIS)
- HTML
- Plain Text
Get PDF (12266 KB)
Set citation alerts
Save article

Related Topics
Table of Contents Category
- Fourier Optics, Image and Signal Processing
Optics & Photonics Topics
?

The topics in this list come from the OSA Optics and Photonics Topics applied to this article.

About this Article
History
- Original Manuscript: February 18, 2019
- Revised Manuscript: April 10, 2019
- Manuscript Accepted: April 12, 2019
- Published: April 26, 2019

Accessible

Open Access

Abstract

Passive light field imaging generally uses depth cues that depend on the image structure to perform depth estimation, causing robustness and accuracy problems in complex scenes. In this study, the commonly used depth cues, defocus and correspondence, were analyzed by using phase encoding instead of the image structure. The defocus cue obtained by spatial variance is insensitive to the global spatial monotonicity of the phase-encoded field. In contrast, the correspondence cue is sensitive to the angular variance of the phase-encoded field, and the correspondence responses across the depth range have single-peak distributions. Based on this analysis, a novel active light field depth estimation method is proposed by directly using the correspondence cue in the structured light field to search for non-ambiguous depths, and thus no optimization is required. Furthermore, the angular variance can be weighted to reduce the depth estimation uncertainty according to the phase encoding information. The depth estimation of an experimental scene with rich colors demonstrated that the proposed method could distinguish different depth regions in each color segment more clearly, and was substantially improved in terms of phase consistency compared to the passive method, thus verifying its robustness and accuracy.

Full Article | PDF Article

OSA Recommended Articles

Ray calibration and phase mapping for structured-light-field 3D reconstruction

Zewei Cai, Xiaoli Liu, Xiang Peng, and Bruce Z. Gao
Opt. Express 26(6) 7598-7613 (2018)

Active depth estimation from defocus using a camera array

Tianyang Tao, Qian Chen, Shijie Feng, Yan Hu, and Chao Zuo
Appl. Opt. 57(18) 4960-4967 (2018)

Structured light field 3D imaging

Zewei Cai, Xiaoli Liu, Xiang Peng, Yongkai Yin, Ameng Li, Jiachen Wu, and Bruce Z. Gao
Opt. Express 24(18) 20324-20334 (2016)

References

View by:
Article Order
|
Year
|
Author
|
Publication

M. Levoy, “Light fields and computational imaging,” Computer 39(8), 46–55 (2006).
[Crossref]
I. Ihrke, J. Restrepo, and L. Mignard-Debise, “Principles of light field imaging briefly revisiting 25 years of research,” IEEE Signal Procss. Mag. 33(5), 59–69 (2016).
G. Wu, B. Masia, A. Jarabo, Y. Zhang, L. Wang, Q. Dai, T. Chai, and Y. Liu, “Light field image processing: an overview,” IEEE J. Sel. Top. Signal Process. 11(7), 926–954 (2017).
[Crossref]
B. Wilburn, N. Joshi, V. Vaish, E. Talvala, E. Antunez, A. Barth, A. Adams, M. Horowitz, and M. Levoy, “High performance imaging using large camera arrays,” ACM Trans. Graph. 24(3), 765–776 (2005).
[Crossref]
A. Levin, R. Fergus, F. Durand, and W. Freeman, “Image and depth from a conventional camera with a coded aperture,” ACM Trans. Graph. 26(3), 70 (2007).
[Crossref]
A. Veeraraghavan, R. Raskar, A. Agrawal, A. Mohan, and J. Tumblin, “Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing,” ACM Trans. Graph. 26(3), 69 (2007).
[Crossref]
R. Ng, M. Levoy, M. Brédif, G. Duval, M. Horowitz, and P. Hanrahan, “Light field photography with a hand-held plenoptic camera,” Stanford Technical Report CSTR (2005), pp. 1–11.
S. Wanner and B. Goldluecke, “Globally consistent depth labeling of 4D light fields,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (IEEE, 2012), pp. 41–48.
[Crossref]
C. Kim, H. Zimmer, Y. Pritch, A. Sorkine-Hornung, and M. Gross, “Scene reconstruction from high spatio-angular resolution light fields,” ACM Trans. Graph. 32(4), 73 (2013).
[Crossref]
M. W. Tao, S. Hadap, J. Malik, and R. Ramamoorthi, “Depth from combining defocus and correspondence using light-field cameras,” in Proceedings of IEEE International Conference on Computer Vision (IEEE, 2013), pp. 673–680.
[Crossref]
H. Lin, C. Chen, S. B. Kang, and J. Yu, “Depth recovery from light field using focal stack symmetry,” in Proceedings of IEEE International Conference on Computer Vision (IEEE, 2015), pp. 3451–3459.
[Crossref]
C. Hahne, A. Aggoun, V. Velisavljevic, S. Fiebig, and M. Pesch, “Refocusing distance of a standard plenoptic camera,” Opt. Express 24(19), 21521–21540 (2016).
[Crossref] [PubMed]
Y. Chen, X. Jin, and Q. Dai, “Distance measurement based on light field geometry and ray tracing,” Opt. Express 25(1), 59–76 (2017).
[Crossref] [PubMed]
Y. Zhang, H. Lv, Y. Liu, H. Wang, X. Wang, Q. Huang, X. Xiang, and Q. Dai, “Light-field depth estimation via epipolar plane image analysis and locally linear embedding,” IEEE Trans. Circ. Syst. Video Tech. 27(4), 739–747 (2017).
[Crossref]
I. K. P. Williem, I. K. Park, and K. M. Lee, “Robust light field depth estimation using occlusion-noise aware data costs,” IEEE Trans. Pattern Anal. Mach. Intell. 40(10), 2484–2497 (2018).
[Crossref] [PubMed]
T. Tao, Q. Chen, S. Feng, Y. Hu, and C. Zuo, “Active depth estimation from defocus using a camera array,” Appl. Opt. 57(18), 4960–4967 (2018).
[Crossref] [PubMed]
J. Salvi, S. Fernandez, T. Pribanic, and X. Llado, “A state of the art in structured light patterns for surface profilometry,” Pattern Recognit. 43(8), 2666–2680 (2010).
[Crossref]
J. Geng, “Structured-light 3D surface imaging: a tutorial,” Adv. Opt. Photonics 3(2), 128–160 (2011).
[Crossref]
A. Gershun, “The light field,” Translated by P. Moon and, G. Timoshenko, J. Math. Phys. 18(1–4), 51–151 (1936).
E. H. Adelson and J. R. Bergen, “The plenoptic function and the elements of early vision,” in Computational models of visual processing (MIT, 1991), pp. 3–20.
M. Levoy and P. Hanrahan, “Light field rendering,” in Proceedings of ACM SIGGRAPH (ACM, 1996), pp. 31–42.
S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, “The lumigraph,” in Proceedings of ACM SIGGRAPH (ACM, 1996), pp. 43–54.
X. Peng, Z. Yang, and H. Niu, “Multi-resolution reconstruction of 3-D image with modified temporal unwrapping algorithm,” Opt. Commun. 224(1–3), 35–44 (2003).
[Crossref]
Z. Cai, X. Liu, H. Jiang, D. He, X. Peng, S. Huang, and Z. Zhang, “Flexible phase error compensation based on Hilbert transform in phase shifting profilometry,” Opt. Express 23(19), 25171–25181 (2015).
[Crossref] [PubMed]

2018 (2)

I. K. P. Williem, I. K. Park, and K. M. Lee, “Robust light field depth estimation using occlusion-noise aware data costs,” IEEE Trans. Pattern Anal. Mach. Intell. 40(10), 2484–2497 (2018).
[Crossref] [PubMed]

T. Tao, Q. Chen, S. Feng, Y. Hu, and C. Zuo, “Active depth estimation from defocus using a camera array,” Appl. Opt. 57(18), 4960–4967 (2018).
[Crossref] [PubMed]

2017 (3)

Y. Chen, X. Jin, and Q. Dai, “Distance measurement based on light field geometry and ray tracing,” Opt. Express 25(1), 59–76 (2017).
[Crossref] [PubMed]

Y. Zhang, H. Lv, Y. Liu, H. Wang, X. Wang, Q. Huang, X. Xiang, and Q. Dai, “Light-field depth estimation via epipolar plane image analysis and locally linear embedding,” IEEE Trans. Circ. Syst. Video Tech. 27(4), 739–747 (2017).
[Crossref]

G. Wu, B. Masia, A. Jarabo, Y. Zhang, L. Wang, Q. Dai, T. Chai, and Y. Liu, “Light field image processing: an overview,” IEEE J. Sel. Top. Signal Process. 11(7), 926–954 (2017).
[Crossref]

2016 (2)

I. Ihrke, J. Restrepo, and L. Mignard-Debise, “Principles of light field imaging briefly revisiting 25 years of research,” IEEE Signal Procss. Mag. 33(5), 59–69 (2016).

C. Hahne, A. Aggoun, V. Velisavljevic, S. Fiebig, and M. Pesch, “Refocusing distance of a standard plenoptic camera,” Opt. Express 24(19), 21521–21540 (2016).
[Crossref] [PubMed]

2015 (1)

Z. Cai, X. Liu, H. Jiang, D. He, X. Peng, S. Huang, and Z. Zhang, “Flexible phase error compensation based on Hilbert transform in phase shifting profilometry,” Opt. Express 23(19), 25171–25181 (2015).
[Crossref] [PubMed]

2013 (1)

C. Kim, H. Zimmer, Y. Pritch, A. Sorkine-Hornung, and M. Gross, “Scene reconstruction from high spatio-angular resolution light fields,” ACM Trans. Graph. 32(4), 73 (2013).
[Crossref]

2011 (1)

J. Geng, “Structured-light 3D surface imaging: a tutorial,” Adv. Opt. Photonics 3(2), 128–160 (2011).
[Crossref]

2010 (1)

J. Salvi, S. Fernandez, T. Pribanic, and X. Llado, “A state of the art in structured light patterns for surface profilometry,” Pattern Recognit. 43(8), 2666–2680 (2010).
[Crossref]

2007 (2)

A. Levin, R. Fergus, F. Durand, and W. Freeman, “Image and depth from a conventional camera with a coded aperture,” ACM Trans. Graph. 26(3), 70 (2007).
[Crossref]

A. Veeraraghavan, R. Raskar, A. Agrawal, A. Mohan, and J. Tumblin, “Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing,” ACM Trans. Graph. 26(3), 69 (2007).
[Crossref]

2006 (1)

M. Levoy, “Light fields and computational imaging,” Computer 39(8), 46–55 (2006).
[Crossref]

2005 (1)

B. Wilburn, N. Joshi, V. Vaish, E. Talvala, E. Antunez, A. Barth, A. Adams, M. Horowitz, and M. Levoy, “High performance imaging using large camera arrays,” ACM Trans. Graph. 24(3), 765–776 (2005).
[Crossref]

2003 (1)

X. Peng, Z. Yang, and H. Niu, “Multi-resolution reconstruction of 3-D image with modified temporal unwrapping algorithm,” Opt. Commun. 224(1–3), 35–44 (2003).
[Crossref]

1936 (1)

A. Gershun, “The light field,” Translated by P. Moon and, G. Timoshenko, J. Math. Phys. 18(1–4), 51–151 (1936).

Adams, A.

Aggoun, A.

C. Hahne, A. Aggoun, V. Velisavljevic, S. Fiebig, and M. Pesch, “Refocusing distance of a standard plenoptic camera,” Opt. Express 24(19), 21521–21540 (2016).
[Crossref] [PubMed]

Agrawal, A.

Antunez, E.

Barth, A.

Cai, Z.

Chai, T.

G. Wu, B. Masia, A. Jarabo, Y. Zhang, L. Wang, Q. Dai, T. Chai, and Y. Liu, “Light field image processing: an overview,” IEEE J. Sel. Top. Signal Process. 11(7), 926–954 (2017).
[Crossref]

Chen, C.

H. Lin, C. Chen, S. B. Kang, and J. Yu, “Depth recovery from light field using focal stack symmetry,” in Proceedings of IEEE International Conference on Computer Vision (IEEE, 2015), pp. 3451–3459.
[Crossref]

Chen, Q.

T. Tao, Q. Chen, S. Feng, Y. Hu, and C. Zuo, “Active depth estimation from defocus using a camera array,” Appl. Opt. 57(18), 4960–4967 (2018).
[Crossref] [PubMed]

Chen, Y.

Y. Chen, X. Jin, and Q. Dai, “Distance measurement based on light field geometry and ray tracing,” Opt. Express 25(1), 59–76 (2017).
[Crossref] [PubMed]

Cohen, M. F.

S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, “The lumigraph,” in Proceedings of ACM SIGGRAPH (ACM, 1996), pp. 43–54.

Dai, Q.

G. Wu, B. Masia, A. Jarabo, Y. Zhang, L. Wang, Q. Dai, T. Chai, and Y. Liu, “Light field image processing: an overview,” IEEE J. Sel. Top. Signal Process. 11(7), 926–954 (2017).
[Crossref]

Y. Chen, X. Jin, and Q. Dai, “Distance measurement based on light field geometry and ray tracing,” Opt. Express 25(1), 59–76 (2017).
[Crossref] [PubMed]

Durand, F.

A. Levin, R. Fergus, F. Durand, and W. Freeman, “Image and depth from a conventional camera with a coded aperture,” ACM Trans. Graph. 26(3), 70 (2007).
[Crossref]

Feng, S.

T. Tao, Q. Chen, S. Feng, Y. Hu, and C. Zuo, “Active depth estimation from defocus using a camera array,” Appl. Opt. 57(18), 4960–4967 (2018).
[Crossref] [PubMed]

Fergus, R.

A. Levin, R. Fergus, F. Durand, and W. Freeman, “Image and depth from a conventional camera with a coded aperture,” ACM Trans. Graph. 26(3), 70 (2007).
[Crossref]

Fernandez, S.

J. Salvi, S. Fernandez, T. Pribanic, and X. Llado, “A state of the art in structured light patterns for surface profilometry,” Pattern Recognit. 43(8), 2666–2680 (2010).
[Crossref]

Fiebig, S.

C. Hahne, A. Aggoun, V. Velisavljevic, S. Fiebig, and M. Pesch, “Refocusing distance of a standard plenoptic camera,” Opt. Express 24(19), 21521–21540 (2016).
[Crossref] [PubMed]

Freeman, W.

A. Levin, R. Fergus, F. Durand, and W. Freeman, “Image and depth from a conventional camera with a coded aperture,” ACM Trans. Graph. 26(3), 70 (2007).
[Crossref]

Geng, J.

J. Geng, “Structured-light 3D surface imaging: a tutorial,” Adv. Opt. Photonics 3(2), 128–160 (2011).
[Crossref]

Gershun, A.

A. Gershun, “The light field,” Translated by P. Moon and, G. Timoshenko, J. Math. Phys. 18(1–4), 51–151 (1936).

Goldluecke, B.

S. Wanner and B. Goldluecke, “Globally consistent depth labeling of 4D light fields,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (IEEE, 2012), pp. 41–48.
[Crossref]

Gortler, S. J.

S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, “The lumigraph,” in Proceedings of ACM SIGGRAPH (ACM, 1996), pp. 43–54.

Gross, M.

C. Kim, H. Zimmer, Y. Pritch, A. Sorkine-Hornung, and M. Gross, “Scene reconstruction from high spatio-angular resolution light fields,” ACM Trans. Graph. 32(4), 73 (2013).
[Crossref]

Grzeszczuk, R.

S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, “The lumigraph,” in Proceedings of ACM SIGGRAPH (ACM, 1996), pp. 43–54.

Hadap, S.

M. W. Tao, S. Hadap, J. Malik, and R. Ramamoorthi, “Depth from combining defocus and correspondence using light-field cameras,” in Proceedings of IEEE International Conference on Computer Vision (IEEE, 2013), pp. 673–680.
[Crossref]

Hahne, C.

C. Hahne, A. Aggoun, V. Velisavljevic, S. Fiebig, and M. Pesch, “Refocusing distance of a standard plenoptic camera,” Opt. Express 24(19), 21521–21540 (2016).
[Crossref] [PubMed]

Hanrahan, P.

M. Levoy and P. Hanrahan, “Light field rendering,” in Proceedings of ACM SIGGRAPH (ACM, 1996), pp. 31–42.

He, D.

Horowitz, M.

Hu, Y.

T. Tao, Q. Chen, S. Feng, Y. Hu, and C. Zuo, “Active depth estimation from defocus using a camera array,” Appl. Opt. 57(18), 4960–4967 (2018).
[Crossref] [PubMed]

Huang, Q.

Huang, S.

Ihrke, I.

I. Ihrke, J. Restrepo, and L. Mignard-Debise, “Principles of light field imaging briefly revisiting 25 years of research,” IEEE Signal Procss. Mag. 33(5), 59–69 (2016).

Jarabo, A.

G. Wu, B. Masia, A. Jarabo, Y. Zhang, L. Wang, Q. Dai, T. Chai, and Y. Liu, “Light field image processing: an overview,” IEEE J. Sel. Top. Signal Process. 11(7), 926–954 (2017).
[Crossref]

Jiang, H.

Jin, X.

Y. Chen, X. Jin, and Q. Dai, “Distance measurement based on light field geometry and ray tracing,” Opt. Express 25(1), 59–76 (2017).
[Crossref] [PubMed]

Joshi, N.

Kang, S. B.

Kim, C.

C. Kim, H. Zimmer, Y. Pritch, A. Sorkine-Hornung, and M. Gross, “Scene reconstruction from high spatio-angular resolution light fields,” ACM Trans. Graph. 32(4), 73 (2013).
[Crossref]

Lee, K. M.

Levin, A.

A. Levin, R. Fergus, F. Durand, and W. Freeman, “Image and depth from a conventional camera with a coded aperture,” ACM Trans. Graph. 26(3), 70 (2007).
[Crossref]

Levoy, M.

M. Levoy, “Light fields and computational imaging,” Computer 39(8), 46–55 (2006).
[Crossref]

M. Levoy and P. Hanrahan, “Light field rendering,” in Proceedings of ACM SIGGRAPH (ACM, 1996), pp. 31–42.

Lin, H.

Liu, X.

Liu, Y.

G. Wu, B. Masia, A. Jarabo, Y. Zhang, L. Wang, Q. Dai, T. Chai, and Y. Liu, “Light field image processing: an overview,” IEEE J. Sel. Top. Signal Process. 11(7), 926–954 (2017).
[Crossref]

Llado, X.

J. Salvi, S. Fernandez, T. Pribanic, and X. Llado, “A state of the art in structured light patterns for surface profilometry,” Pattern Recognit. 43(8), 2666–2680 (2010).
[Crossref]

Lv, H.

Malik, J.

Masia, B.

G. Wu, B. Masia, A. Jarabo, Y. Zhang, L. Wang, Q. Dai, T. Chai, and Y. Liu, “Light field image processing: an overview,” IEEE J. Sel. Top. Signal Process. 11(7), 926–954 (2017).
[Crossref]

Mignard-Debise, L.

I. Ihrke, J. Restrepo, and L. Mignard-Debise, “Principles of light field imaging briefly revisiting 25 years of research,” IEEE Signal Procss. Mag. 33(5), 59–69 (2016).

Mohan, A.

Niu, H.

X. Peng, Z. Yang, and H. Niu, “Multi-resolution reconstruction of 3-D image with modified temporal unwrapping algorithm,” Opt. Commun. 224(1–3), 35–44 (2003).
[Crossref]

Park, I. K.

Peng, X.

X. Peng, Z. Yang, and H. Niu, “Multi-resolution reconstruction of 3-D image with modified temporal unwrapping algorithm,” Opt. Commun. 224(1–3), 35–44 (2003).
[Crossref]

Pesch, M.

C. Hahne, A. Aggoun, V. Velisavljevic, S. Fiebig, and M. Pesch, “Refocusing distance of a standard plenoptic camera,” Opt. Express 24(19), 21521–21540 (2016).
[Crossref] [PubMed]

Pribanic, T.

J. Salvi, S. Fernandez, T. Pribanic, and X. Llado, “A state of the art in structured light patterns for surface profilometry,” Pattern Recognit. 43(8), 2666–2680 (2010).
[Crossref]

Pritch, Y.

C. Kim, H. Zimmer, Y. Pritch, A. Sorkine-Hornung, and M. Gross, “Scene reconstruction from high spatio-angular resolution light fields,” ACM Trans. Graph. 32(4), 73 (2013).
[Crossref]

Ramamoorthi, R.

Raskar, R.

Restrepo, J.

I. Ihrke, J. Restrepo, and L. Mignard-Debise, “Principles of light field imaging briefly revisiting 25 years of research,” IEEE Signal Procss. Mag. 33(5), 59–69 (2016).

Salvi, J.

J. Salvi, S. Fernandez, T. Pribanic, and X. Llado, “A state of the art in structured light patterns for surface profilometry,” Pattern Recognit. 43(8), 2666–2680 (2010).
[Crossref]

Sorkine-Hornung, A.

C. Kim, H. Zimmer, Y. Pritch, A. Sorkine-Hornung, and M. Gross, “Scene reconstruction from high spatio-angular resolution light fields,” ACM Trans. Graph. 32(4), 73 (2013).
[Crossref]

Szeliski, R.

S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, “The lumigraph,” in Proceedings of ACM SIGGRAPH (ACM, 1996), pp. 43–54.

Talvala, E.

Tao, M. W.

Tao, T.

T. Tao, Q. Chen, S. Feng, Y. Hu, and C. Zuo, “Active depth estimation from defocus using a camera array,” Appl. Opt. 57(18), 4960–4967 (2018).
[Crossref] [PubMed]

Tumblin, J.

Vaish, V.

Veeraraghavan, A.

Velisavljevic, V.

C. Hahne, A. Aggoun, V. Velisavljevic, S. Fiebig, and M. Pesch, “Refocusing distance of a standard plenoptic camera,” Opt. Express 24(19), 21521–21540 (2016).
[Crossref] [PubMed]

Wang, H.

Wang, L.

G. Wu, B. Masia, A. Jarabo, Y. Zhang, L. Wang, Q. Dai, T. Chai, and Y. Liu, “Light field image processing: an overview,” IEEE J. Sel. Top. Signal Process. 11(7), 926–954 (2017).
[Crossref]

Wang, X.

Wanner, S.

Wilburn, B.

Williem, I. K. P.

Wu, G.

G. Wu, B. Masia, A. Jarabo, Y. Zhang, L. Wang, Q. Dai, T. Chai, and Y. Liu, “Light field image processing: an overview,” IEEE J. Sel. Top. Signal Process. 11(7), 926–954 (2017).
[Crossref]

Xiang, X.

Yang, Z.

X. Peng, Z. Yang, and H. Niu, “Multi-resolution reconstruction of 3-D image with modified temporal unwrapping algorithm,” Opt. Commun. 224(1–3), 35–44 (2003).
[Crossref]

Yu, J.

Zhang, Y.

G. Wu, B. Masia, A. Jarabo, Y. Zhang, L. Wang, Q. Dai, T. Chai, and Y. Liu, “Light field image processing: an overview,” IEEE J. Sel. Top. Signal Process. 11(7), 926–954 (2017).
[Crossref]

Zhang, Z.

Zimmer, H.

C. Kim, H. Zimmer, Y. Pritch, A. Sorkine-Hornung, and M. Gross, “Scene reconstruction from high spatio-angular resolution light fields,” ACM Trans. Graph. 32(4), 73 (2013).
[Crossref]

Zuo, C.

T. Tao, Q. Chen, S. Feng, Y. Hu, and C. Zuo, “Active depth estimation from defocus using a camera array,” Appl. Opt. 57(18), 4960–4967 (2018).
[Crossref] [PubMed]

ACM Trans. Graph. (4)

A. Levin, R. Fergus, F. Durand, and W. Freeman, “Image and depth from a conventional camera with a coded aperture,” ACM Trans. Graph. 26(3), 70 (2007).
[Crossref]

C. Kim, H. Zimmer, Y. Pritch, A. Sorkine-Hornung, and M. Gross, “Scene reconstruction from high spatio-angular resolution light fields,” ACM Trans. Graph. 32(4), 73 (2013).
[Crossref]

Adv. Opt. Photonics (1)

J. Geng, “Structured-light 3D surface imaging: a tutorial,” Adv. Opt. Photonics 3(2), 128–160 (2011).
[Crossref]

Appl. Opt. (1)

T. Tao, Q. Chen, S. Feng, Y. Hu, and C. Zuo, “Active depth estimation from defocus using a camera array,” Appl. Opt. 57(18), 4960–4967 (2018).
[Crossref] [PubMed]

Computer (1)

M. Levoy, “Light fields and computational imaging,” Computer 39(8), 46–55 (2006).
[Crossref]

IEEE J. Sel. Top. Signal Process. (1)

G. Wu, B. Masia, A. Jarabo, Y. Zhang, L. Wang, Q. Dai, T. Chai, and Y. Liu, “Light field image processing: an overview,” IEEE J. Sel. Top. Signal Process. 11(7), 926–954 (2017).
[Crossref]

IEEE Signal Procss. Mag. (1)

I. Ihrke, J. Restrepo, and L. Mignard-Debise, “Principles of light field imaging briefly revisiting 25 years of research,” IEEE Signal Procss. Mag. 33(5), 59–69 (2016).

IEEE Trans. Circ. Syst. Video Tech. (1)

IEEE Trans. Pattern Anal. Mach. Intell. (1)

J. Math. Phys. (1)

A. Gershun, “The light field,” Translated by P. Moon and, G. Timoshenko, J. Math. Phys. 18(1–4), 51–151 (1936).

Opt. Commun. (1)

X. Peng, Z. Yang, and H. Niu, “Multi-resolution reconstruction of 3-D image with modified temporal unwrapping algorithm,” Opt. Commun. 224(1–3), 35–44 (2003).
[Crossref]

Opt. Express (3)

C. Hahne, A. Aggoun, V. Velisavljevic, S. Fiebig, and M. Pesch, “Refocusing distance of a standard plenoptic camera,” Opt. Express 24(19), 21521–21540 (2016).
[Crossref] [PubMed]

Y. Chen, X. Jin, and Q. Dai, “Distance measurement based on light field geometry and ray tracing,” Opt. Express 25(1), 59–76 (2017).
[Crossref] [PubMed]

Pattern Recognit. (1)

J. Salvi, S. Fernandez, T. Pribanic, and X. Llado, “A state of the art in structured light patterns for surface profilometry,” Pattern Recognit. 43(8), 2666–2680 (2010).
[Crossref]

Other (7)

E. H. Adelson and J. R. Bergen, “The plenoptic function and the elements of early vision,” in Computational models of visual processing (MIT, 1991), pp. 3–20.

M. Levoy and P. Hanrahan, “Light field rendering,” in Proceedings of ACM SIGGRAPH (ACM, 1996), pp. 31–42.

S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, “The lumigraph,” in Proceedings of ACM SIGGRAPH (ACM, 1996), pp. 43–54.

R. Ng, M. Levoy, M. Brédif, G. Duval, M. Horowitz, and P. Hanrahan, “Light field photography with a hand-held plenoptic camera,” Stanford Technical Report CSTR (2005), pp. 1–11.

Cited By

OSA participates in Crossref's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.

Click here to see a list of articles that cite this paper

Fig. 1 Experimental scene: light field images under (a) uniform illumination and (b) structured illumination; (c) phase-encoded field; enlarged parts on upper right.

Download Full Size | PPT Slide | PDF

Fig. 2 Refocused phase maps related to (a) α₁, (b) α₂, and (c) α₃; (d) absolute difference between (a) and (b); histogram of (d).

Download Full Size | PPT Slide | PDF

Fig. 3 Sheared PEF in different depths.

Download Full Size | PPT Slide | PDF

Fig. 4 Distribution curves across depth range: (a) defocus response and (b) correspondence response during active light field depth estimation; (c) defocus response and (d) correspondence response during passive light field depth estimation.

Download Full Size | PPT Slide | PDF

Fig. 5 Sub-aperture phase maps related to (a) u₁ and (b) u₂; (c) cross sections of the two phase maps with an enlarged diagram.

Download Full Size | PPT Slide | PDF

Fig. 6 Flow chart of active light field depth estimation.

Download Full Size | PPT Slide | PDF

Fig. 7 Comparison of correspondence response with weighted and unweighted angular variance.

Download Full Size | PPT Slide | PDF

Fig. 8 Passive light field depth estimation: depth maps by (a) defocus cue, (b) correspondence cue, and (c) combination of two cues; (d) cross sections of depth maps in (a), (b), and (c).

Download Full Size | PPT Slide | PDF

Fig. 9 Light field depth estimation with the SLF as an input: depth maps by (a) defocus cue, (b) correspondence cue, and (c) combination of two cues; (d) cross sections of depth maps in (a), (b), and (c).

Download Full Size | PPT Slide | PDF

Fig. 10 Distribution curves of correspondence response with weighted angular variance across depth range.

Download Full Size | PPT Slide | PDF

Fig. 11 Active light field depth estimation: (a) depth map; (b) cross sections of depth maps in (a), 9(c), and 8(c).

Download Full Size | PPT Slide | PDF

Fig. 12 Light field depth estimation for different color segments: (a) measured scene divided by colors, corresponding to blue, green, orange, vermilion, and yellow, from top to bottom; histograms of depth map corresponding to each color segment by using (b) active and (c) passive methods.

Download Full Size | PPT Slide | PDF

Fig. 13 Depth estimation evaluation referring to phase encoding: sub-aperture absolute phase difference between u₁ and u₂ corresponding to (a) active and (b) passive methods, respectively; angular variance of resampled PEF corresponding to (c) active and (d) passive methods, respectively.

Download Full Size | PPT Slide | PDF

Fig. 14 Experimental results of passive (first column) and active (second column) light field depth estimation for other measured scenes, as well as cross sections of depth maps (third column).

Download Full Size | PPT Slide | PDF

Tables (2)

Table 1 Relevant data of defocus response computation.

View Table | View all tables in this article

Table 2 Relevant data of depth estimation evaluation (rad).

View Table | View all tables in this article

Equations (6)

Equations on this page are rendered with MathJax. Learn more.

L_{α} (s, u) = L (s_{α}, u),

{\bar{L}}_{α} (s) = \frac{1}{| N_{u} |} \sum_{u^{'} \in N_{u}} L_{α} (s, u^{'})

D_{α} (s) = \frac{1}{| W_{s} |} \sum_{s^{'} \in W_{s}} | Δ_{s} {\bar{L}}_{α} (s^{'}) |

σ_{α}^{2} (s) = \frac{1}{| N_{u} |} \sum_{u^{'} \in N_{u}} {[L_{α} (s, u^{'}) - {\bar{L}}_{α} (s)]}^{2} .

C_{α} (s) = \frac{1}{| W_{s} |} \sum_{s^{'} \in W_{s}} σ_{α} (s),

σ_{α}^{2} (s) = \frac{1}{| N_{u} |} \sum_{u^{'} \in N_{u}} {(| u^{'} | + 1) \cdot [ϕ_{α} (s, u^{'}) - {\bar{ϕ}}_{α} (s)]}^{2} .

		s ₁	s ₂	s ₃
${\bar{ϕ}}_{α} (s)$	α ₁ α ₂ α ₃	0.55320.55310.5532	0.55460.55460.5547	0.55610.55620.5561
$\| Δ_{s} {\bar{ϕ}}_{α} (s) \|$	α ₁ α ₂ α ₃	0.00140.00140.0014	0.00150.00150.0015	0.00150.00150.0015
$D_{α} (s)$	α ₁ α ₂ α ₃	8.4683x10⁻⁴8.4320x10⁻⁴8.4602x10⁻⁴	8.5370x10⁻⁴8.5310x10⁻⁴8.5234x10⁻⁴	8.5968x10⁻⁴8.6077x10⁻⁴8.5784x10⁻⁴

		MAX	MEAN	STD
$Δ ϕ$	activepassive	2.839120.0501	0.00800.2841	0.04580.3023
$σ_{α}$	active	7.5823	0.1767	0.1455
$σ_{α}$	passive	70.3890	1.0768	1.0006

		s ₁	s ₂	s ₃
${\bar{ϕ}}_{α} (s)$	α ₁ α ₂ α ₃	0.55320.55310.5532	0.55460.55460.5547	0.55610.55620.5561
$\| Δ_{s} {\bar{ϕ}}_{α} (s) \|$	α ₁ α ₂ α ₃	0.00140.00140.0014	0.00150.00150.0015	0.00150.00150.0015
$D_{α} (s)$	α ₁ α ₂ α ₃	8.4683x10⁻⁴8.4320x10⁻⁴8.4602x10⁻⁴	8.5370x10⁻⁴8.5310x10⁻⁴8.5234x10⁻⁴	8.5968x10⁻⁴8.6077x10⁻⁴8.5784x10⁻⁴

		MAX	MEAN	STD
$Δ ϕ$	activepassive	2.839120.0501	0.00800.2841	0.04580.3023
$σ_{α}$	active	7.5823	0.1767	0.1455
$σ_{α}$	passive	70.3890	1.0768	1.0006