Abstract

Plenoptic imaging systems are becoming more common since they provide capabilities unattainable in conventional imaging systems, but one of their main limitations is the poor bidimensional resolution. Combining the wavefront phase measurement and the plenoptic image deconvolution, we propose a system capable of improving the resolution when a wavefront aberration is present and the image is blurred. In this work, a plenoptic system is simulated using Fourier optics, and the results show that an improved resolution is achieved, even in the presence of strong wavefront aberrations.

© 2014 Optical Society of America

Full Article  |  PDF Article

References

  • View by:
  • |
  • |
  • |

  1. E. H. Adelson and J. R. Bergen, Computational Models of Visual Processing (MIT, 1991), Vol. 1.
  2. H. E. Ives, J. Opt. Soc. Am. 20, 332 (1930).
    [Crossref]
  3. G. Lippmann, C. R. Acad. Sci. 146, 446 (1908).
  4. J. G. Marichal-Hernández, J. P. Lüke, F. Rosa, F. Perez, and J. M. Rodriguez-Ramos, 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video (IEEE, 2009).
  5. R. Ng, ACM Trans. Graph. 24, 735 (2005).
  6. J. P. Lüke, F. Perez, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, Int. J. Digital Multimedia Broadcast. 2010, 942037 (2009).
    [Crossref]
  7. R. M. Clare and R. G. Lane, J. Opt. Soc. Am. A 22, 117 (2005).
    [Crossref]
  8. L. F. Rodríguez-Ramos, Y. Martin, J. J. Diaz, J. Piqueras, and J. M. Rodriguez-Ramos, Proc. SPIE 7439, 74390I (2009).
    [Crossref]
  9. J. M. Rodriguez-Ramos, B. Femenia, I. Montilla, L. F. Rodriguez-Ramos, J. G. Marichal-Hernandez, J. P. Lüke, R. Lopez, J. J. Diaz, and Y. Martin, in Proceedings of the 1st AO4ELT Conference—Adaptive Optics for Extremely Large Telescopes (EDP Sciences, 2010), pp. 22–26.
  10. A. Lumsdaine and T. Georgiev, “Full resolution lightfield rendering,” Technical Report (Indiana University and Adobe Systems, 2008).
  11. S. A. Shroff and K. Berkner, Appl. Opt. 52, D22 (2013).
    [Crossref]
  12. D. G. Voelz, Computational Fourier Optics: A MATLAB Tutorial (SPIE, 2011).
  13. C. C. Paige and M. A. Saunders, ACM Trans. Math Softw. 8, 43 (1982).
  14. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, IEEE Trans. Image Process. 13, 600 (2004).
    [Crossref]

2013 (1)

2009 (2)

L. F. Rodríguez-Ramos, Y. Martin, J. J. Diaz, J. Piqueras, and J. M. Rodriguez-Ramos, Proc. SPIE 7439, 74390I (2009).
[Crossref]

J. P. Lüke, F. Perez, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, Int. J. Digital Multimedia Broadcast. 2010, 942037 (2009).
[Crossref]

2005 (2)

2004 (1)

Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, IEEE Trans. Image Process. 13, 600 (2004).
[Crossref]

1982 (1)

C. C. Paige and M. A. Saunders, ACM Trans. Math Softw. 8, 43 (1982).

1930 (1)

1908 (1)

G. Lippmann, C. R. Acad. Sci. 146, 446 (1908).

Adelson, E. H.

E. H. Adelson and J. R. Bergen, Computational Models of Visual Processing (MIT, 1991), Vol. 1.

Bergen, J. R.

E. H. Adelson and J. R. Bergen, Computational Models of Visual Processing (MIT, 1991), Vol. 1.

Berkner, K.

Bovik, A. C.

Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, IEEE Trans. Image Process. 13, 600 (2004).
[Crossref]

Clare, R. M.

Diaz, J. J.

L. F. Rodríguez-Ramos, Y. Martin, J. J. Diaz, J. Piqueras, and J. M. Rodriguez-Ramos, Proc. SPIE 7439, 74390I (2009).
[Crossref]

J. M. Rodriguez-Ramos, B. Femenia, I. Montilla, L. F. Rodriguez-Ramos, J. G. Marichal-Hernandez, J. P. Lüke, R. Lopez, J. J. Diaz, and Y. Martin, in Proceedings of the 1st AO4ELT Conference—Adaptive Optics for Extremely Large Telescopes (EDP Sciences, 2010), pp. 22–26.

Femenia, B.

J. M. Rodriguez-Ramos, B. Femenia, I. Montilla, L. F. Rodriguez-Ramos, J. G. Marichal-Hernandez, J. P. Lüke, R. Lopez, J. J. Diaz, and Y. Martin, in Proceedings of the 1st AO4ELT Conference—Adaptive Optics for Extremely Large Telescopes (EDP Sciences, 2010), pp. 22–26.

Georgiev, T.

A. Lumsdaine and T. Georgiev, “Full resolution lightfield rendering,” Technical Report (Indiana University and Adobe Systems, 2008).

Ives, H. E.

Lane, R. G.

Lippmann, G.

G. Lippmann, C. R. Acad. Sci. 146, 446 (1908).

Lopez, R.

J. M. Rodriguez-Ramos, B. Femenia, I. Montilla, L. F. Rodriguez-Ramos, J. G. Marichal-Hernandez, J. P. Lüke, R. Lopez, J. J. Diaz, and Y. Martin, in Proceedings of the 1st AO4ELT Conference—Adaptive Optics for Extremely Large Telescopes (EDP Sciences, 2010), pp. 22–26.

Lüke, J. P.

J. P. Lüke, F. Perez, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, Int. J. Digital Multimedia Broadcast. 2010, 942037 (2009).
[Crossref]

J. G. Marichal-Hernández, J. P. Lüke, F. Rosa, F. Perez, and J. M. Rodriguez-Ramos, 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video (IEEE, 2009).

J. M. Rodriguez-Ramos, B. Femenia, I. Montilla, L. F. Rodriguez-Ramos, J. G. Marichal-Hernandez, J. P. Lüke, R. Lopez, J. J. Diaz, and Y. Martin, in Proceedings of the 1st AO4ELT Conference—Adaptive Optics for Extremely Large Telescopes (EDP Sciences, 2010), pp. 22–26.

Lumsdaine, A.

A. Lumsdaine and T. Georgiev, “Full resolution lightfield rendering,” Technical Report (Indiana University and Adobe Systems, 2008).

Marichal-Hernandez, J. G.

J. P. Lüke, F. Perez, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, Int. J. Digital Multimedia Broadcast. 2010, 942037 (2009).
[Crossref]

J. M. Rodriguez-Ramos, B. Femenia, I. Montilla, L. F. Rodriguez-Ramos, J. G. Marichal-Hernandez, J. P. Lüke, R. Lopez, J. J. Diaz, and Y. Martin, in Proceedings of the 1st AO4ELT Conference—Adaptive Optics for Extremely Large Telescopes (EDP Sciences, 2010), pp. 22–26.

Marichal-Hernández, J. G.

J. G. Marichal-Hernández, J. P. Lüke, F. Rosa, F. Perez, and J. M. Rodriguez-Ramos, 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video (IEEE, 2009).

Martin, Y.

L. F. Rodríguez-Ramos, Y. Martin, J. J. Diaz, J. Piqueras, and J. M. Rodriguez-Ramos, Proc. SPIE 7439, 74390I (2009).
[Crossref]

J. M. Rodriguez-Ramos, B. Femenia, I. Montilla, L. F. Rodriguez-Ramos, J. G. Marichal-Hernandez, J. P. Lüke, R. Lopez, J. J. Diaz, and Y. Martin, in Proceedings of the 1st AO4ELT Conference—Adaptive Optics for Extremely Large Telescopes (EDP Sciences, 2010), pp. 22–26.

Montilla, I.

J. M. Rodriguez-Ramos, B. Femenia, I. Montilla, L. F. Rodriguez-Ramos, J. G. Marichal-Hernandez, J. P. Lüke, R. Lopez, J. J. Diaz, and Y. Martin, in Proceedings of the 1st AO4ELT Conference—Adaptive Optics for Extremely Large Telescopes (EDP Sciences, 2010), pp. 22–26.

Ng, R.

R. Ng, ACM Trans. Graph. 24, 735 (2005).

Paige, C. C.

C. C. Paige and M. A. Saunders, ACM Trans. Math Softw. 8, 43 (1982).

Perez, F.

J. P. Lüke, F. Perez, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, Int. J. Digital Multimedia Broadcast. 2010, 942037 (2009).
[Crossref]

J. G. Marichal-Hernández, J. P. Lüke, F. Rosa, F. Perez, and J. M. Rodriguez-Ramos, 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video (IEEE, 2009).

Piqueras, J.

L. F. Rodríguez-Ramos, Y. Martin, J. J. Diaz, J. Piqueras, and J. M. Rodriguez-Ramos, Proc. SPIE 7439, 74390I (2009).
[Crossref]

Rodriguez-Ramos, J. M.

L. F. Rodríguez-Ramos, Y. Martin, J. J. Diaz, J. Piqueras, and J. M. Rodriguez-Ramos, Proc. SPIE 7439, 74390I (2009).
[Crossref]

J. P. Lüke, F. Perez, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, Int. J. Digital Multimedia Broadcast. 2010, 942037 (2009).
[Crossref]

J. G. Marichal-Hernández, J. P. Lüke, F. Rosa, F. Perez, and J. M. Rodriguez-Ramos, 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video (IEEE, 2009).

J. M. Rodriguez-Ramos, B. Femenia, I. Montilla, L. F. Rodriguez-Ramos, J. G. Marichal-Hernandez, J. P. Lüke, R. Lopez, J. J. Diaz, and Y. Martin, in Proceedings of the 1st AO4ELT Conference—Adaptive Optics for Extremely Large Telescopes (EDP Sciences, 2010), pp. 22–26.

Rodriguez-Ramos, L. F.

J. M. Rodriguez-Ramos, B. Femenia, I. Montilla, L. F. Rodriguez-Ramos, J. G. Marichal-Hernandez, J. P. Lüke, R. Lopez, J. J. Diaz, and Y. Martin, in Proceedings of the 1st AO4ELT Conference—Adaptive Optics for Extremely Large Telescopes (EDP Sciences, 2010), pp. 22–26.

Rodríguez-Ramos, L. F.

L. F. Rodríguez-Ramos, Y. Martin, J. J. Diaz, J. Piqueras, and J. M. Rodriguez-Ramos, Proc. SPIE 7439, 74390I (2009).
[Crossref]

Rosa, F.

J. P. Lüke, F. Perez, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, Int. J. Digital Multimedia Broadcast. 2010, 942037 (2009).
[Crossref]

J. G. Marichal-Hernández, J. P. Lüke, F. Rosa, F. Perez, and J. M. Rodriguez-Ramos, 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video (IEEE, 2009).

Saunders, M. A.

C. C. Paige and M. A. Saunders, ACM Trans. Math Softw. 8, 43 (1982).

Sheikh, H. R.

Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, IEEE Trans. Image Process. 13, 600 (2004).
[Crossref]

Shroff, S. A.

Simoncelli, E. P.

Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, IEEE Trans. Image Process. 13, 600 (2004).
[Crossref]

Voelz, D. G.

D. G. Voelz, Computational Fourier Optics: A MATLAB Tutorial (SPIE, 2011).

Wang, Z.

Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, IEEE Trans. Image Process. 13, 600 (2004).
[Crossref]

ACM Trans. Graph. (1)

R. Ng, ACM Trans. Graph. 24, 735 (2005).

ACM Trans. Math Softw. (1)

C. C. Paige and M. A. Saunders, ACM Trans. Math Softw. 8, 43 (1982).

Appl. Opt. (1)

C. R. Acad. Sci. (1)

G. Lippmann, C. R. Acad. Sci. 146, 446 (1908).

IEEE Trans. Image Process. (1)

Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, IEEE Trans. Image Process. 13, 600 (2004).
[Crossref]

Int. J. Digital Multimedia Broadcast. (1)

J. P. Lüke, F. Perez, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, Int. J. Digital Multimedia Broadcast. 2010, 942037 (2009).
[Crossref]

J. Opt. Soc. Am. (1)

J. Opt. Soc. Am. A (1)

Proc. SPIE (1)

L. F. Rodríguez-Ramos, Y. Martin, J. J. Diaz, J. Piqueras, and J. M. Rodriguez-Ramos, Proc. SPIE 7439, 74390I (2009).
[Crossref]

Other (5)

J. M. Rodriguez-Ramos, B. Femenia, I. Montilla, L. F. Rodriguez-Ramos, J. G. Marichal-Hernandez, J. P. Lüke, R. Lopez, J. J. Diaz, and Y. Martin, in Proceedings of the 1st AO4ELT Conference—Adaptive Optics for Extremely Large Telescopes (EDP Sciences, 2010), pp. 22–26.

A. Lumsdaine and T. Georgiev, “Full resolution lightfield rendering,” Technical Report (Indiana University and Adobe Systems, 2008).

E. H. Adelson and J. R. Bergen, Computational Models of Visual Processing (MIT, 1991), Vol. 1.

J. G. Marichal-Hernández, J. P. Lüke, F. Rosa, F. Perez, and J. M. Rodriguez-Ramos, 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video (IEEE, 2009).

D. G. Voelz, Computational Fourier Optics: A MATLAB Tutorial (SPIE, 2011).

Cited By

OSA participates in Crossref's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (8)

Fig. 1.
Fig. 1.

Schematic of a basic plenoptic sensor.

Fig. 2.
Fig. 2.

Schematic of the simulated system. The phase screen layer is placed in the main lens pupil. The object is in the conjugated plane of the main lens.

Fig. 3.
Fig. 3.

Left, aperture of the main lens. Right, sample plenoptic image. Creating an image rearranging pixels marked with “*” would synthesize a 4 by 4 pixels image with the point of view from point “a” in the main lens.

Fig. 4.
Fig. 4.

Upper left, original image. Upper right, blurred image because of the phase screen. Bottom left, plenoptic image. Bottom right, deconvolved image.

Fig. 5.
Fig. 5.

Left, original object used to test, based on the 1951 USAF chart. Center, image created at microlens plane. Right, plenoptic image to be deconvolved.

Fig. 6.
Fig. 6.

Deconvolved images and detail of the central groups. The resolution of the recovered phase screen varies between 256×256 and 8×8 pixels.

Fig. 7.
Fig. 7.

Structural similarity (SSIM) versus recovered phase screen resolution.

Fig. 8.
Fig. 8.

Structural similarity (SSIM) of object and deconvolved image versus an SNR in plenoptic image.

Equations (6)

Equations on this page are rendered with MathJax. Learn more.

U1(s,t)=I1{I{P(s,t)Ui(s,t)exp(jk(s2+t22zml+Φ(s,t)))}exp(jπλzml(fs2+ft2))},
Um,n(ξ,η)=I1{I{Ui(P(m1)+ξ,Q(n1)+η)exp(jk2zμl(ξ2+η2))}exp(jπλzμl(fξ2+fη2))}.
I(u,v)=|Um,n(u(m1)P,v(n1)Q)|2,
dμl12ρc,
[Ipleno]=[IR][Iobject],
[Iobject]=[IR]1[Ipleno].

Metrics