Abstract

Recently, three-dimensional (3D) object reconstruction using photon counting integral imaging (PCII) based on grayscale elemental images has been reported. In this paper, we present a multispectral PCII system using Bayer elemental images for multispectral visualization of photon limited 3D scenes. We measure the accuracy as well as the speed of demosaicing algorithms to estimate multispectral 3D scenes at low light levels. Experimental results demonstrate that the gradient corrected linear interpolation technique achieves better performance in terms of peak-to-SNR (PSNR) and faster computation.

© 2013 IEEE

PDF Article

References

  • View by:
  • |
  • |

  1. G. Lippmann, "La photographie integrale," Comptes-Rendus Acad. Sci. 146, 446-451 (1908).
  2. H. Ives, "Optical properties of a Lippman lenticulated sheet," J. Opt. Soc. Amer. 21, 171 (1931).
  3. C. Burckhardt, "Optimum parameters and resolution limitation of integral photography," J. Opt. Soc. Amer. 58, 71-74 (1968).
  4. M. Forman, N. Davies, M. McCormick, "Continuous parallax in discrete pixelated integral three-dimensional displays," J. Opt. Soc. Amer. A 20, 411-420 (2003).
  5. H. Hoshino, F. Okano, H. Isono, I. Yuyama, "Analysis of resolution limitation of integral photography," J. Opt. Soc. Amer. A 15, 2059-2065 (1998).
  6. F. Okano, J. Arai, K. Mitani, M. Okui, "Real-time integral imaging based on extremely high resolution video system," Proc. IEEE 94, 490-501 (2006).
  7. B. Javidi, F. Okano, Three Dimensional Television, Video, and Display Technologies (Springer, 2002).
  8. J. Park, K. Hong, B. Lee, "Recent progress in three-dimensional information processing based on integral imaging," Appl. Opt. 48, H77-H94 (2009).
  9. R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, B. Javidi, "Progress in 3-D multiperspective display by integral imaging," Proc. IEEE 97, 1067-1077 (2009).
  10. B. Tavakoli, B. Javidi, E. Watson, "Three dimensional visualization by photon counting computational integral imaging," Opt. Express 16, 4426-4436 (2008).
  11. C. Lee, I. Moon, B. Javidi, "Photon counting 3D integral imaging with compression of elemental images," J. Opt. Soc. Amer. A 29, 854-860 (2012).
  12. D. Aloni, A. Stern, B. Javidi, "Three-dimensional photon counting integral imaging reconstruction using penalized maximum likelihood expectation maximization," Opt. Express 19, 19681-19687 (2011).
  13. S. Yeom, B. Javidi, E. Watson, "Photon counting passive 3D image sensing for automatic target recognition," Opt. Express 13, 9310-9331 (2005).
  14. I. Moon, B. Javidi, "Three-dimensional recognition of photon starved events using computational integral imaging and statistical sampling," Opt. Lett. 34, 731-733 (2009).
  15. J. W. Goodman, Statist. Opt. (Wiley-Interscience, 1985).
  16. M. Guillanume, P. Melon, P. Refregier, "Maximum-likelihood estimation of an astronomical image from a sequence at low photon levels," J. Opt. Soc. Amer. A 15, 2841-2848 (1998).
  17. A. Yip, P. Sinha, "Contribution of color to face recognition," Perception 31, 995-1003 (2002).
  18. B. Gunturk, J. Glotzbach, Y. Altunbasak, R. Schafer, R. Mersereau, "Demosaicking: Color filter array interpolation," IEEE Signal Process. Mag. 22, 44-54 (2005).
  19. R. Ramanath, W. Snyder, G. Bilbro, W. Sander, "Demosaicing methods for Bayer color arrays," J. Electron. Imag. 11, 306-315 (2002).
  20. H. Malvar, L. He, R. Cutler, "High-quality linear interpolation for demosaicing of Bayer-patterned color images," IEEE Int. Conf. on Acoust., Speech, Signal Process. (2004) pp. 485-488.

2012

C. Lee, I. Moon, B. Javidi, "Photon counting 3D integral imaging with compression of elemental images," J. Opt. Soc. Amer. A 29, 854-860 (2012).

2011

2009

2008

2006

F. Okano, J. Arai, K. Mitani, M. Okui, "Real-time integral imaging based on extremely high resolution video system," Proc. IEEE 94, 490-501 (2006).

2005

S. Yeom, B. Javidi, E. Watson, "Photon counting passive 3D image sensing for automatic target recognition," Opt. Express 13, 9310-9331 (2005).

B. Gunturk, J. Glotzbach, Y. Altunbasak, R. Schafer, R. Mersereau, "Demosaicking: Color filter array interpolation," IEEE Signal Process. Mag. 22, 44-54 (2005).

2003

M. Forman, N. Davies, M. McCormick, "Continuous parallax in discrete pixelated integral three-dimensional displays," J. Opt. Soc. Amer. A 20, 411-420 (2003).

2002

R. Ramanath, W. Snyder, G. Bilbro, W. Sander, "Demosaicing methods for Bayer color arrays," J. Electron. Imag. 11, 306-315 (2002).

A. Yip, P. Sinha, "Contribution of color to face recognition," Perception 31, 995-1003 (2002).

1998

H. Hoshino, F. Okano, H. Isono, I. Yuyama, "Analysis of resolution limitation of integral photography," J. Opt. Soc. Amer. A 15, 2059-2065 (1998).

M. Guillanume, P. Melon, P. Refregier, "Maximum-likelihood estimation of an astronomical image from a sequence at low photon levels," J. Opt. Soc. Amer. A 15, 2841-2848 (1998).

1968

C. Burckhardt, "Optimum parameters and resolution limitation of integral photography," J. Opt. Soc. Amer. 58, 71-74 (1968).

1931

H. Ives, "Optical properties of a Lippman lenticulated sheet," J. Opt. Soc. Amer. 21, 171 (1931).

1908

G. Lippmann, "La photographie integrale," Comptes-Rendus Acad. Sci. 146, 446-451 (1908).

Appl. Opt.

Comptes-Rendus Acad. Sci.

G. Lippmann, "La photographie integrale," Comptes-Rendus Acad. Sci. 146, 446-451 (1908).

IEEE Signal Process. Mag.

B. Gunturk, J. Glotzbach, Y. Altunbasak, R. Schafer, R. Mersereau, "Demosaicking: Color filter array interpolation," IEEE Signal Process. Mag. 22, 44-54 (2005).

J. Electron. Imag.

R. Ramanath, W. Snyder, G. Bilbro, W. Sander, "Demosaicing methods for Bayer color arrays," J. Electron. Imag. 11, 306-315 (2002).

J. Opt. Soc. Amer.

H. Ives, "Optical properties of a Lippman lenticulated sheet," J. Opt. Soc. Amer. 21, 171 (1931).

C. Burckhardt, "Optimum parameters and resolution limitation of integral photography," J. Opt. Soc. Amer. 58, 71-74 (1968).

M. Forman, N. Davies, M. McCormick, "Continuous parallax in discrete pixelated integral three-dimensional displays," J. Opt. Soc. Amer. A 20, 411-420 (2003).

H. Hoshino, F. Okano, H. Isono, I. Yuyama, "Analysis of resolution limitation of integral photography," J. Opt. Soc. Amer. A 15, 2059-2065 (1998).

C. Lee, I. Moon, B. Javidi, "Photon counting 3D integral imaging with compression of elemental images," J. Opt. Soc. Amer. A 29, 854-860 (2012).

M. Guillanume, P. Melon, P. Refregier, "Maximum-likelihood estimation of an astronomical image from a sequence at low photon levels," J. Opt. Soc. Amer. A 15, 2841-2848 (1998).

Opt. Express

Opt. Lett.

Perception

A. Yip, P. Sinha, "Contribution of color to face recognition," Perception 31, 995-1003 (2002).

Proc. IEEE

F. Okano, J. Arai, K. Mitani, M. Okui, "Real-time integral imaging based on extremely high resolution video system," Proc. IEEE 94, 490-501 (2006).

R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, B. Javidi, "Progress in 3-D multiperspective display by integral imaging," Proc. IEEE 97, 1067-1077 (2009).

Other

H. Malvar, L. He, R. Cutler, "High-quality linear interpolation for demosaicing of Bayer-patterned color images," IEEE Int. Conf. on Acoust., Speech, Signal Process. (2004) pp. 485-488.

B. Javidi, F. Okano, Three Dimensional Television, Video, and Display Technologies (Springer, 2002).

J. W. Goodman, Statist. Opt. (Wiley-Interscience, 1985).

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.