Abstract

In computational integral imaging (II), the elemental images are processed on serial processors to reconstruct one plane (slice) of the 3D scene. In this paper, we present a fast three-dimensional (3D) integral imaging system via a graphics processing unit (GPU) which allows parallel processing with multiple processors. We show that it can significantly accelerate 3D scene reconstruction in II using the GPU based stream-processing model. The streaming version of the ray back propagation algorithm with lookup table is presented. It is demonstrated that the ray back propagation algorithm with a lookup table for the 3D scene reconstruction in II to be processed on parallel processors may greatly improve computational speed while requiring minimally larger memory space as compared with CPU sequential computing. Experimental results verify the feasibility for parallel implementation of 3D integral imaging. To the best of our knowledge, this is the first study on achieving a 3D computational integral imaging system using GPU computing with high parallelism.

© 2012 IEEE

PDF Article

References

  • View by:
  • |
  • |

  1. B. Javidi, F. Okano, J. Sun, 3D Imaging, Visualization, and Display Technologies (Springer, 2008).
  2. G. Lippmann, "La photographie intégrale," C. R. Acad. Sci. 146, 446-451 (1908).
  3. H. Hoshino, F. Okano, H. Isono, I. Yuyama, "Analysis of resolution limitation of integral photography," J. Opt. Soc. Amer. A 15, 2059-2065 (1998).
  4. C. Burckhardt, "Optimum parameters and resolution limitation of integral photography," J. Opt. Soc. Amer. 58, 71-76 (1968).
  5. F. Okano, J. Arai, K. Mitani, M. Okui, "Real-time integral imaging based on extremely high resolution video system," Proc. IEEE 94, 490-501 (2006).
  6. F. Okano, H. Hoshino, J. Arai, I. Yuyama, "Three-dimensional video system based on integral photography," Opt. Eng. 38, 1072-1077 (1999).
  7. M. Forman, N. Davies, M. McCormick, "Continuous parallax in discrete pixelated integral three-dimensional displays," J. Opt. Soc. Amer. A 20, 411-420 (2003).
  8. R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, B. Javidi, "Progress in 3-D multiperspective display by integral imaging," Proc. IEEE 97, 1067-1077 (2009).
  9. Y. Igarishi, H. Murata, M. Ueda, "3D display system using a computer-generated integral photograph," Jpn. J. Appl. Phys. 17, 1683-1684 (1978).
  10. A. Stern, B. Javidi, "Three-dimensional image sensing, visualization, and processing using integral imaging," Proc. IEEE 94, 591-607 (2006).
  11. O. Matoba, E. Tajahuerce, B. Javidi, "Real-time three-dimensional object recognition with multiple perspectives imaging," Appl. Opt. 40, 3318-3325 (2001).
  12. S. Hong, J. Jang, B. Javidi, "Three-dimensional volumetric object reconstruction using computational integral imaging," Opt. Express 12, 483-491 (2004).
  13. I. Moon, B. Javidi, "Three-dimensional visualization of objects in scattering medium by use of computational integral imaging," Opt. Express 16, 13080-13089 (2008).
  14. M. Levoy, "Light fields and computational imaging," IEEE Comput. Mag. 39, 46-55 (2006).
  15. B. Lee, S. Jung, J.-H. Park, "Viewing-angle-enhanced integral imaging using lens switching," Opt. Lett. 27, 818-820 (2002).
  16. D. Shin, M. Cho, B. Javidi, "Three-dimensional optical microscopy using axially distributed image sensing," Opt. Lett. 35, 3646-3648 (2010).
  17. M. Daneshpanah, B. Javidi, E. Watson, "Three dimensional imaging with randomly distributed sensors," Opt. Express 16, 6368-6377 (2008).
  18. M. Cho, M. Daneshpanah, I. Moon, B. Javidi, "Three-dimensional optical sensing and visualization using integral imaging," Proc. IEEE 99, 556-575 (2011).
  19. D. Michael, "Signal processing and general-purpose computing on GPUs," IEEE Signal Process. Mag. 24, 109-114 (2007).
  20. M. Bryan, E. Niklas, "Towards utilizing GPUs in information visualization: A model and implementation of image-space operations," IEEE Trans. Visual. Comput. Graph. 15, 1105-1112 (2009).
  21. D. Luebke, G. Humphreys, "How GPUs work," IEEE Comput. Soc. 40, 96-100 (2007).
  22. E. R. Altman, "CPUs and GPUs: Who owns the future?," IEEE Micro 31, 2-3 (2011).
  23. D. Kirk, W. Hwu, Programming Massively Parallel Processors (Elsevier, 2010).
  24. J. Sanders, E. Kandrot, CUDA by Example (Addison-Wesley, 2010).
  25. Y. Taguchi, T. Koike, K. Takahashi, T. Naemura, "TransCAIP: A live 3D TV system using a camera array and an integral photography display with interactive control of viewing parameters," IEEE Trans. Visual. Comput. Graph. 15, 841-852 (2009).
  26. T. Balogh, P. Kovacs, "Real-time 3D light field transmission," Proc. SPIE (2010) pp. 5-11.
  27. H. Tan, J. Xia, Y. He, Y. Guan, "A system for capturing, rendering and multiplexing images on multi-view autostereoscopic display," Int. Conf. Cyberworlds (2010) pp. 325-330.

2011

M. Cho, M. Daneshpanah, I. Moon, B. Javidi, "Three-dimensional optical sensing and visualization using integral imaging," Proc. IEEE 99, 556-575 (2011).

E. R. Altman, "CPUs and GPUs: Who owns the future?," IEEE Micro 31, 2-3 (2011).

2010

2009

M. Bryan, E. Niklas, "Towards utilizing GPUs in information visualization: A model and implementation of image-space operations," IEEE Trans. Visual. Comput. Graph. 15, 1105-1112 (2009).

Y. Taguchi, T. Koike, K. Takahashi, T. Naemura, "TransCAIP: A live 3D TV system using a camera array and an integral photography display with interactive control of viewing parameters," IEEE Trans. Visual. Comput. Graph. 15, 841-852 (2009).

R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, B. Javidi, "Progress in 3-D multiperspective display by integral imaging," Proc. IEEE 97, 1067-1077 (2009).

2008

2007

D. Luebke, G. Humphreys, "How GPUs work," IEEE Comput. Soc. 40, 96-100 (2007).

D. Michael, "Signal processing and general-purpose computing on GPUs," IEEE Signal Process. Mag. 24, 109-114 (2007).

2006

A. Stern, B. Javidi, "Three-dimensional image sensing, visualization, and processing using integral imaging," Proc. IEEE 94, 591-607 (2006).

M. Levoy, "Light fields and computational imaging," IEEE Comput. Mag. 39, 46-55 (2006).

F. Okano, J. Arai, K. Mitani, M. Okui, "Real-time integral imaging based on extremely high resolution video system," Proc. IEEE 94, 490-501 (2006).

2004

S. Hong, J. Jang, B. Javidi, "Three-dimensional volumetric object reconstruction using computational integral imaging," Opt. Express 12, 483-491 (2004).

2003

M. Forman, N. Davies, M. McCormick, "Continuous parallax in discrete pixelated integral three-dimensional displays," J. Opt. Soc. Amer. A 20, 411-420 (2003).

2002

2001

O. Matoba, E. Tajahuerce, B. Javidi, "Real-time three-dimensional object recognition with multiple perspectives imaging," Appl. Opt. 40, 3318-3325 (2001).

1999

F. Okano, H. Hoshino, J. Arai, I. Yuyama, "Three-dimensional video system based on integral photography," Opt. Eng. 38, 1072-1077 (1999).

1998

H. Hoshino, F. Okano, H. Isono, I. Yuyama, "Analysis of resolution limitation of integral photography," J. Opt. Soc. Amer. A 15, 2059-2065 (1998).

1978

Y. Igarishi, H. Murata, M. Ueda, "3D display system using a computer-generated integral photograph," Jpn. J. Appl. Phys. 17, 1683-1684 (1978).

1968

C. Burckhardt, "Optimum parameters and resolution limitation of integral photography," J. Opt. Soc. Amer. 58, 71-76 (1968).

1908

G. Lippmann, "La photographie intégrale," C. R. Acad. Sci. 146, 446-451 (1908).

Appl. Opt.

O. Matoba, E. Tajahuerce, B. Javidi, "Real-time three-dimensional object recognition with multiple perspectives imaging," Appl. Opt. 40, 3318-3325 (2001).

C. R. Acad. Sci.

G. Lippmann, "La photographie intégrale," C. R. Acad. Sci. 146, 446-451 (1908).

IEEE Comput. Mag.

M. Levoy, "Light fields and computational imaging," IEEE Comput. Mag. 39, 46-55 (2006).

IEEE Comput. Soc.

D. Luebke, G. Humphreys, "How GPUs work," IEEE Comput. Soc. 40, 96-100 (2007).

IEEE Micro

E. R. Altman, "CPUs and GPUs: Who owns the future?," IEEE Micro 31, 2-3 (2011).

IEEE Signal Process. Mag.

D. Michael, "Signal processing and general-purpose computing on GPUs," IEEE Signal Process. Mag. 24, 109-114 (2007).

IEEE Trans. Visual. Comput. Graph.

M. Bryan, E. Niklas, "Towards utilizing GPUs in information visualization: A model and implementation of image-space operations," IEEE Trans. Visual. Comput. Graph. 15, 1105-1112 (2009).

Y. Taguchi, T. Koike, K. Takahashi, T. Naemura, "TransCAIP: A live 3D TV system using a camera array and an integral photography display with interactive control of viewing parameters," IEEE Trans. Visual. Comput. Graph. 15, 841-852 (2009).

J. Opt. Soc. Amer. A

M. Forman, N. Davies, M. McCormick, "Continuous parallax in discrete pixelated integral three-dimensional displays," J. Opt. Soc. Amer. A 20, 411-420 (2003).

J. Opt. Soc. Amer.

C. Burckhardt, "Optimum parameters and resolution limitation of integral photography," J. Opt. Soc. Amer. 58, 71-76 (1968).

J. Opt. Soc. Amer. A

H. Hoshino, F. Okano, H. Isono, I. Yuyama, "Analysis of resolution limitation of integral photography," J. Opt. Soc. Amer. A 15, 2059-2065 (1998).

Jpn. J. Appl. Phys.

Y. Igarishi, H. Murata, M. Ueda, "3D display system using a computer-generated integral photograph," Jpn. J. Appl. Phys. 17, 1683-1684 (1978).

Opt. Express

S. Hong, J. Jang, B. Javidi, "Three-dimensional volumetric object reconstruction using computational integral imaging," Opt. Express 12, 483-491 (2004).

Opt. Eng.

F. Okano, H. Hoshino, J. Arai, I. Yuyama, "Three-dimensional video system based on integral photography," Opt. Eng. 38, 1072-1077 (1999).

Opt. Express

Opt. Lett.

Proc. IEEE

A. Stern, B. Javidi, "Three-dimensional image sensing, visualization, and processing using integral imaging," Proc. IEEE 94, 591-607 (2006).

Proc. IEEE

M. Cho, M. Daneshpanah, I. Moon, B. Javidi, "Three-dimensional optical sensing and visualization using integral imaging," Proc. IEEE 99, 556-575 (2011).

R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, B. Javidi, "Progress in 3-D multiperspective display by integral imaging," Proc. IEEE 97, 1067-1077 (2009).

F. Okano, J. Arai, K. Mitani, M. Okui, "Real-time integral imaging based on extremely high resolution video system," Proc. IEEE 94, 490-501 (2006).

Other

B. Javidi, F. Okano, J. Sun, 3D Imaging, Visualization, and Display Technologies (Springer, 2008).

D. Kirk, W. Hwu, Programming Massively Parallel Processors (Elsevier, 2010).

J. Sanders, E. Kandrot, CUDA by Example (Addison-Wesley, 2010).

T. Balogh, P. Kovacs, "Real-time 3D light field transmission," Proc. SPIE (2010) pp. 5-11.

H. Tan, J. Xia, Y. He, Y. Guan, "A system for capturing, rendering and multiplexing images on multi-view autostereoscopic display," Int. Conf. Cyberworlds (2010) pp. 325-330.

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.