Abstract

In multi-view three-dimensional imaging, to capture the elemental images of distant objects, the use of a field-like lens that projects the reference plane onto the microlens array is necessary. In this case, the spatial resolution of reconstructed images is equal to the spatial density of microlenses in the array. In this paper we report a simple method, based on the realization of double snapshots, to double the 2D pixel density of reconstructed scenes. Experiments are reported to support the proposed approach.

© 2012 OSA

Full Article  |  PDF Article

References

  • View by:
  • |
  • |
  • |

  1. G. Lippmann, “Epreuves reversibles donnant la sensation du relief,” J. Phys. 7, 821–825 (1908).
  2. B. Javidi and F. Okano, eds., Three-Dimensional Television, Video and Display Technologies (Springer-Verlag, 2002).
  3. S.-H. Hong, J.-S. Jang, and B. Javidi, “Three-dimensional volumetric object reconstruction using computational integral imaging,” Opt. Express 12(3), 483–491 (2004).
    [CrossRef] [PubMed]
  4. J.-H. Park, K. Hong, and B. Lee, “Recent progress in three-dimensional information processing based on integral imaging,” Appl. Opt. 48(34), H77–H94 (2009).
    [CrossRef] [PubMed]
  5. B. Javidi, R. Ponce-Díaz, and S.-H. Hong, “Three-dimensional recognition of occluded objects by using computational integral imaging,” Opt. Lett. 31(8), 1106–1108 (2006).
    [CrossRef] [PubMed]
  6. S. Yeom, B. Javidi, and E. Watson, “Photon counting passive 3D image sensing for automatic target recognition,” Opt. Express 13(23), 9310–9330 (2005).
    [CrossRef] [PubMed]
  7. F. Okano, J. Arai, H. Hoshino, and I. Yuyama, “Three-dimensional video system based on integral photography,” Opt. Eng. 38(6), 1072–1077 (1999).
    [CrossRef]
  8. N. Davies, M. McCormick, and L. Yang, “Three-dimensional imaging systems: a new development,” Appl. Opt. 27(21), 4520–4528 (1988).
    [CrossRef] [PubMed]
  9. J. P. Lüke, F. Perez Nava, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, “Near real-time estimation of super-resolved depth and all-in-focus images from a plenoptic camera using graphics processing units,” Int. J. Digit. Multimed. Broadcast. 2010, 942037 (2010).
    [CrossRef]
  10. H. Navarro, R. Martínez-Cuenca, A. Molina, M. Martínez-Corral, G. Saavedra, and B. Javidi, “Method to remedy image degradations due to facet braiding in 3D InI monitors,” J. Display Technol. 6(10), 404–411 (2010).
    [CrossRef]
  11. J. Y. Son, B. Javidi, S. Yano, and K. H. Choi, “Recent developments in 3-D imaging technologies,” J. Display Technol. 6(10), 394–403 (2010).
    [CrossRef]
  12. S. H. Hong, J. S. Jang, and B. Javidi, “Three-dimensional volumetric object reconstruction using computational integral imaging,” Opt. Express 12(3), 483–491 (2004).
    [CrossRef] [PubMed]
  13. Y. T. Lim, J. H. Park, K. C. Kwon, and N. Kim, “Resolution-enhanced integral imaging microscopy that uses lens array shifting,” Opt. Express 17(21), 19253–19263 (2009).
    [CrossRef] [PubMed]
  14. A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen, and C. Zhang, “Multiview imaging and 3DTV,” IEEE Signal Process. Mag. 24, 10–21 (2007).
  15. E. H. Adelson and J. Y. A. Wang, “Single lens stereo with plenoptic camera,” IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 99–106 (1992).
    [CrossRef]
  16. M. Levoy, R. Ng, A. Adams, M. Footer, and M. Horowitz, “Light field microscopy,” ACM Trans. Graph. 25(3), 924–934 (2006).
    [CrossRef]
  17. J. S. Jang and B. Javidi, “Three-dimensional integral imaging with electronically synthesized lenslet arrays,” Opt. Lett. 27(20), 1767–1769 (2002).
    [CrossRef] [PubMed]
  18. S. H. Hong and B. Javidi, “Improved resolution 3D object reconstruction using computational integral imaging with time multiplexing,” Opt. Express 12(19), 4579–4588 (2004).
    [CrossRef] [PubMed]
  19. R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, and B. Javidi, “Progress in 3-D multiperspective display by integral imaging,” Proc. IEEE 97(6), 1067–1077 (2009).
    [CrossRef]

2010

J. P. Lüke, F. Perez Nava, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, “Near real-time estimation of super-resolved depth and all-in-focus images from a plenoptic camera using graphics processing units,” Int. J. Digit. Multimed. Broadcast. 2010, 942037 (2010).
[CrossRef]

J. Y. Son, B. Javidi, S. Yano, and K. H. Choi, “Recent developments in 3-D imaging technologies,” J. Display Technol. 6(10), 394–403 (2010).
[CrossRef]

H. Navarro, R. Martínez-Cuenca, A. Molina, M. Martínez-Corral, G. Saavedra, and B. Javidi, “Method to remedy image degradations due to facet braiding in 3D InI monitors,” J. Display Technol. 6(10), 404–411 (2010).
[CrossRef]

2009

2007

A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen, and C. Zhang, “Multiview imaging and 3DTV,” IEEE Signal Process. Mag. 24, 10–21 (2007).

2006

2005

2004

2002

1999

F. Okano, J. Arai, H. Hoshino, and I. Yuyama, “Three-dimensional video system based on integral photography,” Opt. Eng. 38(6), 1072–1077 (1999).
[CrossRef]

1992

E. H. Adelson and J. Y. A. Wang, “Single lens stereo with plenoptic camera,” IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 99–106 (1992).
[CrossRef]

1988

1908

G. Lippmann, “Epreuves reversibles donnant la sensation du relief,” J. Phys. 7, 821–825 (1908).

Adams, A.

M. Levoy, R. Ng, A. Adams, M. Footer, and M. Horowitz, “Light field microscopy,” ACM Trans. Graph. 25(3), 924–934 (2006).
[CrossRef]

Adelson, E. H.

E. H. Adelson and J. Y. A. Wang, “Single lens stereo with plenoptic camera,” IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 99–106 (1992).
[CrossRef]

Arai, J.

F. Okano, J. Arai, H. Hoshino, and I. Yuyama, “Three-dimensional video system based on integral photography,” Opt. Eng. 38(6), 1072–1077 (1999).
[CrossRef]

Chen, T.

A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen, and C. Zhang, “Multiview imaging and 3DTV,” IEEE Signal Process. Mag. 24, 10–21 (2007).

Choi, K. H.

Davies, N.

Footer, M.

M. Levoy, R. Ng, A. Adams, M. Footer, and M. Horowitz, “Light field microscopy,” ACM Trans. Graph. 25(3), 924–934 (2006).
[CrossRef]

Hong, K.

Hong, S. H.

Hong, S.-H.

Horowitz, M.

M. Levoy, R. Ng, A. Adams, M. Footer, and M. Horowitz, “Light field microscopy,” ACM Trans. Graph. 25(3), 924–934 (2006).
[CrossRef]

Hoshino, H.

F. Okano, J. Arai, H. Hoshino, and I. Yuyama, “Three-dimensional video system based on integral photography,” Opt. Eng. 38(6), 1072–1077 (1999).
[CrossRef]

Jang, J. S.

Jang, J.-S.

Javidi, B.

H. Navarro, R. Martínez-Cuenca, A. Molina, M. Martínez-Corral, G. Saavedra, and B. Javidi, “Method to remedy image degradations due to facet braiding in 3D InI monitors,” J. Display Technol. 6(10), 404–411 (2010).
[CrossRef]

J. Y. Son, B. Javidi, S. Yano, and K. H. Choi, “Recent developments in 3-D imaging technologies,” J. Display Technol. 6(10), 394–403 (2010).
[CrossRef]

R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, and B. Javidi, “Progress in 3-D multiperspective display by integral imaging,” Proc. IEEE 97(6), 1067–1077 (2009).
[CrossRef]

B. Javidi, R. Ponce-Díaz, and S.-H. Hong, “Three-dimensional recognition of occluded objects by using computational integral imaging,” Opt. Lett. 31(8), 1106–1108 (2006).
[CrossRef] [PubMed]

S. Yeom, B. Javidi, and E. Watson, “Photon counting passive 3D image sensing for automatic target recognition,” Opt. Express 13(23), 9310–9330 (2005).
[CrossRef] [PubMed]

S. H. Hong, J. S. Jang, and B. Javidi, “Three-dimensional volumetric object reconstruction using computational integral imaging,” Opt. Express 12(3), 483–491 (2004).
[CrossRef] [PubMed]

S.-H. Hong, J.-S. Jang, and B. Javidi, “Three-dimensional volumetric object reconstruction using computational integral imaging,” Opt. Express 12(3), 483–491 (2004).
[CrossRef] [PubMed]

S. H. Hong and B. Javidi, “Improved resolution 3D object reconstruction using computational integral imaging with time multiplexing,” Opt. Express 12(19), 4579–4588 (2004).
[CrossRef] [PubMed]

J. S. Jang and B. Javidi, “Three-dimensional integral imaging with electronically synthesized lenslet arrays,” Opt. Lett. 27(20), 1767–1769 (2002).
[CrossRef] [PubMed]

Kim, N.

Kubota, A.

A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen, and C. Zhang, “Multiview imaging and 3DTV,” IEEE Signal Process. Mag. 24, 10–21 (2007).

Kwon, K. C.

Lee, B.

Levoy, M.

M. Levoy, R. Ng, A. Adams, M. Footer, and M. Horowitz, “Light field microscopy,” ACM Trans. Graph. 25(3), 924–934 (2006).
[CrossRef]

Lim, Y. T.

Lippmann, G.

G. Lippmann, “Epreuves reversibles donnant la sensation du relief,” J. Phys. 7, 821–825 (1908).

Lüke, J. P.

J. P. Lüke, F. Perez Nava, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, “Near real-time estimation of super-resolved depth and all-in-focus images from a plenoptic camera using graphics processing units,” Int. J. Digit. Multimed. Broadcast. 2010, 942037 (2010).
[CrossRef]

Magnor, M.

A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen, and C. Zhang, “Multiview imaging and 3DTV,” IEEE Signal Process. Mag. 24, 10–21 (2007).

Marichal-Hernandez, J. G.

J. P. Lüke, F. Perez Nava, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, “Near real-time estimation of super-resolved depth and all-in-focus images from a plenoptic camera using graphics processing units,” Int. J. Digit. Multimed. Broadcast. 2010, 942037 (2010).
[CrossRef]

Martinez-Corral, M.

R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, and B. Javidi, “Progress in 3-D multiperspective display by integral imaging,” Proc. IEEE 97(6), 1067–1077 (2009).
[CrossRef]

Martínez-Corral, M.

Martinez-Cuenca, R.

R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, and B. Javidi, “Progress in 3-D multiperspective display by integral imaging,” Proc. IEEE 97(6), 1067–1077 (2009).
[CrossRef]

Martínez-Cuenca, R.

McCormick, M.

Molina, A.

Navarro, H.

Ng, R.

M. Levoy, R. Ng, A. Adams, M. Footer, and M. Horowitz, “Light field microscopy,” ACM Trans. Graph. 25(3), 924–934 (2006).
[CrossRef]

Okano, F.

F. Okano, J. Arai, H. Hoshino, and I. Yuyama, “Three-dimensional video system based on integral photography,” Opt. Eng. 38(6), 1072–1077 (1999).
[CrossRef]

Park, J. H.

Park, J.-H.

Perez Nava, F.

J. P. Lüke, F. Perez Nava, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, “Near real-time estimation of super-resolved depth and all-in-focus images from a plenoptic camera using graphics processing units,” Int. J. Digit. Multimed. Broadcast. 2010, 942037 (2010).
[CrossRef]

Ponce-Díaz, R.

Rodriguez-Ramos, J. M.

J. P. Lüke, F. Perez Nava, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, “Near real-time estimation of super-resolved depth and all-in-focus images from a plenoptic camera using graphics processing units,” Int. J. Digit. Multimed. Broadcast. 2010, 942037 (2010).
[CrossRef]

Rosa, F.

J. P. Lüke, F. Perez Nava, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, “Near real-time estimation of super-resolved depth and all-in-focus images from a plenoptic camera using graphics processing units,” Int. J. Digit. Multimed. Broadcast. 2010, 942037 (2010).
[CrossRef]

Saavedra, G.

H. Navarro, R. Martínez-Cuenca, A. Molina, M. Martínez-Corral, G. Saavedra, and B. Javidi, “Method to remedy image degradations due to facet braiding in 3D InI monitors,” J. Display Technol. 6(10), 404–411 (2010).
[CrossRef]

R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, and B. Javidi, “Progress in 3-D multiperspective display by integral imaging,” Proc. IEEE 97(6), 1067–1077 (2009).
[CrossRef]

Smolic, A.

A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen, and C. Zhang, “Multiview imaging and 3DTV,” IEEE Signal Process. Mag. 24, 10–21 (2007).

Son, J. Y.

Tanimoto, M.

A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen, and C. Zhang, “Multiview imaging and 3DTV,” IEEE Signal Process. Mag. 24, 10–21 (2007).

Wang, J. Y. A.

E. H. Adelson and J. Y. A. Wang, “Single lens stereo with plenoptic camera,” IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 99–106 (1992).
[CrossRef]

Watson, E.

Yang, L.

Yano, S.

Yeom, S.

Yuyama, I.

F. Okano, J. Arai, H. Hoshino, and I. Yuyama, “Three-dimensional video system based on integral photography,” Opt. Eng. 38(6), 1072–1077 (1999).
[CrossRef]

Zhang, C.

A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen, and C. Zhang, “Multiview imaging and 3DTV,” IEEE Signal Process. Mag. 24, 10–21 (2007).

ACM Trans. Graph.

M. Levoy, R. Ng, A. Adams, M. Footer, and M. Horowitz, “Light field microscopy,” ACM Trans. Graph. 25(3), 924–934 (2006).
[CrossRef]

Appl. Opt.

IEEE Signal Process. Mag.

A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen, and C. Zhang, “Multiview imaging and 3DTV,” IEEE Signal Process. Mag. 24, 10–21 (2007).

IEEE Trans. Pattern Anal. Mach. Intell.

E. H. Adelson and J. Y. A. Wang, “Single lens stereo with plenoptic camera,” IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 99–106 (1992).
[CrossRef]

Int. J. Digit. Multimed. Broadcast.

J. P. Lüke, F. Perez Nava, J. G. Marichal-Hernandez, J. M. Rodriguez-Ramos, and F. Rosa, “Near real-time estimation of super-resolved depth and all-in-focus images from a plenoptic camera using graphics processing units,” Int. J. Digit. Multimed. Broadcast. 2010, 942037 (2010).
[CrossRef]

J. Display Technol.

J. Phys.

G. Lippmann, “Epreuves reversibles donnant la sensation du relief,” J. Phys. 7, 821–825 (1908).

Opt. Eng.

F. Okano, J. Arai, H. Hoshino, and I. Yuyama, “Three-dimensional video system based on integral photography,” Opt. Eng. 38(6), 1072–1077 (1999).
[CrossRef]

Opt. Express

Opt. Lett.

Proc. IEEE

R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, and B. Javidi, “Progress in 3-D multiperspective display by integral imaging,” Proc. IEEE 97(6), 1067–1077 (2009).
[CrossRef]

Other

B. Javidi and F. Okano, eds., Three-Dimensional Television, Video and Display Technologies (Springer-Verlag, 2002).

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (7)

Fig. 1
Fig. 1

Near-field integral imaging: (a) In the capture stage, the EIs of the 3D scene are recorded with large parallax; (b) In the reconstruction stage, the EIs are projected through the centers of the lenses. The resolution of reconstructed images is limited by the number of pixels/EI.

Fig. 2
Fig. 2

Capture setup of far-field integral imaging. The reference plane is the plane that is conjugated with the MLA.

Fig. 3
Fig. 3

(a) The sub-images are synthesized from the pixels placed at the same local positions in any elemental image; (b) The sub-images of the FInI cameras are equivalent to the elemental images that could be obtained by a NInI camera, but with the barriers arranged in conical form.

Fig. 4
Fig. 4

(a) Grid of the array of microlenses in the case of single snapshot FInI; (b) Grid of the synthetic array in the case of the double snapshot.

Fig. 5
Fig. 5

Experimental setup

Fig. 6
Fig. 6

Central subimage obtained (a) after single snapshot, (b) after double snapshot.

Fig. 7
Fig. 7

The left column shows the images reconstructed from the single-shot set of subimages. The right column shows the images obtained from our proposed double shot.

Metrics