Abstract

This paper proposes a high resolution integral imaging system using a lens array composed of non-uniform decentered elemental lenses. One of the problems of integral imaging is the trade-off relationship between the resolution and the number of views. When the number of views is small, motion parallax becomes strongly discrete to maintain the viewing angle. In order to overcome this trade-off, the proposed method uses the elemental lenses whose size is smaller than that of the elemental images. To keep the images generated by the elemental lenses at constant depth, the lens array is designed so that the optical centers of elemental lenses may be located in the centers of elemental images, not in the centers of elemental lenses. To compensate optical distortion, new image rendering algorithm is developed so that undistorted 3D image may be presented with a non-uniform lens array. The proposed design of lens array can be applied to integral volumetric imaging, where display panels are layered to show volumetric images in the scheme of integral imaging.

© 2012 OSA

Full Article  |  PDF Article

References

  • View by:
  • |
  • |
  • |

  1. A. C. Traub, “Stereoscopic display using rapid varifocal mirror oscillations,” Appl. Opt. 6(6), 1085–1087 (1967).
    [Crossref] [PubMed]
  2. S. Suyama, M. Date, and H. Takada, “Three-dimensional display system with dual-frequency liquid-crystal varifocal lens,” Jpn. J. Appl. Phys. 1(2), 480–484 (2000).
    [Crossref]
  3. A. Sullivan, “DepthCube solid state 3D volumetric display,” Proc. SPIE 5291, 279–284 (2004).
    [Crossref]
  4. H. Kakeya, “Coarse integral imaging and its applications,” Proc. SPIE 6803, 680317, 680317-10 (2008).
    [Crossref]
  5. H. Kakeya, “Improving image quality of coarse integral volumetric display,” Proc. SPIE 7237, 723726, 723726-9 (2009).
    [Crossref]
  6. H. Kakeya, T. Kurokawa, and Y. Mano, “Electronic realization of coarse integral volumetric imaging with wide viewing angle,” Proc. SPIE 7524, 752411, 752411-10 (2010).
    [Crossref]
  7. H. Kakeya, “Realization of undistorted volumetric multiview image with multilayered integral imaging,” Opt. Express 19(21), 20395–20404 (2011).
    [Crossref] [PubMed]
  8. G. Lippmann, “La photograhie integrale,” Comptes Rendus Acad. Sci. 146, 446–451 (1908).
  9. B. Lee, S. Jung, S. W. Min, and J. H. Park, “Three-dimensional display by use of integral photography with dynamically variable image planes,” Opt. Lett. 26(19), 1481–1482 (2001).
    [Crossref] [PubMed]
  10. H. Kakeya, “MOEVision: simple multiview display with clear floating image,” Proc. SPIE 6490, 64900J, 64900J-8 (2007).
    [Crossref]
  11. J.-H. Park, S. Jung, H. Choi, and B. Lee, “Integral imaging with multiple image planes using a uniaxial crystal plate,” Opt. Express 11(16), 1862–1875 (2003).
    [Crossref] [PubMed]
  12. S.-W. Min, B. Javidi, and B. Lee, “Enhanced three-dimensional integral imaging system by use of double display devices,” Appl. Opt. 42(20), 4186–4195 (2003).
    [Crossref] [PubMed]
  13. R. Yasui, I. Matsuda, and H. Kakeya, “Combining volumetric edge display and multiview display for expression of natural 3D images,” Proc. SPIE 6055, 60550Y, 60550Y-9 (2006).
    [Crossref]
  14. H. Ebisu, T. Kimura, and H. Kakeya, “Realization of electronic 3D display combining multiview and volumetric solutions,” Proc. SPIE 6490, 64900Y, 64900Y-10 (2007).
    [Crossref]
  15. Y. Kim, J. H. Park, H. Choi, J. Kim, S. W. Cho, and B. Lee, “Depth-enhanced three-dimensional integral imaging by use of multilayered display devices,” Appl. Opt. 45(18), 4334–4343 (2006).
    [Crossref] [PubMed]
  16. Y. Kim, H. Choi, J. Kim, S. W. Cho, Y. Kim, G. Park, and B. Lee, “Depth-enhanced integral imaging display system with electrically variable image planes using polymer-dispersed liquid-crystal layers,” Appl. Opt. 46(18), 3766–3773 (2007).
    [Crossref] [PubMed]
  17. S. Suyama, H. Takada, K. Uehira, S. Sakai, and S. Ohtsuka, “A novel direct-vision 3-D display using luminance-modulated two 2-D images displayed at different depths,” SID’00 Dig. Tech. Pap. 31(1), 1208–1211 (2000).
    [Crossref]
  18. S. Suyama, H. Takada, and S. Ohtsuka, “A direct-vision 3-D display using a new depth-fusing perceptual phenomenon in 2-D displays with different depths,” IEICE Trans. on Electron., E85-C, 1911–1915 (2002).
  19. S. Suyama, S. Ohtsuka, H. Takada, K. Uehira, and S. Sakai, “Apparent 3-D image perceived from luminance-modulated two 2-D images displayed at different depths,” Vision Res. 44(8), 785–793 (2004).
    [Crossref] [PubMed]
  20. S. Sawada and H. Kakeya, “Coarse Integral Volumetric Imaging with Flat Screen and Wide Viewing Angle,” J. Electron. Imaging 21(1), 011004 (2012).
    [Crossref]
  21. H. Deng, Q. Wang, D. Li, and F. Wang, “An integral imaging display with wide viewing angle,” SID’11 Dig. Tech. Pap. 42(1), 1095–1097 (2011).
    [Crossref]
  22. J. S. Jang and B. Javidi, “Large depth-of-focus time-multiplexed three-dimensional integral imaging by use of lenslets with nonuniform focal lengths and aperture sizes,” Opt. Lett. 28(20), 1924–1926 (2003).
    [Crossref] [PubMed]
  23. L. Bogaert, Y. Meuret, S. Roelandt, A. Avci, H. De Smet, and H. Thienpont, “Demonstration of a multiview projection display using decentered microlens arrays,” Opt. Express 18(25), 26092–26106 (2010).
    [Crossref] [PubMed]

2012 (1)

S. Sawada and H. Kakeya, “Coarse Integral Volumetric Imaging with Flat Screen and Wide Viewing Angle,” J. Electron. Imaging 21(1), 011004 (2012).
[Crossref]

2011 (2)

H. Deng, Q. Wang, D. Li, and F. Wang, “An integral imaging display with wide viewing angle,” SID’11 Dig. Tech. Pap. 42(1), 1095–1097 (2011).
[Crossref]

H. Kakeya, “Realization of undistorted volumetric multiview image with multilayered integral imaging,” Opt. Express 19(21), 20395–20404 (2011).
[Crossref] [PubMed]

2010 (2)

L. Bogaert, Y. Meuret, S. Roelandt, A. Avci, H. De Smet, and H. Thienpont, “Demonstration of a multiview projection display using decentered microlens arrays,” Opt. Express 18(25), 26092–26106 (2010).
[Crossref] [PubMed]

H. Kakeya, T. Kurokawa, and Y. Mano, “Electronic realization of coarse integral volumetric imaging with wide viewing angle,” Proc. SPIE 7524, 752411, 752411-10 (2010).
[Crossref]

2009 (1)

H. Kakeya, “Improving image quality of coarse integral volumetric display,” Proc. SPIE 7237, 723726, 723726-9 (2009).
[Crossref]

2008 (1)

H. Kakeya, “Coarse integral imaging and its applications,” Proc. SPIE 6803, 680317, 680317-10 (2008).
[Crossref]

2007 (3)

H. Kakeya, “MOEVision: simple multiview display with clear floating image,” Proc. SPIE 6490, 64900J, 64900J-8 (2007).
[Crossref]

H. Ebisu, T. Kimura, and H. Kakeya, “Realization of electronic 3D display combining multiview and volumetric solutions,” Proc. SPIE 6490, 64900Y, 64900Y-10 (2007).
[Crossref]

Y. Kim, H. Choi, J. Kim, S. W. Cho, Y. Kim, G. Park, and B. Lee, “Depth-enhanced integral imaging display system with electrically variable image planes using polymer-dispersed liquid-crystal layers,” Appl. Opt. 46(18), 3766–3773 (2007).
[Crossref] [PubMed]

2006 (2)

Y. Kim, J. H. Park, H. Choi, J. Kim, S. W. Cho, and B. Lee, “Depth-enhanced three-dimensional integral imaging by use of multilayered display devices,” Appl. Opt. 45(18), 4334–4343 (2006).
[Crossref] [PubMed]

R. Yasui, I. Matsuda, and H. Kakeya, “Combining volumetric edge display and multiview display for expression of natural 3D images,” Proc. SPIE 6055, 60550Y, 60550Y-9 (2006).
[Crossref]

2004 (2)

A. Sullivan, “DepthCube solid state 3D volumetric display,” Proc. SPIE 5291, 279–284 (2004).
[Crossref]

S. Suyama, S. Ohtsuka, H. Takada, K. Uehira, and S. Sakai, “Apparent 3-D image perceived from luminance-modulated two 2-D images displayed at different depths,” Vision Res. 44(8), 785–793 (2004).
[Crossref] [PubMed]

2003 (3)

2002 (1)

S. Suyama, H. Takada, and S. Ohtsuka, “A direct-vision 3-D display using a new depth-fusing perceptual phenomenon in 2-D displays with different depths,” IEICE Trans. on Electron., E85-C, 1911–1915 (2002).

2001 (1)

2000 (2)

S. Suyama, H. Takada, K. Uehira, S. Sakai, and S. Ohtsuka, “A novel direct-vision 3-D display using luminance-modulated two 2-D images displayed at different depths,” SID’00 Dig. Tech. Pap. 31(1), 1208–1211 (2000).
[Crossref]

S. Suyama, M. Date, and H. Takada, “Three-dimensional display system with dual-frequency liquid-crystal varifocal lens,” Jpn. J. Appl. Phys. 1(2), 480–484 (2000).
[Crossref]

1967 (1)

1908 (1)

G. Lippmann, “La photograhie integrale,” Comptes Rendus Acad. Sci. 146, 446–451 (1908).

Avci, A.

Bogaert, L.

Cho, S. W.

Choi, H.

Date, M.

S. Suyama, M. Date, and H. Takada, “Three-dimensional display system with dual-frequency liquid-crystal varifocal lens,” Jpn. J. Appl. Phys. 1(2), 480–484 (2000).
[Crossref]

De Smet, H.

Deng, H.

H. Deng, Q. Wang, D. Li, and F. Wang, “An integral imaging display with wide viewing angle,” SID’11 Dig. Tech. Pap. 42(1), 1095–1097 (2011).
[Crossref]

Ebisu, H.

H. Ebisu, T. Kimura, and H. Kakeya, “Realization of electronic 3D display combining multiview and volumetric solutions,” Proc. SPIE 6490, 64900Y, 64900Y-10 (2007).
[Crossref]

Jang, J. S.

Javidi, B.

Jung, S.

Kakeya, H.

S. Sawada and H. Kakeya, “Coarse Integral Volumetric Imaging with Flat Screen and Wide Viewing Angle,” J. Electron. Imaging 21(1), 011004 (2012).
[Crossref]

H. Kakeya, “Realization of undistorted volumetric multiview image with multilayered integral imaging,” Opt. Express 19(21), 20395–20404 (2011).
[Crossref] [PubMed]

H. Kakeya, T. Kurokawa, and Y. Mano, “Electronic realization of coarse integral volumetric imaging with wide viewing angle,” Proc. SPIE 7524, 752411, 752411-10 (2010).
[Crossref]

H. Kakeya, “Improving image quality of coarse integral volumetric display,” Proc. SPIE 7237, 723726, 723726-9 (2009).
[Crossref]

H. Kakeya, “Coarse integral imaging and its applications,” Proc. SPIE 6803, 680317, 680317-10 (2008).
[Crossref]

H. Kakeya, “MOEVision: simple multiview display with clear floating image,” Proc. SPIE 6490, 64900J, 64900J-8 (2007).
[Crossref]

H. Ebisu, T. Kimura, and H. Kakeya, “Realization of electronic 3D display combining multiview and volumetric solutions,” Proc. SPIE 6490, 64900Y, 64900Y-10 (2007).
[Crossref]

R. Yasui, I. Matsuda, and H. Kakeya, “Combining volumetric edge display and multiview display for expression of natural 3D images,” Proc. SPIE 6055, 60550Y, 60550Y-9 (2006).
[Crossref]

Kim, J.

Kim, Y.

Kimura, T.

H. Ebisu, T. Kimura, and H. Kakeya, “Realization of electronic 3D display combining multiview and volumetric solutions,” Proc. SPIE 6490, 64900Y, 64900Y-10 (2007).
[Crossref]

Kurokawa, T.

H. Kakeya, T. Kurokawa, and Y. Mano, “Electronic realization of coarse integral volumetric imaging with wide viewing angle,” Proc. SPIE 7524, 752411, 752411-10 (2010).
[Crossref]

Lee, B.

Li, D.

H. Deng, Q. Wang, D. Li, and F. Wang, “An integral imaging display with wide viewing angle,” SID’11 Dig. Tech. Pap. 42(1), 1095–1097 (2011).
[Crossref]

Lippmann, G.

G. Lippmann, “La photograhie integrale,” Comptes Rendus Acad. Sci. 146, 446–451 (1908).

Mano, Y.

H. Kakeya, T. Kurokawa, and Y. Mano, “Electronic realization of coarse integral volumetric imaging with wide viewing angle,” Proc. SPIE 7524, 752411, 752411-10 (2010).
[Crossref]

Matsuda, I.

R. Yasui, I. Matsuda, and H. Kakeya, “Combining volumetric edge display and multiview display for expression of natural 3D images,” Proc. SPIE 6055, 60550Y, 60550Y-9 (2006).
[Crossref]

Meuret, Y.

Min, S. W.

Min, S.-W.

Ohtsuka, S.

S. Suyama, S. Ohtsuka, H. Takada, K. Uehira, and S. Sakai, “Apparent 3-D image perceived from luminance-modulated two 2-D images displayed at different depths,” Vision Res. 44(8), 785–793 (2004).
[Crossref] [PubMed]

S. Suyama, H. Takada, and S. Ohtsuka, “A direct-vision 3-D display using a new depth-fusing perceptual phenomenon in 2-D displays with different depths,” IEICE Trans. on Electron., E85-C, 1911–1915 (2002).

S. Suyama, H. Takada, K. Uehira, S. Sakai, and S. Ohtsuka, “A novel direct-vision 3-D display using luminance-modulated two 2-D images displayed at different depths,” SID’00 Dig. Tech. Pap. 31(1), 1208–1211 (2000).
[Crossref]

Park, G.

Park, J. H.

Park, J.-H.

Roelandt, S.

Sakai, S.

S. Suyama, S. Ohtsuka, H. Takada, K. Uehira, and S. Sakai, “Apparent 3-D image perceived from luminance-modulated two 2-D images displayed at different depths,” Vision Res. 44(8), 785–793 (2004).
[Crossref] [PubMed]

S. Suyama, H. Takada, K. Uehira, S. Sakai, and S. Ohtsuka, “A novel direct-vision 3-D display using luminance-modulated two 2-D images displayed at different depths,” SID’00 Dig. Tech. Pap. 31(1), 1208–1211 (2000).
[Crossref]

Sawada, S.

S. Sawada and H. Kakeya, “Coarse Integral Volumetric Imaging with Flat Screen and Wide Viewing Angle,” J. Electron. Imaging 21(1), 011004 (2012).
[Crossref]

Sullivan, A.

A. Sullivan, “DepthCube solid state 3D volumetric display,” Proc. SPIE 5291, 279–284 (2004).
[Crossref]

Suyama, S.

S. Suyama, S. Ohtsuka, H. Takada, K. Uehira, and S. Sakai, “Apparent 3-D image perceived from luminance-modulated two 2-D images displayed at different depths,” Vision Res. 44(8), 785–793 (2004).
[Crossref] [PubMed]

S. Suyama, H. Takada, and S. Ohtsuka, “A direct-vision 3-D display using a new depth-fusing perceptual phenomenon in 2-D displays with different depths,” IEICE Trans. on Electron., E85-C, 1911–1915 (2002).

S. Suyama, H. Takada, K. Uehira, S. Sakai, and S. Ohtsuka, “A novel direct-vision 3-D display using luminance-modulated two 2-D images displayed at different depths,” SID’00 Dig. Tech. Pap. 31(1), 1208–1211 (2000).
[Crossref]

S. Suyama, M. Date, and H. Takada, “Three-dimensional display system with dual-frequency liquid-crystal varifocal lens,” Jpn. J. Appl. Phys. 1(2), 480–484 (2000).
[Crossref]

Takada, H.

S. Suyama, S. Ohtsuka, H. Takada, K. Uehira, and S. Sakai, “Apparent 3-D image perceived from luminance-modulated two 2-D images displayed at different depths,” Vision Res. 44(8), 785–793 (2004).
[Crossref] [PubMed]

S. Suyama, H. Takada, and S. Ohtsuka, “A direct-vision 3-D display using a new depth-fusing perceptual phenomenon in 2-D displays with different depths,” IEICE Trans. on Electron., E85-C, 1911–1915 (2002).

S. Suyama, H. Takada, K. Uehira, S. Sakai, and S. Ohtsuka, “A novel direct-vision 3-D display using luminance-modulated two 2-D images displayed at different depths,” SID’00 Dig. Tech. Pap. 31(1), 1208–1211 (2000).
[Crossref]

S. Suyama, M. Date, and H. Takada, “Three-dimensional display system with dual-frequency liquid-crystal varifocal lens,” Jpn. J. Appl. Phys. 1(2), 480–484 (2000).
[Crossref]

Thienpont, H.

Traub, A. C.

Uehira, K.

S. Suyama, S. Ohtsuka, H. Takada, K. Uehira, and S. Sakai, “Apparent 3-D image perceived from luminance-modulated two 2-D images displayed at different depths,” Vision Res. 44(8), 785–793 (2004).
[Crossref] [PubMed]

S. Suyama, H. Takada, K. Uehira, S. Sakai, and S. Ohtsuka, “A novel direct-vision 3-D display using luminance-modulated two 2-D images displayed at different depths,” SID’00 Dig. Tech. Pap. 31(1), 1208–1211 (2000).
[Crossref]

Wang, F.

H. Deng, Q. Wang, D. Li, and F. Wang, “An integral imaging display with wide viewing angle,” SID’11 Dig. Tech. Pap. 42(1), 1095–1097 (2011).
[Crossref]

Wang, Q.

H. Deng, Q. Wang, D. Li, and F. Wang, “An integral imaging display with wide viewing angle,” SID’11 Dig. Tech. Pap. 42(1), 1095–1097 (2011).
[Crossref]

Yasui, R.

R. Yasui, I. Matsuda, and H. Kakeya, “Combining volumetric edge display and multiview display for expression of natural 3D images,” Proc. SPIE 6055, 60550Y, 60550Y-9 (2006).
[Crossref]

Appl. Opt. (4)

Comptes Rendus Acad. Sci. (1)

G. Lippmann, “La photograhie integrale,” Comptes Rendus Acad. Sci. 146, 446–451 (1908).

Dig. Tech. Pap. (2)

H. Deng, Q. Wang, D. Li, and F. Wang, “An integral imaging display with wide viewing angle,” SID’11 Dig. Tech. Pap. 42(1), 1095–1097 (2011).
[Crossref]

S. Suyama, H. Takada, K. Uehira, S. Sakai, and S. Ohtsuka, “A novel direct-vision 3-D display using luminance-modulated two 2-D images displayed at different depths,” SID’00 Dig. Tech. Pap. 31(1), 1208–1211 (2000).
[Crossref]

IEICE Trans. on Electron., (1)

S. Suyama, H. Takada, and S. Ohtsuka, “A direct-vision 3-D display using a new depth-fusing perceptual phenomenon in 2-D displays with different depths,” IEICE Trans. on Electron., E85-C, 1911–1915 (2002).

J. Electron. Imaging (1)

S. Sawada and H. Kakeya, “Coarse Integral Volumetric Imaging with Flat Screen and Wide Viewing Angle,” J. Electron. Imaging 21(1), 011004 (2012).
[Crossref]

Jpn. J. Appl. Phys. (1)

S. Suyama, M. Date, and H. Takada, “Three-dimensional display system with dual-frequency liquid-crystal varifocal lens,” Jpn. J. Appl. Phys. 1(2), 480–484 (2000).
[Crossref]

Opt. Express (3)

Opt. Lett. (2)

Proc. SPIE (7)

R. Yasui, I. Matsuda, and H. Kakeya, “Combining volumetric edge display and multiview display for expression of natural 3D images,” Proc. SPIE 6055, 60550Y, 60550Y-9 (2006).
[Crossref]

H. Ebisu, T. Kimura, and H. Kakeya, “Realization of electronic 3D display combining multiview and volumetric solutions,” Proc. SPIE 6490, 64900Y, 64900Y-10 (2007).
[Crossref]

H. Kakeya, “MOEVision: simple multiview display with clear floating image,” Proc. SPIE 6490, 64900J, 64900J-8 (2007).
[Crossref]

A. Sullivan, “DepthCube solid state 3D volumetric display,” Proc. SPIE 5291, 279–284 (2004).
[Crossref]

H. Kakeya, “Coarse integral imaging and its applications,” Proc. SPIE 6803, 680317, 680317-10 (2008).
[Crossref]

H. Kakeya, “Improving image quality of coarse integral volumetric display,” Proc. SPIE 7237, 723726, 723726-9 (2009).
[Crossref]

H. Kakeya, T. Kurokawa, and Y. Mano, “Electronic realization of coarse integral volumetric imaging with wide viewing angle,” Proc. SPIE 7524, 752411, 752411-10 (2010).
[Crossref]

Vision Res. (1)

S. Suyama, S. Ohtsuka, H. Takada, K. Uehira, and S. Sakai, “Apparent 3-D image perceived from luminance-modulated two 2-D images displayed at different depths,” Vision Res. 44(8), 785–793 (2004).
[Crossref] [PubMed]

Supplementary Material (3)

» Media 1: MPG (2202 KB)     
» Media 2: MPG (690 KB)     
» Media 3: MPG (400 KB)     

Cited By

OSA participates in Crossref's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (15)

Fig. 1
Fig. 1

Principle of coarse integral volumetric imaging.

Fig. 2
Fig. 2

Principle of DFD for distorted image planes.

Fig. 3
Fig. 3

Integral imaging with wider viewing angle.

Fig. 4
Fig. 4

Shapes of real images generated by conventional elemental lenses.

Fig. 5
Fig. 5

Integral imaging composed of decentered elemental lenses.

Fig. 6
Fig. 6

Conventional elemental lens and decentered elemental lens

Fig. 7
Fig. 7

Shapes of real images generated by decentered elemental lenses.

Fig. 8
Fig. 8

Viewpoint of projection transformation located on the opposite side of observer.

Fig. 9
Fig. 9

Projection transformation from the opposite side of the observer.

Fig. 10
Fig. 10

Distortion correction procedure.

Fig. 11
Fig. 11

Distortion correction in the depth direction.

Fig. 12
Fig. 12

Elemental image of CIVI with decentered elemental lenses.

Fig. 13
Fig. 13

CIVI prototype system with decentered elemental lenses.

Fig. 14
Fig. 14

Observed images with CIVI composed of decentered lenses (Media 1, Media 2).

Fig. 15
Fig. 15

Observed images with CIVI composed of conventional elemental lenses and elemental images larger than elemental lenses (Media 3).

Metrics