Abstract

In this paper, we propose a simple correction method of distorted elemental images for computational integral imaging reconstruction (CIIR) method by using surface markers on lenslet array. The position information of surface markers is extracted from distorted elemental images with geometric misalignments such as skew, rotation and so on. Then the elemental images can be corrected simply when applying linear transformation calculated from the extracted positions. Therefore, the proposed method can simply correct geometric misalignments such as skew and rotation. The corrected elemental images can provide the precise reconstruction of 3D plane images in CIIR. To show the usefulness of the proposed method, the preliminary experiments are carried out and the experimental results are presented. To the best of our knowledge, this is the first report to deal with compensating for the distorted elemental images recorded by using computational integral imaging.

© 2009 OSA

Full Article  |  PDF Article

References

  • View by:
  • |
  • |
  • |

  1. S. A. Benton, ed., Selected Papers on Three-Dimensional Displays (SPIE Optical Engineering Press, Bellingham, WA, 2001).
  2. T. Okoshi, “Three-dimensional display,” Proc. IEEE 68(5), 548–564 (1980).
    [CrossRef]
  3. A. R. L. Travis, “The display of Three-dimensional video images,” Proc. IEEE 85(11), 1817–1832 (1997).
    [CrossRef]
  4. D. H. McMahon and H. J. Caulfield, “A technique for producing wide-angle holographic displays,” Appl. Opt. 9(1), 91–96 (1970).
    [CrossRef] [PubMed]
  5. G. Lippmann, “La photographie integrale,” Comptes-Rendus Academie des Sciences 146, 446–451 (1908).
  6. F. Okano, H. Hoshino, J. Arai, and I. Yuyama, “Real-time pickup method for a three-dimensional image based on integral photography,” Appl. Opt. 36(7), 1598–1603 (1997).
    [CrossRef] [PubMed]
  7. J.-S. Jang and B. Javidi, “Improved viewing resolution of three-dimensional integral imaging by use of nonstationary micro-optics,” Opt. Lett. 27(5), 324–326 (2002).
    [CrossRef]
  8. S.-W. Min, B. Javidi, and B. Lee, “Enhanced three-dimensional integral imaging system by use of double display devices,” Appl. Opt. 42(20), 4186–4195 (2003).
    [CrossRef] [PubMed]
  9. D.-H. Shin, S.-H. Lee, and E.-S. Kim, “Optical display of true 3D objects in depth-priority integral imaging using an active sensor,” Opt. Commun. 275(2), 330–334 (2007).
    [CrossRef]
  10. R. Martinez-Cuenca, A. Pons, G. Saavedra, M. Martinez-Corral, and B. Javidi, “Optically-corrected elemental images for undistorted Integral image display,” Opt. Express 14(21), 9657–9663 (2006).
    [CrossRef] [PubMed]
  11. S.-H. Hong, J.-S. Jang, and B. Javidi, “Three-dimensional volumetric object reconstruction using computational integral imaging,” Opt. Express 12(3), 483–491 (2004).
    [CrossRef] [PubMed]
  12. S.-H. Hong and B. Javidi, “Improved resolution 3D object reconstruction using computational integral imaging with time multiplexing,” Opt. Express 12(19), 4579–4588 (2004).
    [CrossRef] [PubMed]
  13. J.-S. Park, D.-C. Hwang, D.-H. Shin, and E.-S. Kim, “Resolution-enhanced three-dimensional image correlator using computationally reconstructed integral images,” Opt. Commun. 276, 72–79 (2007).
    [CrossRef]
  14. D.-H. Shin and H. Yoo, “Image quality enhancement in 3D computational integral imaging by use of interpolation methods,” Opt. Express 15(19), 12039–12049 (2007).
    [CrossRef] [PubMed]
  15. D.-H. Shin and E.-S. Kim, “Computational integral imaging reconstruction of 3D object using a depth conversion technique,” J. Opt. Soc. Korea 12(3), 131–135 (2008).
    [CrossRef]
  16. R. Martínez-Cuenca, H. Navarro, G. Saavedra, B. Javidi, and M. Martinez-Corral, “Enhanced viewing-angle integral imaging by multiple-axis telecentric relay system,” Opt. Express 15(24), 16255–16260 (2007).
    [CrossRef] [PubMed]
  17. J. Hahn, Y. Kim, E. H. Kim, and B. Lee, “Undistorted pickup method of both virtual and real objects for integral imaging,” Opt. Express 16(18), 13969–13978 (2008).
    [CrossRef] [PubMed]
  18. M. Kawakita, H. Sasaki, J. Arai, F. Okano, K. Suehiro, Y. Haino, M. Yoshimura, and M. Sato, “Geometric analysis of spatial distortion in projection-type integral imaging,” Opt. Lett. 33(7), 684–686 (2008).
    [CrossRef] [PubMed]
  19. D.-C. Hwang, J.-S. Park, S.-C. Kim, D.-H. Shin, and E.-S. Kim, “Magnification of 3D reconstructed images in integral imaging using an intermediate-view reconstruction technique,” Appl. Opt. 45(19), 4631–4637 (2006).
    [CrossRef] [PubMed]

2008

2007

R. Martínez-Cuenca, H. Navarro, G. Saavedra, B. Javidi, and M. Martinez-Corral, “Enhanced viewing-angle integral imaging by multiple-axis telecentric relay system,” Opt. Express 15(24), 16255–16260 (2007).
[CrossRef] [PubMed]

J.-S. Park, D.-C. Hwang, D.-H. Shin, and E.-S. Kim, “Resolution-enhanced three-dimensional image correlator using computationally reconstructed integral images,” Opt. Commun. 276, 72–79 (2007).
[CrossRef]

D.-H. Shin and H. Yoo, “Image quality enhancement in 3D computational integral imaging by use of interpolation methods,” Opt. Express 15(19), 12039–12049 (2007).
[CrossRef] [PubMed]

D.-H. Shin, S.-H. Lee, and E.-S. Kim, “Optical display of true 3D objects in depth-priority integral imaging using an active sensor,” Opt. Commun. 275(2), 330–334 (2007).
[CrossRef]

2006

2004

2003

2002

1997

1980

T. Okoshi, “Three-dimensional display,” Proc. IEEE 68(5), 548–564 (1980).
[CrossRef]

1970

1908

G. Lippmann, “La photographie integrale,” Comptes-Rendus Academie des Sciences 146, 446–451 (1908).

Arai, J.

Caulfield, H. J.

Hahn, J.

Haino, Y.

Hong, S.-H.

Hoshino, H.

Hwang, D.-C.

J.-S. Park, D.-C. Hwang, D.-H. Shin, and E.-S. Kim, “Resolution-enhanced three-dimensional image correlator using computationally reconstructed integral images,” Opt. Commun. 276, 72–79 (2007).
[CrossRef]

D.-C. Hwang, J.-S. Park, S.-C. Kim, D.-H. Shin, and E.-S. Kim, “Magnification of 3D reconstructed images in integral imaging using an intermediate-view reconstruction technique,” Appl. Opt. 45(19), 4631–4637 (2006).
[CrossRef] [PubMed]

Jang, J.-S.

Javidi, B.

Kawakita, M.

Kim, E. H.

Kim, E.-S.

D.-H. Shin and E.-S. Kim, “Computational integral imaging reconstruction of 3D object using a depth conversion technique,” J. Opt. Soc. Korea 12(3), 131–135 (2008).
[CrossRef]

J.-S. Park, D.-C. Hwang, D.-H. Shin, and E.-S. Kim, “Resolution-enhanced three-dimensional image correlator using computationally reconstructed integral images,” Opt. Commun. 276, 72–79 (2007).
[CrossRef]

D.-H. Shin, S.-H. Lee, and E.-S. Kim, “Optical display of true 3D objects in depth-priority integral imaging using an active sensor,” Opt. Commun. 275(2), 330–334 (2007).
[CrossRef]

D.-C. Hwang, J.-S. Park, S.-C. Kim, D.-H. Shin, and E.-S. Kim, “Magnification of 3D reconstructed images in integral imaging using an intermediate-view reconstruction technique,” Appl. Opt. 45(19), 4631–4637 (2006).
[CrossRef] [PubMed]

Kim, S.-C.

Kim, Y.

Lee, B.

Lee, S.-H.

D.-H. Shin, S.-H. Lee, and E.-S. Kim, “Optical display of true 3D objects in depth-priority integral imaging using an active sensor,” Opt. Commun. 275(2), 330–334 (2007).
[CrossRef]

Lippmann, G.

G. Lippmann, “La photographie integrale,” Comptes-Rendus Academie des Sciences 146, 446–451 (1908).

Martinez-Corral, M.

Martinez-Cuenca, R.

Martínez-Cuenca, R.

McMahon, D. H.

Min, S.-W.

Navarro, H.

Okano, F.

Okoshi, T.

T. Okoshi, “Three-dimensional display,” Proc. IEEE 68(5), 548–564 (1980).
[CrossRef]

Park, J.-S.

J.-S. Park, D.-C. Hwang, D.-H. Shin, and E.-S. Kim, “Resolution-enhanced three-dimensional image correlator using computationally reconstructed integral images,” Opt. Commun. 276, 72–79 (2007).
[CrossRef]

D.-C. Hwang, J.-S. Park, S.-C. Kim, D.-H. Shin, and E.-S. Kim, “Magnification of 3D reconstructed images in integral imaging using an intermediate-view reconstruction technique,” Appl. Opt. 45(19), 4631–4637 (2006).
[CrossRef] [PubMed]

Pons, A.

Saavedra, G.

Sasaki, H.

Sato, M.

Shin, D.-H.

Suehiro, K.

Travis, A. R. L.

A. R. L. Travis, “The display of Three-dimensional video images,” Proc. IEEE 85(11), 1817–1832 (1997).
[CrossRef]

Yoo, H.

Yoshimura, M.

Yuyama, I.

Appl. Opt.

Comptes-Rendus Academie des Sciences

G. Lippmann, “La photographie integrale,” Comptes-Rendus Academie des Sciences 146, 446–451 (1908).

J. Opt. Soc. Korea

Opt. Commun.

J.-S. Park, D.-C. Hwang, D.-H. Shin, and E.-S. Kim, “Resolution-enhanced three-dimensional image correlator using computationally reconstructed integral images,” Opt. Commun. 276, 72–79 (2007).
[CrossRef]

D.-H. Shin, S.-H. Lee, and E.-S. Kim, “Optical display of true 3D objects in depth-priority integral imaging using an active sensor,” Opt. Commun. 275(2), 330–334 (2007).
[CrossRef]

Opt. Express

Opt. Lett.

Proc. IEEE

T. Okoshi, “Three-dimensional display,” Proc. IEEE 68(5), 548–564 (1980).
[CrossRef]

A. R. L. Travis, “The display of Three-dimensional video images,” Proc. IEEE 85(11), 1817–1832 (1997).
[CrossRef]

Other

S. A. Benton, ed., Selected Papers on Three-Dimensional Displays (SPIE Optical Engineering Press, Bellingham, WA, 2001).

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (14)

Fig. 1
Fig. 1

Concept of computational integral imaging (a) Optical pickup (b) CIIR.

Fig. 3
Fig. 3

(a) Proposed pickup system using surface markers on lenslet array (b) Example of distorted elemental images (c) Example of corrected elemental images

Fig. 2
Fig. 2

Pickup stage using the relay optic system.

Fig. 4
Fig. 4

Conceptual diagram for computational test (a) Pickup and distortion process (b) Correction and CIIR process.

Fig. 5
Fig. 5

(a) Three test images for computational experiments. (b) Their elemental images with markers.

Fig. 6
Fig. 6

Diagram of our correction process.

Fig. 7
Fig. 7

Examples of reconstructed plane images according to the rotation angle.

Fig. 8
Fig. 8

PSNR results for rotation distortion in CIIR

Fig. 9
Fig. 9

Skew-distorted elemental images (a) Lena (b) Cow (c) Caw

Fig. 10
Fig. 10

(a) Original elemental images and its CIIR image (b) Skew-distorted elemental images and its CIIR image (c) Corrected elemental images and its CIIR image.

Fig. 11
Fig. 11

Experimental structure for pickup of real 3D object.

Fig. 12
Fig. 12

(a) Original elemental images without distortion (b) CIIR image.

Fig. 13
Fig. 13

(a) Rotational-distorted elemental images and its CIIR image (b) Rotation-corrected elemental images and its CIIR image.

Fig. 14
Fig. 14

(a) Skew-distorted elemental images and its CIIR image (b) Skew-corrected elemental images and its CIIR image.

Equations (4)

Equations on this page are rendered with MathJax. Learn more.

u=p1x+p2y+p3p7x+p8y+p9
v=p4x+p5y+p6p7x+p8y+p9
(uwvww)=(p1p2p3p4p5p6p7p8p9)(xy1).
AP=[x1y11000u1x1u1y1u1000x1y11v1x1v1y1v1xnxn1000unxnunynun000xnxn1vnxnvnxnvn][p1p2p3p4p5p6p7p8p9]=0.

Metrics