Abstract

A novel method of using stereoscopic video images to synthesize the computer-generated hologram (CGH) patterns of a real 3D object is proposed. Stereoscopic video images of a real 3D object are captured by a 3D camera system. Disparity maps between the captured stereo image pairs are estimated and from these estimated maps the depth data for each pixel of the object can be extracted on a frame basis. By using these depth data and original color images, hologram patterns of a real object can be computationally generated. In experiments, stereoscopic video images of a real 3D object, a wooden rhinoceros doll, are captured by using the Wasol 3D adapter system and its depth data are extracted from them. Then, CGH patterns of 1280 pixels × 1024 pixels are generated with these depth-annotated images of the wooden rhinoceros doll, and the CGH patterns are experimentally displayed via a holographic display system.

© 2006 Optical Society of America

Full Article  |  PDF Article

References

  • View by:
  • |
  • |
  • |

  1. T. Kawai, "3D displays and applications," Displays 23, 49-56 (2002).
    [CrossRef]
  2. C. J. Kuo and M. H. Tsai, Three-Dimensional Holographic Imaging (Wiley, 2002).
  3. A. W. Lohmann and D. P. Paris, "Binary Fraunhofer holograms generated by computer," Appl. Opt. 6, 1739-1748 (1967).
    [CrossRef] [PubMed]
  4. Y. Li, D. Abookasis, and J. Rosen, "Computer-generated holograms of three-dimensional realistic objects recorded without wave interference," Appl. Opt. 40, 2864-2870 (2001).
    [CrossRef]
  5. R. Piestun and J. Shamir, "On-axis computer-generated holograms for three-dimensional display," Opt. Lett. 22, 922-924 (1997).
    [CrossRef] [PubMed]
  6. G. J. Iddan and G. Yahav, "Three-dimensional imaging in the studio and elsewhere," in Three-Dimensional Image Capture and Applications IV, B. D. Corner, J. H. Nurre, and R. P. Pargas, eds., Proc. SPIE 4298, 48-55 (2000).
    [CrossRef]
  7. M. Kawakita, K. Iizuka, T. Aida, H. Kikuchi, H. Fujikake, J. Yonai, and K. Takizawa, "Axi-Vision Camera (real-time distance-mapping camera)," Appl. Opt. 39, 3931-3939 (2000).
    [CrossRef]
  8. Y. H. Lee, "Adapter for three-dimensional moving image photographing device," Patent No. PCT/KR03/01064 (2003).
  9. D. H. Kim, S. C. Kim, K. H. Bae, and E. S. Kim, "Performance analysis of a compact electro-optical 3D adapter with a wide capturing angle," in Novel Optical Systems Design and Optimization VIII, J. M. Sasian, R. J. Koshel, and R. C. Juergens, eds., Proc. SPIE 5875, 177-188 (2005).
  10. http://www.crlopto.com.
  11. T. Shibata, T. Kawai, T. Inoue, Y. Sakaguchi, K. Okabe, and Y. Kuno, "Development of an electro-optical 3D adapter for stereoscopic video recording," in Stereoscopic Displays and Virtual Reality Systems IX, A. J. Woods, J. O. Merritt, S. A. Benton, and M. T. Bolas, eds., Proc. SPIE 4660, 325-330 (2002).
    [CrossRef]
  12. http://www.sony.co.kr.
  13. http://www.wasol.co.kr.
  14. http://www.ptgrey.com.
  15. U. R. Dhond and J. K. Aggarwal, "Structure from stereo-A review," IEEE Trans. Syst. Man Cybern. 19, 1489-1510 (1989).
    [CrossRef]
  16. C. J. Tsai and A. K. Katsaggelos, "Dense disparity estimation with a divide-and-conquer disparity space image technique," IEEE Trans. Multimedia 1, 18-29 (1999).
    [CrossRef]
  17. W. E. L. Grimson, "Computational experiments with a feature based stereo algorithm," IEEE Trans. Pattern Anal. Mach. Intell. PAMI- 7, 17-34 (1985).
    [CrossRef]
  18. W. Ho and N. Ahuja, "Surfaces from stereo: integrating feature matching, disparity estimation, and contour detection," IEEE Trans. Pattern Anal. Mach. Intell. 11, 121-136 (1989).
    [CrossRef]
  19. K. H. Bae and E. S. Kim, "A new disparity estimation scheme based-on adaptive matching window for intermediate view reconstruction," Opt. Eng. 42, 1778-1786 (2003).
    [CrossRef]
  20. M. S. Moellenhoff and M. W. Maier, "Transform coding of stereo image residuals," IEEE Trans. Image Process. 7, 804-812 (1998).
    [CrossRef]
  21. V. Grinberg, "Geometry of binocular imaging," in Stereoscopic Displays and Virtual Reality Systems, S. S. Fisher, J. O. Merritt, and M. T. Bolas, eds., Proc. SPIE 2177, 56-65 (1994).
    [CrossRef]
  22. H. Yoshikawa, S. Iwase, and T. Oneda, "Fast computation of Fresnel holograms employing difference," in Practical Holography XIV and Holographic Materials VI, S.A.Benton, S.H.Stevenson, and T.J.Trout, eds., Proc. SPIE 3956, 48-55 (2000).
  23. K. Takano and K. Sato, "Color electro-holographic display using a single white light source and a focal adjustment method," Opt. Eng. 41, 2427-2433 (2002).
    [CrossRef]

2005 (1)

D. H. Kim, S. C. Kim, K. H. Bae, and E. S. Kim, "Performance analysis of a compact electro-optical 3D adapter with a wide capturing angle," in Novel Optical Systems Design and Optimization VIII, J. M. Sasian, R. J. Koshel, and R. C. Juergens, eds., Proc. SPIE 5875, 177-188 (2005).

2003 (1)

K. H. Bae and E. S. Kim, "A new disparity estimation scheme based-on adaptive matching window for intermediate view reconstruction," Opt. Eng. 42, 1778-1786 (2003).
[CrossRef]

2002 (4)

K. Takano and K. Sato, "Color electro-holographic display using a single white light source and a focal adjustment method," Opt. Eng. 41, 2427-2433 (2002).
[CrossRef]

T. Shibata, T. Kawai, T. Inoue, Y. Sakaguchi, K. Okabe, and Y. Kuno, "Development of an electro-optical 3D adapter for stereoscopic video recording," in Stereoscopic Displays and Virtual Reality Systems IX, A. J. Woods, J. O. Merritt, S. A. Benton, and M. T. Bolas, eds., Proc. SPIE 4660, 325-330 (2002).
[CrossRef]

T. Kawai, "3D displays and applications," Displays 23, 49-56 (2002).
[CrossRef]

C. J. Kuo and M. H. Tsai, Three-Dimensional Holographic Imaging (Wiley, 2002).

2001 (1)

2000 (2)

G. J. Iddan and G. Yahav, "Three-dimensional imaging in the studio and elsewhere," in Three-Dimensional Image Capture and Applications IV, B. D. Corner, J. H. Nurre, and R. P. Pargas, eds., Proc. SPIE 4298, 48-55 (2000).
[CrossRef]

M. Kawakita, K. Iizuka, T. Aida, H. Kikuchi, H. Fujikake, J. Yonai, and K. Takizawa, "Axi-Vision Camera (real-time distance-mapping camera)," Appl. Opt. 39, 3931-3939 (2000).
[CrossRef]

1999 (1)

C. J. Tsai and A. K. Katsaggelos, "Dense disparity estimation with a divide-and-conquer disparity space image technique," IEEE Trans. Multimedia 1, 18-29 (1999).
[CrossRef]

1998 (1)

M. S. Moellenhoff and M. W. Maier, "Transform coding of stereo image residuals," IEEE Trans. Image Process. 7, 804-812 (1998).
[CrossRef]

1997 (1)

1994 (1)

V. Grinberg, "Geometry of binocular imaging," in Stereoscopic Displays and Virtual Reality Systems, S. S. Fisher, J. O. Merritt, and M. T. Bolas, eds., Proc. SPIE 2177, 56-65 (1994).
[CrossRef]

1989 (2)

W. Ho and N. Ahuja, "Surfaces from stereo: integrating feature matching, disparity estimation, and contour detection," IEEE Trans. Pattern Anal. Mach. Intell. 11, 121-136 (1989).
[CrossRef]

U. R. Dhond and J. K. Aggarwal, "Structure from stereo-A review," IEEE Trans. Syst. Man Cybern. 19, 1489-1510 (1989).
[CrossRef]

1985 (1)

W. E. L. Grimson, "Computational experiments with a feature based stereo algorithm," IEEE Trans. Pattern Anal. Mach. Intell. PAMI- 7, 17-34 (1985).
[CrossRef]

1967 (1)

Abookasis, D.

Aggarwal, J. K.

U. R. Dhond and J. K. Aggarwal, "Structure from stereo-A review," IEEE Trans. Syst. Man Cybern. 19, 1489-1510 (1989).
[CrossRef]

Ahuja, N.

W. Ho and N. Ahuja, "Surfaces from stereo: integrating feature matching, disparity estimation, and contour detection," IEEE Trans. Pattern Anal. Mach. Intell. 11, 121-136 (1989).
[CrossRef]

Aida, T.

Bae, K. H.

D. H. Kim, S. C. Kim, K. H. Bae, and E. S. Kim, "Performance analysis of a compact electro-optical 3D adapter with a wide capturing angle," in Novel Optical Systems Design and Optimization VIII, J. M. Sasian, R. J. Koshel, and R. C. Juergens, eds., Proc. SPIE 5875, 177-188 (2005).

K. H. Bae and E. S. Kim, "A new disparity estimation scheme based-on adaptive matching window for intermediate view reconstruction," Opt. Eng. 42, 1778-1786 (2003).
[CrossRef]

Dhond, U. R.

U. R. Dhond and J. K. Aggarwal, "Structure from stereo-A review," IEEE Trans. Syst. Man Cybern. 19, 1489-1510 (1989).
[CrossRef]

Fujikake, H.

Grimson, W. E. L.

W. E. L. Grimson, "Computational experiments with a feature based stereo algorithm," IEEE Trans. Pattern Anal. Mach. Intell. PAMI- 7, 17-34 (1985).
[CrossRef]

Grinberg, V.

V. Grinberg, "Geometry of binocular imaging," in Stereoscopic Displays and Virtual Reality Systems, S. S. Fisher, J. O. Merritt, and M. T. Bolas, eds., Proc. SPIE 2177, 56-65 (1994).
[CrossRef]

Ho, W.

W. Ho and N. Ahuja, "Surfaces from stereo: integrating feature matching, disparity estimation, and contour detection," IEEE Trans. Pattern Anal. Mach. Intell. 11, 121-136 (1989).
[CrossRef]

Iddan, G. J.

G. J. Iddan and G. Yahav, "Three-dimensional imaging in the studio and elsewhere," in Three-Dimensional Image Capture and Applications IV, B. D. Corner, J. H. Nurre, and R. P. Pargas, eds., Proc. SPIE 4298, 48-55 (2000).
[CrossRef]

Iizuka, K.

Inoue, T.

T. Shibata, T. Kawai, T. Inoue, Y. Sakaguchi, K. Okabe, and Y. Kuno, "Development of an electro-optical 3D adapter for stereoscopic video recording," in Stereoscopic Displays and Virtual Reality Systems IX, A. J. Woods, J. O. Merritt, S. A. Benton, and M. T. Bolas, eds., Proc. SPIE 4660, 325-330 (2002).
[CrossRef]

Iwase, S.

H. Yoshikawa, S. Iwase, and T. Oneda, "Fast computation of Fresnel holograms employing difference," in Practical Holography XIV and Holographic Materials VI, S.A.Benton, S.H.Stevenson, and T.J.Trout, eds., Proc. SPIE 3956, 48-55 (2000).

Katsaggelos, A. K.

C. J. Tsai and A. K. Katsaggelos, "Dense disparity estimation with a divide-and-conquer disparity space image technique," IEEE Trans. Multimedia 1, 18-29 (1999).
[CrossRef]

Kawai, T.

T. Shibata, T. Kawai, T. Inoue, Y. Sakaguchi, K. Okabe, and Y. Kuno, "Development of an electro-optical 3D adapter for stereoscopic video recording," in Stereoscopic Displays and Virtual Reality Systems IX, A. J. Woods, J. O. Merritt, S. A. Benton, and M. T. Bolas, eds., Proc. SPIE 4660, 325-330 (2002).
[CrossRef]

T. Kawai, "3D displays and applications," Displays 23, 49-56 (2002).
[CrossRef]

Kawakita, M.

Kikuchi, H.

Kim, D. H.

D. H. Kim, S. C. Kim, K. H. Bae, and E. S. Kim, "Performance analysis of a compact electro-optical 3D adapter with a wide capturing angle," in Novel Optical Systems Design and Optimization VIII, J. M. Sasian, R. J. Koshel, and R. C. Juergens, eds., Proc. SPIE 5875, 177-188 (2005).

Kim, E. S.

D. H. Kim, S. C. Kim, K. H. Bae, and E. S. Kim, "Performance analysis of a compact electro-optical 3D adapter with a wide capturing angle," in Novel Optical Systems Design and Optimization VIII, J. M. Sasian, R. J. Koshel, and R. C. Juergens, eds., Proc. SPIE 5875, 177-188 (2005).

K. H. Bae and E. S. Kim, "A new disparity estimation scheme based-on adaptive matching window for intermediate view reconstruction," Opt. Eng. 42, 1778-1786 (2003).
[CrossRef]

Kim, S. C.

D. H. Kim, S. C. Kim, K. H. Bae, and E. S. Kim, "Performance analysis of a compact electro-optical 3D adapter with a wide capturing angle," in Novel Optical Systems Design and Optimization VIII, J. M. Sasian, R. J. Koshel, and R. C. Juergens, eds., Proc. SPIE 5875, 177-188 (2005).

Kuno, Y.

T. Shibata, T. Kawai, T. Inoue, Y. Sakaguchi, K. Okabe, and Y. Kuno, "Development of an electro-optical 3D adapter for stereoscopic video recording," in Stereoscopic Displays and Virtual Reality Systems IX, A. J. Woods, J. O. Merritt, S. A. Benton, and M. T. Bolas, eds., Proc. SPIE 4660, 325-330 (2002).
[CrossRef]

Kuo, C. J.

C. J. Kuo and M. H. Tsai, Three-Dimensional Holographic Imaging (Wiley, 2002).

Lee, Y. H.

Y. H. Lee, "Adapter for three-dimensional moving image photographing device," Patent No. PCT/KR03/01064 (2003).

Li, Y.

Lohmann, A. W.

Maier, M. W.

M. S. Moellenhoff and M. W. Maier, "Transform coding of stereo image residuals," IEEE Trans. Image Process. 7, 804-812 (1998).
[CrossRef]

Moellenhoff, M. S.

M. S. Moellenhoff and M. W. Maier, "Transform coding of stereo image residuals," IEEE Trans. Image Process. 7, 804-812 (1998).
[CrossRef]

Okabe, K.

T. Shibata, T. Kawai, T. Inoue, Y. Sakaguchi, K. Okabe, and Y. Kuno, "Development of an electro-optical 3D adapter for stereoscopic video recording," in Stereoscopic Displays and Virtual Reality Systems IX, A. J. Woods, J. O. Merritt, S. A. Benton, and M. T. Bolas, eds., Proc. SPIE 4660, 325-330 (2002).
[CrossRef]

Oneda, T.

H. Yoshikawa, S. Iwase, and T. Oneda, "Fast computation of Fresnel holograms employing difference," in Practical Holography XIV and Holographic Materials VI, S.A.Benton, S.H.Stevenson, and T.J.Trout, eds., Proc. SPIE 3956, 48-55 (2000).

Paris, D. P.

Piestun, R.

Rosen, J.

Sakaguchi, Y.

T. Shibata, T. Kawai, T. Inoue, Y. Sakaguchi, K. Okabe, and Y. Kuno, "Development of an electro-optical 3D adapter for stereoscopic video recording," in Stereoscopic Displays and Virtual Reality Systems IX, A. J. Woods, J. O. Merritt, S. A. Benton, and M. T. Bolas, eds., Proc. SPIE 4660, 325-330 (2002).
[CrossRef]

Sato, K.

K. Takano and K. Sato, "Color electro-holographic display using a single white light source and a focal adjustment method," Opt. Eng. 41, 2427-2433 (2002).
[CrossRef]

Shamir, J.

Shibata, T.

T. Shibata, T. Kawai, T. Inoue, Y. Sakaguchi, K. Okabe, and Y. Kuno, "Development of an electro-optical 3D adapter for stereoscopic video recording," in Stereoscopic Displays and Virtual Reality Systems IX, A. J. Woods, J. O. Merritt, S. A. Benton, and M. T. Bolas, eds., Proc. SPIE 4660, 325-330 (2002).
[CrossRef]

Takano, K.

K. Takano and K. Sato, "Color electro-holographic display using a single white light source and a focal adjustment method," Opt. Eng. 41, 2427-2433 (2002).
[CrossRef]

Takizawa, K.

Tsai, C. J.

C. J. Tsai and A. K. Katsaggelos, "Dense disparity estimation with a divide-and-conquer disparity space image technique," IEEE Trans. Multimedia 1, 18-29 (1999).
[CrossRef]

Tsai, M. H.

C. J. Kuo and M. H. Tsai, Three-Dimensional Holographic Imaging (Wiley, 2002).

Yahav, G.

G. J. Iddan and G. Yahav, "Three-dimensional imaging in the studio and elsewhere," in Three-Dimensional Image Capture and Applications IV, B. D. Corner, J. H. Nurre, and R. P. Pargas, eds., Proc. SPIE 4298, 48-55 (2000).
[CrossRef]

Yonai, J.

Yoshikawa, H.

H. Yoshikawa, S. Iwase, and T. Oneda, "Fast computation of Fresnel holograms employing difference," in Practical Holography XIV and Holographic Materials VI, S.A.Benton, S.H.Stevenson, and T.J.Trout, eds., Proc. SPIE 3956, 48-55 (2000).

Appl. Opt. (3)

Displays (1)

T. Kawai, "3D displays and applications," Displays 23, 49-56 (2002).
[CrossRef]

IEEE Trans. Image Process. (1)

M. S. Moellenhoff and M. W. Maier, "Transform coding of stereo image residuals," IEEE Trans. Image Process. 7, 804-812 (1998).
[CrossRef]

IEEE Trans. Multimedia (1)

C. J. Tsai and A. K. Katsaggelos, "Dense disparity estimation with a divide-and-conquer disparity space image technique," IEEE Trans. Multimedia 1, 18-29 (1999).
[CrossRef]

IEEE Trans. Pattern Anal. Mach. Intell. (1)

W. Ho and N. Ahuja, "Surfaces from stereo: integrating feature matching, disparity estimation, and contour detection," IEEE Trans. Pattern Anal. Mach. Intell. 11, 121-136 (1989).
[CrossRef]

IEEE Trans. Pattern Anal. Mach. Intell. PAMI- (1)

W. E. L. Grimson, "Computational experiments with a feature based stereo algorithm," IEEE Trans. Pattern Anal. Mach. Intell. PAMI- 7, 17-34 (1985).
[CrossRef]

IEEE Trans. Syst. Man Cybern. (1)

U. R. Dhond and J. K. Aggarwal, "Structure from stereo-A review," IEEE Trans. Syst. Man Cybern. 19, 1489-1510 (1989).
[CrossRef]

Opt. Eng. (2)

K. Takano and K. Sato, "Color electro-holographic display using a single white light source and a focal adjustment method," Opt. Eng. 41, 2427-2433 (2002).
[CrossRef]

K. H. Bae and E. S. Kim, "A new disparity estimation scheme based-on adaptive matching window for intermediate view reconstruction," Opt. Eng. 42, 1778-1786 (2003).
[CrossRef]

Opt. Lett. (1)

Proc. SPIE (4)

G. J. Iddan and G. Yahav, "Three-dimensional imaging in the studio and elsewhere," in Three-Dimensional Image Capture and Applications IV, B. D. Corner, J. H. Nurre, and R. P. Pargas, eds., Proc. SPIE 4298, 48-55 (2000).
[CrossRef]

D. H. Kim, S. C. Kim, K. H. Bae, and E. S. Kim, "Performance analysis of a compact electro-optical 3D adapter with a wide capturing angle," in Novel Optical Systems Design and Optimization VIII, J. M. Sasian, R. J. Koshel, and R. C. Juergens, eds., Proc. SPIE 5875, 177-188 (2005).

T. Shibata, T. Kawai, T. Inoue, Y. Sakaguchi, K. Okabe, and Y. Kuno, "Development of an electro-optical 3D adapter for stereoscopic video recording," in Stereoscopic Displays and Virtual Reality Systems IX, A. J. Woods, J. O. Merritt, S. A. Benton, and M. T. Bolas, eds., Proc. SPIE 4660, 325-330 (2002).
[CrossRef]

V. Grinberg, "Geometry of binocular imaging," in Stereoscopic Displays and Virtual Reality Systems, S. S. Fisher, J. O. Merritt, and M. T. Bolas, eds., Proc. SPIE 2177, 56-65 (1994).
[CrossRef]

Other (7)

H. Yoshikawa, S. Iwase, and T. Oneda, "Fast computation of Fresnel holograms employing difference," in Practical Holography XIV and Holographic Materials VI, S.A.Benton, S.H.Stevenson, and T.J.Trout, eds., Proc. SPIE 3956, 48-55 (2000).

http://www.sony.co.kr.

http://www.wasol.co.kr.

http://www.ptgrey.com.

http://www.crlopto.com.

C. J. Kuo and M. H. Tsai, Three-Dimensional Holographic Imaging (Wiley, 2002).

Y. H. Lee, "Adapter for three-dimensional moving image photographing device," Patent No. PCT/KR03/01064 (2003).

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (14)

Fig. 1
Fig. 1

Block diagram of the proposed CGH generation method for a real 3D object.

Fig. 2
Fig. 2

Comparison of positions of the entrance pupil point: (a) conventional 3D adapter system and (b) Wasol 3D adapter system.

Fig. 3
Fig. 3

3D camera system configured with a 3D adapter attached to a video camcorder.

Fig. 4
Fig. 4

Pixel errors between the left and the right images: (a) stereo camera and (b) Wasol 3D camera.

Fig. 5
Fig. 5

Captured (a) left and (b) right images of the wooden rhinoceros doll.

Fig. 6
Fig. 6

Extraction process of depth data.

Fig. 7
Fig. 7

Estimated disparity maps by using the PWM algorithm.

Fig. 8
Fig. 8

Parallel stereo camera geometry for extraction of depth data.

Fig. 9
Fig. 9

Extracted depth maps from the disparity data.

Fig. 10
Fig. 10

Procedure for generating CGH patterns of a real 3D object of the wooden rhinoceros.

Fig. 11
Fig. 11

Computation model for a 1D Fresnel hologram.

Fig. 12
Fig. 12

Calculated hologram pattern of the green wooden rhinoceros image.

Fig. 13
Fig. 13

Experimental setup for holographic reconstruction of the constructed CGH pattern.

Fig. 14
Fig. 14

Optically reconstructed 3D images of the wooden rhinoceros object: (a) at the focal point of Z = 1080 mm and (b) at the focal point of Z = 1120 mm.

Tables (3)

Tables Icon

Table 1 Specification of the Wasol 3D Adapter (3D58 LenSys)

Tables Icon

Table 2 Mean Value of Color Differences between the Right and the Left Images

Tables Icon

Table 3 Specifications of the Wasol Demultiplexer (WSD-100DMX)

Equations (11)

Equations on this page are rendered with MathJax. Learn more.

MSE ( i , j ) = 1 N x N y i = 1 N x j = 1 N y | I L ( i , j ) I R ( i + d , j ) | 2 .
MSE ( i , j ) = | I L ( i , j ) I R ( i + d , j ) | 2 .
x  −  ( b / 2 ) z = x ( b / 2 ) h + l f + z ,
l = f x z f b 2 z + h , r = f x z + f b 2 z h .
d = ( l r ) = 2 h f b z .
z = f b 2 h d .
O ( x ) = p = 1 N a p r p exp [ j ( k r p + ϕ p ) ] ,
r p = ( x x p ) 2 + z p 2 .
R ( x ) = a R exp [ j ( k x sin θ R ) ] ,
I ( x ) = | O + R | 2 = | O | 2 + | R | 2 + 2 { O R * } ,
I ( x ) = 2 p = 1 N a p r p cos ( k r p + k x sin θ R + ϕ p ) .

Metrics