Real-time capture and reconstruction system with multiple GPUs for a 3D live scene by a generation from 4K IP images to 8K holograms

Yasuyuki Ichihashi; Ryutaro Oi; Takanori Senoh; Kenji Yamamoto; Taiichiro Kurita

doi:10.1364/OE.20.021645

Real-time capture and reconstruction system with multiple GPUs for a 3D live scene by a generation from 4K IP images to 8K holograms

Yasuyuki Ichihashi, Ryutaro Oi, Takanori Senoh, Kenji Yamamoto, and Taiichiro Kurita

Optics Express
Vol. 20,
Issue 19,
pp. 21645-21655
(2012)
•https://doi.org/10.1364/OE.20.021645

Get Citation
Copy Citation Text
Yasuyuki Ichihashi, Ryutaro Oi, Takanori Senoh, Kenji Yamamoto, and Taiichiro Kurita, "Real-time capture and reconstruction system with multiple GPUs for a 3D live scene by a generation from 4K IP images to 8K holograms," Opt. Express 20, 21645-21655 (2012)

Export Citation
- BibTex
- Endnote (RIS)
- HTML
- Plain Text
Get PDF (2999 KB)
Set citation alerts
Save article

Related Topics
Table of Contents Category
- Holography
Optics & Photonics Topics
?

The topics in this list come from the OSA Optics and Photonics Topics applied to this article.
Previously assigned OCIS codes
- Computer holography (090.1760)
- Holographic display (090.2870)
- Real-time holography (090.5694)

About this Article
History
- Original Manuscript: June 15, 2012
- Revised Manuscript: August 30, 2012
- Manuscript Accepted: September 1, 2012
- Published: September 6, 2012

Accessible

Open Access

Abstract

We developed a real-time capture and reconstruction system for three-dimensional (3D) live scenes. In previous research, we used integral photography (IP) to capture 3D images and then generated holograms from the IP images to implement a real-time reconstruction system. In this paper, we use a 4K (3,840 × 2,160) camera to capture IP images and 8K (7,680 × 4,320) liquid crystal display (LCD) panels for the reconstruction of holograms. We investigate two methods for enlarging the 4K images that were captured by integral photography to 8K images. One of the methods increases the number of pixels of each elemental image. The other increases the number of elemental images. In addition, we developed a personal computer (PC) cluster system with graphics processing units (GPUs) for the enlargement of IP images and the generation of holograms from the IP images using fast Fourier transform (FFT). We used the Compute Unified Device Architecture (CUDA) as the development environment for the GPUs. The Fast Fourier transform is performed using the CUFFT (CUDA FFT) library. As a result, we developed an integrated system for performing all processing from the capture to the reconstruction of 3D images by using these components and successfully used this system to reconstruct a 3D live scene at 12 frames per second.

Full Article | PDF Article

OSA Recommended Articles

Calculation of holograms from elemental images captured by integral photography

Tomoyuki Mishina, Makoto Okui, and Fumio Okano
Appl. Opt. 45(17) 4026-4036 (2006)

360-degree color hologram generation for real 3D objects

Eun-Young Chang, Jongho Choi, Sangha Lee, Soonchul Kwon, Jisang Yoo, Minsik Park, and Jinwoong Kim
Appl. Opt. 57(1) A91-A100 (2018)

Integral 3D display using multiple LCD panels and multi-image combining optical system

Naoto Okaichi, Masato Miura, Jun Arai, Masahiro Kawakita, and Tomoyuki Mishina
Opt. Express 25(3) 2805-2817 (2017)

References

View by:
Article Order
|
Year
|
Author
|
Publication

G. Tricoles, “Computer generated holograms: an historical review,” Appl. Opt. 26(20), 4351–4357 (1987), http://www.opticsinfobase.org/ao/abstract.cfm?URI=ao-26-20-4351 .
[Crossref] [PubMed]
P. St-Hilaire, S. A. Benton, M. Lucente, M. L. Jepsen, J. Kollin, H. Yoshikawa, and J. Underkoffler, “Electronic display system for computational holography,” Proc. SPIE 1212–20, 174–182 (1990).
[Crossref]
N. Hashimoto, S. Morokawa, and K. Kitamura, “Real-time holography using the high-resolution LCTV-SLM,” Proc. SPIE 1461, 291–302 (1991).
[Crossref]
K. Sato, K. Higuchi, and H. Katsuma, “Holographic television by liquid crystal devices,” Proc. SPIE 1667, 19–31 (1992).
[Crossref]
M. Lucente and T. A. Galyean, “Rendering interactive holographic images,” Proc. ACM SIGGRAPH 95, 387– 394 (1995).
M. Lucente, “Holographic bandwidth compression using spatial subsampling,” Opt. Eng. 35(6), 1529–1537 (1996).
[Crossref]
M. Lucente, “Computational holographic bandwidth compression,” IBM Syst. J. 35(3.4), 349–365 (1996).
[Crossref]
T. Okada, S. Iwata, O. Nishikawa, K. Matsumoto, H. Yoshikawa, K. Sato, and T. Honda, “The fast computation of holograms for the interactive holographic 3D display system,” Proc. SPIE 2577, 33–40 (1995).
[Crossref]
A. Shiraki, N. Takada, M. Niwa, Y. Ichihashi, T. Shimobaba, N. Masuda, and T. Ito, “Simplified electroholographic color reconstruction system using graphics processing unit and liquid crystal display projector,” Opt. Express 17(18), 16038–16045 (2009), http://www.opticsinfobase.org/oe/abstract.cfm?URI=oe-17-18-16038 .
[Crossref] [PubMed]
Y. Ichihashi, N. Masuda, M. Tsuge, H. Nakayama, A. Shiraki, T. Shimobaba, and T. Ito, “One-unit system to reconstruct a 3-D movie at a video-rate via electroholography,” Opt. Express 17(22), 19691–19697 (2009), http://www.opticsinfobase.org/oe/abstract.cfm?URI=oe-17-22-19691 .
[Crossref] [PubMed]
J. Barabas, S. Jolly, D. E. Smalley, and V. M. Bove“Diffraction specific coherent panoramagrams of real scenes,” Proc. SPIE 7957, 795702, 795702-7 (2011).
[Crossref]
J. Barabas, S. Jolly, D. E. Smalley, and V. Michael Bove., “Depth perception and user interface in digital holographic television,” Proc. SPIE 8281, 828109, 828109-6 (2012).
[Crossref]
Y. Takaki and J. Nakamura, “Development of a Holographic Display Module Using a 4k2k-SLM Based on the Resolution Redistribution Technique,” in Digital Holography and Three-Dimensional Imaging, OSA Technical Digest (Optical Society of America, 2012), paper DM2C.5 http://www.opticsinfobase.org/abstract.cfm?URI=DH-2012-DM2C.5 .
T. Senoh, T. Mishina, K. Yamamoto, R. Oi, and T. Kurita, “Viewing-zone-angle-expanded color electronic holography system using ultra-high-definition liquid crystal displays with undesirable light elimination,” J. Display Technol. 7(7), 382–390 (2011), http://www.opticsinfobase.org/jdt/abstract.cfm?URI=jdt-7-7-382 .
[Crossref]
T. Mishina, R. Oi, J. Arai, F. Okano, and M. Okui, “Three-dimensional image reconstruction of real objects with electronic holography using 4K2K liquid crystal panels,” in Proceedings of the 14th International Display Workshops (IDW’07), 3D3–4L, 2253–2254 (2007).
K. Yamamoto, T. Mishina, R. Oi, T. Senoh, and T. Kurita, “Real-time color holography system for live scene using 4K2K video system,” Proc. SPIE 7619, 761906, 761906-10 (2010).
[Crossref]
M. G. Lippmann, “Epreuves reversible donnant la sensation du relief,” J. Phys. 7, 821–825 (1908).
J. Arai, F. Okano, H. Hoshino, and I. Yuyama, “Gradient-index lens-array method based on real-time integral photography for three-dimensional images,” Appl. Opt. 37(11), 2034–2045 (1998), http://www.opticsinfobase.org/ao/abstract.cfm?URI=ao-37-11-2034 .
[Crossref] [PubMed]
R. V. Pole, “3D Imagery and Holograms of Objects Illuminated in White Light,” Appl. Phys. Lett. 10(1), 20–22 (1967).
[Crossref]
H. Hoshino, F. Okano, H. Isono, and I. Yuyama, “Analysis of resolution limitation of integral photography,” J. Opt. Soc. Am. A 15(8), 2059–2065 (1998), http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-15-8-2059 .
[Crossref]
T. Naemura, T. Yoshida, and H. Harashima, “3-D computer graphics based on integral photography,” Opt. Express 8(4), 255–262 (2001), http://www.opticsinfobase.org/oe/abstract.cfm?URI=oe-8-4-255 .
[Crossref] [PubMed]
T. Georgiev, K. C. Zheng, B. Curless, D. Salesin, S. Nayar, and C. Intwala, “Spatio-Angular Resolution Tradeoff in Integral Photography,” Proceedings of Eurographics Symposium on Rendering, 263–272 (2006).
O. Bryngdahl and A. Lohmann, “Single-Sideband Holography,” J. Opt. Soc. Am. 58(5), 620–624 (1968), http://www.opticsinfobase.org/josa/abstract.cfm?URI=josa-58-5-620 .
[Crossref]
T. Mishina, F. Okano, and I. Yuyama, “Time-Alternating Method Based on Single-Sideband Holography with Half-Zone-Plate Processing for the Enlargement of Viewing Zones,” Appl. Opt. 38(17), 3703–3713 (1999), http://www.opticsinfobase.org/ao/abstract.cfm?URI=ao-38-17-3703 .
[Crossref] [PubMed]

2012 (1)

J. Barabas, S. Jolly, D. E. Smalley, and V. Michael Bove., “Depth perception and user interface in digital holographic television,” Proc. SPIE 8281, 828109, 828109-6 (2012).
[Crossref]

2011 (2)

J. Barabas, S. Jolly, D. E. Smalley, and V. M. Bove“Diffraction specific coherent panoramagrams of real scenes,” Proc. SPIE 7957, 795702, 795702-7 (2011).
[Crossref]

T. Senoh, T. Mishina, K. Yamamoto, R. Oi, and T. Kurita, “Viewing-zone-angle-expanded color electronic holography system using ultra-high-definition liquid crystal displays with undesirable light elimination,” J. Display Technol. 7(7), 382–390 (2011), http://www.opticsinfobase.org/jdt/abstract.cfm?URI=jdt-7-7-382 .
[Crossref]

2010 (1)

K. Yamamoto, T. Mishina, R. Oi, T. Senoh, and T. Kurita, “Real-time color holography system for live scene using 4K2K video system,” Proc. SPIE 7619, 761906, 761906-10 (2010).
[Crossref]

1996 (2)

M. Lucente, “Holographic bandwidth compression using spatial subsampling,” Opt. Eng. 35(6), 1529–1537 (1996).
[Crossref]

M. Lucente, “Computational holographic bandwidth compression,” IBM Syst. J. 35(3.4), 349–365 (1996).
[Crossref]

1995 (1)

T. Okada, S. Iwata, O. Nishikawa, K. Matsumoto, H. Yoshikawa, K. Sato, and T. Honda, “The fast computation of holograms for the interactive holographic 3D display system,” Proc. SPIE 2577, 33–40 (1995).
[Crossref]

1992 (1)

K. Sato, K. Higuchi, and H. Katsuma, “Holographic television by liquid crystal devices,” Proc. SPIE 1667, 19–31 (1992).
[Crossref]

1991 (1)

N. Hashimoto, S. Morokawa, and K. Kitamura, “Real-time holography using the high-resolution LCTV-SLM,” Proc. SPIE 1461, 291–302 (1991).
[Crossref]

1990 (1)

P. St-Hilaire, S. A. Benton, M. Lucente, M. L. Jepsen, J. Kollin, H. Yoshikawa, and J. Underkoffler, “Electronic display system for computational holography,” Proc. SPIE 1212–20, 174–182 (1990).
[Crossref]

1987 (1)

G. Tricoles, “Computer generated holograms: an historical review,” Appl. Opt. 26(20), 4351–4357 (1987), http://www.opticsinfobase.org/ao/abstract.cfm?URI=ao-26-20-4351 .
[Crossref] [PubMed]

1968 (1)

O. Bryngdahl and A. Lohmann, “Single-Sideband Holography,” J. Opt. Soc. Am. 58(5), 620–624 (1968), http://www.opticsinfobase.org/josa/abstract.cfm?URI=josa-58-5-620 .
[Crossref]

1967 (1)

R. V. Pole, “3D Imagery and Holograms of Objects Illuminated in White Light,” Appl. Phys. Lett. 10(1), 20–22 (1967).
[Crossref]

1908 (1)

M. G. Lippmann, “Epreuves reversible donnant la sensation du relief,” J. Phys. 7, 821–825 (1908).

Arai, J.

Barabas, J.

J. Barabas, S. Jolly, D. E. Smalley, and V. Michael Bove., “Depth perception and user interface in digital holographic television,” Proc. SPIE 8281, 828109, 828109-6 (2012).
[Crossref]

J. Barabas, S. Jolly, D. E. Smalley, and V. M. Bove“Diffraction specific coherent panoramagrams of real scenes,” Proc. SPIE 7957, 795702, 795702-7 (2011).
[Crossref]

Benton, S. A.

Bove, V. M.

J. Barabas, S. Jolly, D. E. Smalley, and V. M. Bove“Diffraction specific coherent panoramagrams of real scenes,” Proc. SPIE 7957, 795702, 795702-7 (2011).
[Crossref]

Bryngdahl, O.

O. Bryngdahl and A. Lohmann, “Single-Sideband Holography,” J. Opt. Soc. Am. 58(5), 620–624 (1968), http://www.opticsinfobase.org/josa/abstract.cfm?URI=josa-58-5-620 .
[Crossref]

Harashima, H.

Hashimoto, N.

N. Hashimoto, S. Morokawa, and K. Kitamura, “Real-time holography using the high-resolution LCTV-SLM,” Proc. SPIE 1461, 291–302 (1991).
[Crossref]

Higuchi, K.

K. Sato, K. Higuchi, and H. Katsuma, “Holographic television by liquid crystal devices,” Proc. SPIE 1667, 19–31 (1992).
[Crossref]

Honda, T.

Hoshino, H.

Ichihashi, Y.

Isono, H.

Ito, T.

Iwata, S.

Jepsen, M. L.

Jolly, S.

J. Barabas, S. Jolly, D. E. Smalley, and V. Michael Bove., “Depth perception and user interface in digital holographic television,” Proc. SPIE 8281, 828109, 828109-6 (2012).
[Crossref]

J. Barabas, S. Jolly, D. E. Smalley, and V. M. Bove“Diffraction specific coherent panoramagrams of real scenes,” Proc. SPIE 7957, 795702, 795702-7 (2011).
[Crossref]

Katsuma, H.

K. Sato, K. Higuchi, and H. Katsuma, “Holographic television by liquid crystal devices,” Proc. SPIE 1667, 19–31 (1992).
[Crossref]

Kitamura, K.

N. Hashimoto, S. Morokawa, and K. Kitamura, “Real-time holography using the high-resolution LCTV-SLM,” Proc. SPIE 1461, 291–302 (1991).
[Crossref]

Kollin, J.

Kurita, T.

K. Yamamoto, T. Mishina, R. Oi, T. Senoh, and T. Kurita, “Real-time color holography system for live scene using 4K2K video system,” Proc. SPIE 7619, 761906, 761906-10 (2010).
[Crossref]

Lippmann, M. G.

M. G. Lippmann, “Epreuves reversible donnant la sensation du relief,” J. Phys. 7, 821–825 (1908).

Lohmann, A.

O. Bryngdahl and A. Lohmann, “Single-Sideband Holography,” J. Opt. Soc. Am. 58(5), 620–624 (1968), http://www.opticsinfobase.org/josa/abstract.cfm?URI=josa-58-5-620 .
[Crossref]

Lucente, M.

M. Lucente, “Computational holographic bandwidth compression,” IBM Syst. J. 35(3.4), 349–365 (1996).
[Crossref]

M. Lucente, “Holographic bandwidth compression using spatial subsampling,” Opt. Eng. 35(6), 1529–1537 (1996).
[Crossref]

Masuda, N.

Matsumoto, K.

Michael Bove, V.

J. Barabas, S. Jolly, D. E. Smalley, and V. Michael Bove., “Depth perception and user interface in digital holographic television,” Proc. SPIE 8281, 828109, 828109-6 (2012).
[Crossref]

Mishina, T.

K. Yamamoto, T. Mishina, R. Oi, T. Senoh, and T. Kurita, “Real-time color holography system for live scene using 4K2K video system,” Proc. SPIE 7619, 761906, 761906-10 (2010).
[Crossref]

Morokawa, S.

N. Hashimoto, S. Morokawa, and K. Kitamura, “Real-time holography using the high-resolution LCTV-SLM,” Proc. SPIE 1461, 291–302 (1991).
[Crossref]

Naemura, T.

Nakayama, H.

Nishikawa, O.

Niwa, M.

Oi, R.

K. Yamamoto, T. Mishina, R. Oi, T. Senoh, and T. Kurita, “Real-time color holography system for live scene using 4K2K video system,” Proc. SPIE 7619, 761906, 761906-10 (2010).
[Crossref]

Okada, T.

Okano, F.

Pole, R. V.

R. V. Pole, “3D Imagery and Holograms of Objects Illuminated in White Light,” Appl. Phys. Lett. 10(1), 20–22 (1967).
[Crossref]

Sato, K.

K. Sato, K. Higuchi, and H. Katsuma, “Holographic television by liquid crystal devices,” Proc. SPIE 1667, 19–31 (1992).
[Crossref]

Senoh, T.

K. Yamamoto, T. Mishina, R. Oi, T. Senoh, and T. Kurita, “Real-time color holography system for live scene using 4K2K video system,” Proc. SPIE 7619, 761906, 761906-10 (2010).
[Crossref]

Shimobaba, T.

Shiraki, A.

Smalley, D. E.

J. Barabas, S. Jolly, D. E. Smalley, and V. Michael Bove., “Depth perception and user interface in digital holographic television,” Proc. SPIE 8281, 828109, 828109-6 (2012).
[Crossref]

J. Barabas, S. Jolly, D. E. Smalley, and V. M. Bove“Diffraction specific coherent panoramagrams of real scenes,” Proc. SPIE 7957, 795702, 795702-7 (2011).
[Crossref]

St-Hilaire, P.

Takada, N.

Tricoles, G.

G. Tricoles, “Computer generated holograms: an historical review,” Appl. Opt. 26(20), 4351–4357 (1987), http://www.opticsinfobase.org/ao/abstract.cfm?URI=ao-26-20-4351 .
[Crossref] [PubMed]

Tsuge, M.

Underkoffler, J.

Yamamoto, K.

K. Yamamoto, T. Mishina, R. Oi, T. Senoh, and T. Kurita, “Real-time color holography system for live scene using 4K2K video system,” Proc. SPIE 7619, 761906, 761906-10 (2010).
[Crossref]

Yoshida, T.

Yoshikawa, H.

Yuyama, I.

Appl. Opt. (3)

G. Tricoles, “Computer generated holograms: an historical review,” Appl. Opt. 26(20), 4351–4357 (1987), http://www.opticsinfobase.org/ao/abstract.cfm?URI=ao-26-20-4351 .
[Crossref] [PubMed]

Appl. Phys. Lett. (1)

R. V. Pole, “3D Imagery and Holograms of Objects Illuminated in White Light,” Appl. Phys. Lett. 10(1), 20–22 (1967).
[Crossref]

IBM Syst. J. (1)

M. Lucente, “Computational holographic bandwidth compression,” IBM Syst. J. 35(3.4), 349–365 (1996).
[Crossref]

J. Display Technol. (1)

J. Opt. Soc. Am. (1)

O. Bryngdahl and A. Lohmann, “Single-Sideband Holography,” J. Opt. Soc. Am. 58(5), 620–624 (1968), http://www.opticsinfobase.org/josa/abstract.cfm?URI=josa-58-5-620 .
[Crossref]

J. Opt. Soc. Am. A (1)

J. Phys. (1)

M. G. Lippmann, “Epreuves reversible donnant la sensation du relief,” J. Phys. 7, 821–825 (1908).

Opt. Eng. (1)

M. Lucente, “Holographic bandwidth compression using spatial subsampling,” Opt. Eng. 35(6), 1529–1537 (1996).
[Crossref]

Opt. Express (3)

Proc. SPIE (7)

K. Yamamoto, T. Mishina, R. Oi, T. Senoh, and T. Kurita, “Real-time color holography system for live scene using 4K2K video system,” Proc. SPIE 7619, 761906, 761906-10 (2010).
[Crossref]

J. Barabas, S. Jolly, D. E. Smalley, and V. M. Bove“Diffraction specific coherent panoramagrams of real scenes,” Proc. SPIE 7957, 795702, 795702-7 (2011).
[Crossref]

J. Barabas, S. Jolly, D. E. Smalley, and V. Michael Bove., “Depth perception and user interface in digital holographic television,” Proc. SPIE 8281, 828109, 828109-6 (2012).
[Crossref]

N. Hashimoto, S. Morokawa, and K. Kitamura, “Real-time holography using the high-resolution LCTV-SLM,” Proc. SPIE 1461, 291–302 (1991).
[Crossref]

K. Sato, K. Higuchi, and H. Katsuma, “Holographic television by liquid crystal devices,” Proc. SPIE 1667, 19–31 (1992).
[Crossref]

Other (4)

M. Lucente and T. A. Galyean, “Rendering interactive holographic images,” Proc. ACM SIGGRAPH 95, 387– 394 (1995).

Y. Takaki and J. Nakamura, “Development of a Holographic Display Module Using a 4k2k-SLM Based on the Resolution Redistribution Technique,” in Digital Holography and Three-Dimensional Imaging, OSA Technical Digest (Optical Society of America, 2012), paper DM2C.5 http://www.opticsinfobase.org/abstract.cfm?URI=DH-2012-DM2C.5 .

T. Mishina, R. Oi, J. Arai, F. Okano, and M. Okui, “Three-dimensional image reconstruction of real objects with electronic holography using 4K2K liquid crystal panels,” in Proceedings of the 14th International Display Workshops (IDW’07), 3D3–4L, 2253–2254 (2007).

T. Georgiev, K. C. Zheng, B. Curless, D. Salesin, S. Nayar, and C. Intwala, “Spatio-Angular Resolution Tradeoff in Integral Photography,” Proceedings of Eurographics Symposium on Rendering, 263–272 (2006).

Supplementary Material (3)

» Media 1: MOV (2816 KB)

» Media 2: MOV (2807 KB)

» Media 3: MOV (3469 KB)

Cited By

OSA participates in Crossref's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.

Click here to see a list of articles that cite this paper

Fig. 1 Capturing of a 3D image by integral photography.

Download Full Size | PPT Slide | PDF

Fig. 2 Lens system for capturing IP images by 4K video camera.

Download Full Size | PPT Slide | PDF

Fig. 3 Generation of elemental holograms from elemental images.

Download Full Size | PPT Slide | PDF

Fig. 4 Optical system for electronic holography with 8K LCD panels. In this paper, this real-time capturing and reconstructing system is not available with time-multiplexed expansion of viewing-zone angle because of cutting calculation costs. So ± 1 order illumination lights are cut out on the liquid crystal (LC) shutter 1.

Download Full Size | PPT Slide | PDF

Fig. 5 Two methods of interpolation and enlargement of the images captured by integral photography.

Download Full Size | PPT Slide | PDF

Fig. 6 Increasing the number of elemental images in live scene.

Download Full Size | PPT Slide | PDF

Fig. 7 Real-time capture and reconstruction system with multiple GPUs.

Download Full Size | PPT Slide | PDF

Fig. 8 Photographs of actual system. (a) is a 4K IP camera component. (b) is a special-purpose component for generating 8K holograms from 4K IP images. (c) is a 3D display component for electronic holography.

Download Full Size | PPT Slide | PDF

Fig. 9 Photographs of reconstructed images created using method 8K IP (1). (a) is a photograph when the camera is focused on a cube with letters “C” and “T” at approximately 4 mm away from the hologram. (b) is a photograph when the camera is focused on letters “3” and “D” at approximately 50 mm away from hologram.

Download Full Size | PPT Slide | PDF

Fig. 10 Movies of 3D objects reconstructed by our system. (a) is a movie of reconstructed images created using method 8K IP (1) (Media 1). (b) is a movie of reconstructed images created using method 8K IP (2) (Media 2). (c) is a movie when an object is put on a turntable (Media 3).

Download Full Size | PPT Slide | PDF

Fig. 11 (a) 4K images captured by IP camera are divided into four parts in this way and each one of the HD images is treated by one of 4 PCs. (b) Elemental images along the boundary of HD1 and HD2. Elemental images are not lined up along boundary because of skew of field lens and so on. (c) Data gaps occur on boundaries of IP images when each HD IP image is captured on the memory of each PC.

Download Full Size | PPT Slide | PDF

Tables (2)

Table 1 Specifications of the real-time capture and reconstruction system with multiple GPUs

View Table | View all tables in this article

Table 2 Performance of the real-time capture and reconstruction system with multiple GPUs

View Table | View all tables in this article

Equations (6)

Equations on this page are rendered with MathJax. Learn more.

g_{1} (x_{1}, y_{1}) = \frac{1}{j λ f} e^{- j k f} \int \int_{- \infty}^{\infty} g_{0} (x_{0}, y_{0}) \cdot e^{- j k \frac{{(x_{1} - x_{0})}^{2} + {(y_{1} - y_{0})}^{2}}{2 f}} d x_{0} d y_{0},

g_{2} (x_{2}, y_{2}) = g_{2} (x_{1}, y_{1}) = g_{1} (x_{1}, y_{1}) \cdot e^{j k \frac{x_{1}^{2} + y_{1}^{2}}{2 f}},

g_{3} (x_{3}, y_{3}) = \frac{1}{j λ d} e^{- j k d} \int \int_{- \infty}^{\infty} g_{2} (x_{2}, y_{2}) \cdot e^{- j k \frac{{(x_{3} - x_{2})}^{2} + {(y_{3} - y_{2})}^{2}}{2 d}} d x_{2} d y_{2},

g_{3} (x_{3}, y_{3}) = - \frac{e^{- 2 j k f}}{λ f} \int \int_{- \infty}^{\infty} g_{0} (x_{0}, y_{0}) \cdot e^{j 2 π (\frac{x_{0} x_{3} + y_{0} y_{3}}{λ f})} d x_{0} d y_{0}

g_{3} (x_{3} Δ p_{m}, y_{3} Δ p_{n}) = \sum_{y_{0} = 1}^{N} \sum_{x_{0} = 1}^{M} g_{0} (x_{0} Δ p_{m}, y_{0} Δ p_{n}) \cdot e^{j 2 π (x_{0} x_{3} \frac{Δ p_{m}^{2}}{λ f} + y_{0} y_{3} \frac{Δ p_{n}^{2}}{λ f})},

M Δ p_{m}^{2} = λ f, N Δ p_{n}^{2} = λ f

	PC1, PC2	PC3, PC4
Workstation	HP xw8400/CT (customized)	Dell Precision T5400 (customized)
CPU	Intel Xeon X5365 (3.0GHz)	Intel Xeon X5460 (3.16GHz)
Memory	DDR2-SDRAM PC2-5300 4 GBytes
Environment	Visual Studio 2010 Express,  CUDA (Compute Unified Device Architecture) tool kit Ver. 4.0
FFT library	CUFFT (CUDA FFT)
OS	Windows XP professional SP3 (32bit)
SDI capture card	ASTRODESIGN GG-163, GG-164-A × 4
External GPU	NVIDIA Quadro Plex 7000 × 4

	Interpolation	Interpolation + FFT
8K IP (1)	13.4	10.0
8K IP (2)	14.0	12.0
[Units: frames per second]

	PC1, PC2	PC3, PC4
Workstation	HP xw8400/CT (customized)	Dell Precision T5400 (customized)
CPU	Intel Xeon X5365 (3.0GHz)	Intel Xeon X5460 (3.16GHz)
Memory	DDR2-SDRAM PC2-5300 4 GBytes
Environment	Visual Studio 2010 Express,  CUDA (Compute Unified Device Architecture) tool kit Ver. 4.0
FFT library	CUFFT (CUDA FFT)
OS	Windows XP professional SP3 (32bit)
SDI capture card	ASTRODESIGN GG-163, GG-164-A × 4
External GPU	NVIDIA Quadro Plex 7000 × 4

	Interpolation	Interpolation + FFT
8K IP (1)	13.4	10.0
8K IP (2)	14.0	12.0
[Units: frames per second]

Abstract

References

2012 (1)

2011 (2)

2010 (1)

2009 (2)

2001 (1)

1999 (1)

1998 (2)

1996 (2)

1995 (1)

1992 (1)

1991 (1)

1990 (1)

1987 (1)

1968 (1)

1967 (1)

1908 (1)

Arai, J.

Barabas, J.

Benton, S. A.

Bove, V. M.

Bryngdahl, O.

Harashima, H.

Hashimoto, N.

Higuchi, K.

Honda, T.

Hoshino, H.

Ichihashi, Y.

Isono, H.

Ito, T.

Iwata, S.

Jepsen, M. L.

Jolly, S.

Katsuma, H.

Kitamura, K.

Kollin, J.

Kurita, T.

Lippmann, M. G.

Lohmann, A.

Lucente, M.

Masuda, N.

Matsumoto, K.

Michael Bove, V.

Mishina, T.

Morokawa, S.

Naemura, T.

Nakayama, H.

Nishikawa, O.

Niwa, M.

Oi, R.

Okada, T.

Okano, F.

Pole, R. V.

Sato, K.

Senoh, T.

Shimobaba, T.

Shiraki, A.

Smalley, D. E.

St-Hilaire, P.

Takada, N.

Tricoles, G.

Tsuge, M.

Underkoffler, J.

Yamamoto, K.

Yoshida, T.

Yoshikawa, H.

Yuyama, I.

Appl. Opt. (3)

Appl. Phys. Lett. (1)

IBM Syst. J. (1)

J. Display Technol. (1)

J. Opt. Soc. Am. (1)

J. Opt. Soc. Am. A (1)

J. Phys. (1)

Opt. Eng. (1)

Opt. Express (3)

Proc. SPIE (7)

Other (4)

Supplementary Material (3)