Abstract

In this paper, the 3D integral imaging method is extended to situations where the sensor positions in the image pick up stage are unknown. Conventional integral imaging systems require a priori knowledge of sensor positions in the image capture stage which can be difficult to measure in synthetic aperture or randomly distributed sensors modes. In the proposed method, only the relative position of two sensors is needed whereas all other sensors positions are unknown. We combine image correspondences extraction, camera perspective model, two view geometry and computational integral imaging 3D reconstruction techniques to overcome this limitation in integral imaging systems. The image reconstruction quality of the system with unknown sensor positions is compared with conventional integral imaging with known sensor positions. We also demonstrate how the proposed method may be used to improve the image reconstruction quality even in situations where the sensor positions recorded are subject to measurement errors.

© 2010 IEEE

PDF Article

References

  • View by:
  • |
  • |

  1. G. Lippmann, "La photographie integrale," Compt. Rend 146, 446-451 (1908).
  2. C. B. Burckhardt, "Optimum parameters and resolution limitation of integral photography," J. Opt. Soc. Amer. 58, 71-74 (1968).
  3. H. E. Ives, "Optical properties of a Lippmann lenticulated sheet," J. Opt. Soc. Ame. 21, 171-176 (1931).
  4. T. Okoshi, "Three-dimensional displays," Proc. IEEE 68, 548-564 (1980).
  5. Y. Igarishi, H. Murata, M. Ueda, "3D display system using a computer-generated integral photograph," Jpn. J. Appl. Phys. 17, 1683-1684 (1978).
  6. Three Dimensional Television, Video, and Display Technology (Springer-Verlag, 2002).
  7. F. Okano, J. Arai, K. Mitani, M. Okui, "Real-time integral imaging based on extremely high resolution video system," Proc. IEEE 94, 490-501 (2006).
  8. R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, B. Javidi, "Progress in 3-D multiperspective display by integral imaging," Proc. IEEE 97, 1067-1077 (2009).
  9. H. Arimoto, B. Javidi, "Integral three-dimensional imaging with digital reconstruction," Opt. Lett. 26, 157-159 (2001).
  10. J. S. Jang, B. Javidi, "Improved viewing resolution of 3-D integral imaging with nonstationary micro-optics," Opt. Lett. 27, 324-326 (2002).
  11. S.-H. Hong, J.-S. Jang, B. Javidi, "Three-dimensional volumetric object reconstruction using computational integral imaging," Opt. Express 12, 483-491 (2004).
  12. A. Stern, B. Javidi, "3D image sensing, visualization, and processing using integral imaging," Proc. IEEE 94, 591-608 (2006).
  13. H. Hoshino, F. Okano, H. Isono, I. Yuyama, "Analysis of resolution limitation of integral photography," J. Opt. Soc. Amer. A 15, 2056-2065 (1998).
  14. K. Perlin, S. Paxia, J. S. Kollin, "An autostereoscopic display," Proc. 27th Annu. Conf. on Comput. Graphics and Interact. Techn. (2000) pp. 319-326.
  15. B. Tavakoli, M. DaneshPanah, B. Javidi, E. Watson, "Performance of 3D integral imaging with position uncertainty," Opt. Express 15, 11889-11902 (2007).
  16. H. Yoo, D.-H. Shin, "Improved analysis on the signal property of computational integral imaging system," Opt. Express 15, 14107-14114 (2007).
  17. M. DaneshPanah, B. Javidi, E. A. Watson, "Three dimensional imaging with randomly distributed sensors," Opt. Express 16, 6368-6377 (2008).
  18. M. DaneshPanah, B. Javidi, "Profilometry and optical slicing by passive three-dimensional imaging," Opt. Lett. 34, 1105-1107 (2009).
  19. M. Martínez-Corral, R. Martínez-Cuenca, G. Saavedra, H. Navarro, A. Pons, B. Javidi, "Progresses in 3D integral imaging with optical processing," J. Phys.: Conf. Series 139, 012012 (2008).
  20. S. Maehara, K. Nitta, O. Matoba, "Three-dimensional measurement and imaging based on multicameras randomly distributed on the circumference," Appl. Opt. 47, 594-601 (2008).
  21. O. D. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint (MIT Press, 1993).
  22. R. Hartley, A. Zisserman, Multiple View Geometry in Computer Vision (Cambridge Univ. Press, 2000).
  23. R. Hartley, P. Sturm, "Triangulation," Computer Vision and Image Understanding 68, 146-157 (1996).
  24. C. Harris, M. Stephens, "A combined corner and edge detector," 4th Alvey Vision Conf. (1988) pp. 147-151.
  25. M. Fischler, R. Bolles, "Random sampling consensus: A paradigm for model fitting with application to image analysis and automated cartography," Commun. ACM 24, 381-395 (1981).
  26. M. Pollefeys, L. Van Gool, M. Vergauwen, F. Verbiest, K. Cornelis, J. Tops, R. Koch, "Visual modeling with a hand-held camera," Int. J. Comput. Vision 59, 207-232 (2004).
  27. M. Levoy, "Light fields and computational imaging," IEEE Comput. Mag. 39, 46-55 (2006).

2009 (2)

R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, B. Javidi, "Progress in 3-D multiperspective display by integral imaging," Proc. IEEE 97, 1067-1077 (2009).

M. DaneshPanah, B. Javidi, "Profilometry and optical slicing by passive three-dimensional imaging," Opt. Lett. 34, 1105-1107 (2009).

2008 (3)

2007 (2)

2006 (3)

M. Levoy, "Light fields and computational imaging," IEEE Comput. Mag. 39, 46-55 (2006).

A. Stern, B. Javidi, "3D image sensing, visualization, and processing using integral imaging," Proc. IEEE 94, 591-608 (2006).

F. Okano, J. Arai, K. Mitani, M. Okui, "Real-time integral imaging based on extremely high resolution video system," Proc. IEEE 94, 490-501 (2006).

2004 (2)

S.-H. Hong, J.-S. Jang, B. Javidi, "Three-dimensional volumetric object reconstruction using computational integral imaging," Opt. Express 12, 483-491 (2004).

M. Pollefeys, L. Van Gool, M. Vergauwen, F. Verbiest, K. Cornelis, J. Tops, R. Koch, "Visual modeling with a hand-held camera," Int. J. Comput. Vision 59, 207-232 (2004).

2002 (1)

2001 (1)

1998 (1)

H. Hoshino, F. Okano, H. Isono, I. Yuyama, "Analysis of resolution limitation of integral photography," J. Opt. Soc. Amer. A 15, 2056-2065 (1998).

1996 (1)

R. Hartley, P. Sturm, "Triangulation," Computer Vision and Image Understanding 68, 146-157 (1996).

1981 (1)

M. Fischler, R. Bolles, "Random sampling consensus: A paradigm for model fitting with application to image analysis and automated cartography," Commun. ACM 24, 381-395 (1981).

1980 (1)

T. Okoshi, "Three-dimensional displays," Proc. IEEE 68, 548-564 (1980).

1978 (1)

Y. Igarishi, H. Murata, M. Ueda, "3D display system using a computer-generated integral photograph," Jpn. J. Appl. Phys. 17, 1683-1684 (1978).

1968 (1)

C. B. Burckhardt, "Optimum parameters and resolution limitation of integral photography," J. Opt. Soc. Amer. 58, 71-74 (1968).

1931 (1)

H. E. Ives, "Optical properties of a Lippmann lenticulated sheet," J. Opt. Soc. Ame. 21, 171-176 (1931).

1908 (1)

G. Lippmann, "La photographie integrale," Compt. Rend 146, 446-451 (1908).

Appl. Opt. (1)

Commun. ACM (1)

M. Fischler, R. Bolles, "Random sampling consensus: A paradigm for model fitting with application to image analysis and automated cartography," Commun. ACM 24, 381-395 (1981).

Compt. Rend (1)

G. Lippmann, "La photographie integrale," Compt. Rend 146, 446-451 (1908).

Computer Vision and Image Understanding (1)

R. Hartley, P. Sturm, "Triangulation," Computer Vision and Image Understanding 68, 146-157 (1996).

IEEE Comput. Mag. (1)

M. Levoy, "Light fields and computational imaging," IEEE Comput. Mag. 39, 46-55 (2006).

Int. J. Comput. Vision (1)

M. Pollefeys, L. Van Gool, M. Vergauwen, F. Verbiest, K. Cornelis, J. Tops, R. Koch, "Visual modeling with a hand-held camera," Int. J. Comput. Vision 59, 207-232 (2004).

J. Opt. Soc. Ame. (1)

H. E. Ives, "Optical properties of a Lippmann lenticulated sheet," J. Opt. Soc. Ame. 21, 171-176 (1931).

J. Opt. Soc. Amer. (2)

C. B. Burckhardt, "Optimum parameters and resolution limitation of integral photography," J. Opt. Soc. Amer. 58, 71-74 (1968).

H. Hoshino, F. Okano, H. Isono, I. Yuyama, "Analysis of resolution limitation of integral photography," J. Opt. Soc. Amer. A 15, 2056-2065 (1998).

J. Phys.: Conf. Series (1)

M. Martínez-Corral, R. Martínez-Cuenca, G. Saavedra, H. Navarro, A. Pons, B. Javidi, "Progresses in 3D integral imaging with optical processing," J. Phys.: Conf. Series 139, 012012 (2008).

Jpn. J. Appl. Phys. (1)

Y. Igarishi, H. Murata, M. Ueda, "3D display system using a computer-generated integral photograph," Jpn. J. Appl. Phys. 17, 1683-1684 (1978).

Opt. Express (4)

Opt. Lett. (3)

Proc. IEEE (4)

A. Stern, B. Javidi, "3D image sensing, visualization, and processing using integral imaging," Proc. IEEE 94, 591-608 (2006).

F. Okano, J. Arai, K. Mitani, M. Okui, "Real-time integral imaging based on extremely high resolution video system," Proc. IEEE 94, 490-501 (2006).

R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, B. Javidi, "Progress in 3-D multiperspective display by integral imaging," Proc. IEEE 97, 1067-1077 (2009).

T. Okoshi, "Three-dimensional displays," Proc. IEEE 68, 548-564 (1980).

Other (5)

Three Dimensional Television, Video, and Display Technology (Springer-Verlag, 2002).

K. Perlin, S. Paxia, J. S. Kollin, "An autostereoscopic display," Proc. 27th Annu. Conf. on Comput. Graphics and Interact. Techn. (2000) pp. 319-326.

O. D. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint (MIT Press, 1993).

R. Hartley, A. Zisserman, Multiple View Geometry in Computer Vision (Cambridge Univ. Press, 2000).

C. Harris, M. Stephens, "A combined corner and edge detector," 4th Alvey Vision Conf. (1988) pp. 147-151.

Cited By

OSA participates in Crossref's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.