Abstract

A novel method is presented for enhancing the natural visual perception afforded by augmented reality (AR) workstations. The approach incorporates a method for simulating perspective viewing using a monitor-based AR workstation that acts as a window to the physical workspace in front of it. Although similar AR workstations are often used in industry, they do not provide natural visual perception. By incorporating user head tracking and a spherical mirror, the method proposed enhances visual perception by simulating the depth cue of perspective viewing. The method interactively adjusts the viewing parameters to provide accurate perspective viewing of both the video stream (representing the physical environment) as well as the virtual objects superimposed within it. Hence, the user gains the impression of 3D viewing of the entire AR scene when moving ones head in front of the monitor. This paper describes the hardware setup and the method for perspective simulation within an AR software application. Finally, an experimental evaluation of the accuracy of the system is described to demonstrate the feasibility of the approach.

© 2014 OAPA

PDF Article

References

  • View by:
  • |
  • |

  1. J. Blake, The Natural User Interface Revolution (Manning, 2011).
  2. U. Neumann, A. Majoros, "Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance," Proc. IEEE Virtual Reality Annu. Int. Symp. (1998) pp. 4-11.
  3. A. Tang, C. Owen, F. Biocca, W. Mou, "Comparative effectiveness of augmented reality in object assembly," Proc. Conf. Human Factors in Computing Syst. (2003) pp. 73-80.
  4. F. Biocca, A. Tang, D. Lamas, J. Gregg, R. Brady, P. Gai, “How do users organize virtual tools around their body in immersive virtual and augmented environments?: An Exploratory study of egocentric spatial mapping of virtual tools in the mobile infosphere,” Media Interface and Network Design Labs, Michigan State Univ.LansingMIUSA (2001) Tech. Rep..
  5. A. Katzenbach, S. Haasis, "Virtual and mixed reality in a SOA based engineering environment," Proc. Design Synthesis, CIRP Design Conf. (2008) pp. 29.
  6. M. Wittke, "AR in der PKW-Entwicklung bei Volkswagen," Proc. 10. IFF Wissenschaftstage—Virtual Reality und Augmented Reality zum Planen, Testen und Betreiben technischer Syst. (2007) pp. 51-56.
  7. O. Geißel, L. Longhitano, A. Katzenbach, "Operativer Einsatz von mixed reality technologien im Baubarkeitsprozess der Fahrzeugentwicklung," Proc. Augmented & Virtual Reality in der Produktentstehung Paderborner Workshop Augmented & Virtual Reality in der Produktentstehung (2008) pp. 175-189.
  8. O. Geißel, L. Longhitano, A. Katzenbach, M. Resch, "Automotive mixed mock-up—Eine neue Entwicklungsplattform der Automobilindustrie," Proc. IFF Wissenschaftstage—Digitales Engineering und Virtuelle Techniken zum Planen, Testen und Betreiben technischer Syst. (2010) pp. 41-46.
  9. J. Grey, "Human-computer interaction in life drawing, a fine artist's perspective," Proc. 6th Int. Conf. Inf. Visualisation (2002) pp. 761-770.
  10. W. Krueger, C. Bohn, B. Froehlich, H. Schueth, W. Strauss, G. Wesche, "The responsive workbench," Proc. IEEE Comput. Graphics and Appl. 14, 1-14 (1994).
  11. J. Garstka, G. Peters, "View-dependent 3d projection using depth-image-based head tracking," Proc. 8th IEEE Int. Workshop on Projector–Camera Syst. (2011) pp. 52-58.
  12. P. Debevec, Y. Yu, "Efficient view-dependent image-based rendering with projective texture-mapping," Proc. 9th Eurographics Rendering Workshop (1998) pp. 105-116.
  13. B. Heigl, R. Koch, M. Pollefeys, J. Danzler, L. Van Gool, "Plenoptic modeling and rendering from image sequences taken by a hand-held camera," Proc. Mustererkennung Symp. (1999) pp. 1-9.
  14. J.-F. Evers-Senne, R. Koch, "Image based interactive rendering with view dependent geometry," Comput. Graph. 22, 573-582 (2003).
  15. Y. Mori, N. Fukushima, T. Fujii, M. Tanimoto, "View generation with 3D warping using depth information for FTV," Proc. 3DTV Conf.: The True Vision—Capture, Transmission and Display of 3D Video (2008) pp. 229-232.
  16. S. Würmllin, E. Lamboray, M. Waschbüsch, P. Kaufmann, A. Smolic, M. Gross, "Image-space free-viewpoint video," Proc. Vision, Modeling, and Visualization (2005) pp. 665-673.
  17. C. Zhang, "A survey on image-based rendering—Representation, sampling and compression," Signal Process.: Image Commun. 19, 1-28 (2004).
  18. H. Shum, B. Kang, "A review of image-based rendering techniques," Proc. IEEE/SPIE Visual Commun. Image Conf. (2000).
  19. A. Smolic, K. Mueller, P. Merkle, T. Rein, M. Kautzner, P. Eisert, T. Wiegand, "Free viewpoint video extraction, representation, coding, and rendering," Proc. Int. Conf. Image Process. (2004) pp. 3287-3290.
  20. O. Bimber, G. Wetzstein, A. Emmerling, C. Nitschke, "Enabling view-dependent stereoscopic projection in real environments," Proc. 4th IEEE/ACM Int. Symp. Mixed and Augmented Reality (2005) pp. 14-23.
  21. A. Hill, J. Schiefer, J. Wilson, B. Davidson, M. Gandy, B. MacIntyre, "Virtual transparency: Introducing parallax view into video see-through AR," Proc. IEEE Int. Symp. Mixed and Augmented Reality (2011) pp. 239-240.
  22. H. Kato, M. Billinghurst, "Marker tracking and HMD calibration for a video-based augmented reality conferencing system," Proc. 2nd Int. Workshop on Augmented Reality (1999) pp. 85-94.
  23. R. Lienhard, J. Maydt, "An extended set of haar-like features for rapid object detection," Proc. IEEE Int. Conf. Image Process. (2002) pp. 900-903.
  24. R. Szeliski, Computer Vision (Springer-Verlag, 2010).
  25. E. Reinhard, G. Ward, S. Pattanaik, P. Debevec, High Dynamic Range Imaging (Morgan Kaufmann, 2006).

2004 (1)

C. Zhang, "A survey on image-based rendering—Representation, sampling and compression," Signal Process.: Image Commun. 19, 1-28 (2004).

2003 (1)

J.-F. Evers-Senne, R. Koch, "Image based interactive rendering with view dependent geometry," Comput. Graph. 22, 573-582 (2003).

1994 (1)

W. Krueger, C. Bohn, B. Froehlich, H. Schueth, W. Strauss, G. Wesche, "The responsive workbench," Proc. IEEE Comput. Graphics and Appl. 14, 1-14 (1994).

Comput. Graph. (1)

J.-F. Evers-Senne, R. Koch, "Image based interactive rendering with view dependent geometry," Comput. Graph. 22, 573-582 (2003).

Proc. IEEE Comput. Graphics and Appl. (1)

W. Krueger, C. Bohn, B. Froehlich, H. Schueth, W. Strauss, G. Wesche, "The responsive workbench," Proc. IEEE Comput. Graphics and Appl. 14, 1-14 (1994).

Signal Process.: Image Commun. (1)

C. Zhang, "A survey on image-based rendering—Representation, sampling and compression," Signal Process.: Image Commun. 19, 1-28 (2004).

Other (22)

H. Shum, B. Kang, "A review of image-based rendering techniques," Proc. IEEE/SPIE Visual Commun. Image Conf. (2000).

A. Smolic, K. Mueller, P. Merkle, T. Rein, M. Kautzner, P. Eisert, T. Wiegand, "Free viewpoint video extraction, representation, coding, and rendering," Proc. Int. Conf. Image Process. (2004) pp. 3287-3290.

O. Bimber, G. Wetzstein, A. Emmerling, C. Nitschke, "Enabling view-dependent stereoscopic projection in real environments," Proc. 4th IEEE/ACM Int. Symp. Mixed and Augmented Reality (2005) pp. 14-23.

A. Hill, J. Schiefer, J. Wilson, B. Davidson, M. Gandy, B. MacIntyre, "Virtual transparency: Introducing parallax view into video see-through AR," Proc. IEEE Int. Symp. Mixed and Augmented Reality (2011) pp. 239-240.

H. Kato, M. Billinghurst, "Marker tracking and HMD calibration for a video-based augmented reality conferencing system," Proc. 2nd Int. Workshop on Augmented Reality (1999) pp. 85-94.

R. Lienhard, J. Maydt, "An extended set of haar-like features for rapid object detection," Proc. IEEE Int. Conf. Image Process. (2002) pp. 900-903.

R. Szeliski, Computer Vision (Springer-Verlag, 2010).

E. Reinhard, G. Ward, S. Pattanaik, P. Debevec, High Dynamic Range Imaging (Morgan Kaufmann, 2006).

J. Blake, The Natural User Interface Revolution (Manning, 2011).

U. Neumann, A. Majoros, "Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance," Proc. IEEE Virtual Reality Annu. Int. Symp. (1998) pp. 4-11.

A. Tang, C. Owen, F. Biocca, W. Mou, "Comparative effectiveness of augmented reality in object assembly," Proc. Conf. Human Factors in Computing Syst. (2003) pp. 73-80.

F. Biocca, A. Tang, D. Lamas, J. Gregg, R. Brady, P. Gai, “How do users organize virtual tools around their body in immersive virtual and augmented environments?: An Exploratory study of egocentric spatial mapping of virtual tools in the mobile infosphere,” Media Interface and Network Design Labs, Michigan State Univ.LansingMIUSA (2001) Tech. Rep..

A. Katzenbach, S. Haasis, "Virtual and mixed reality in a SOA based engineering environment," Proc. Design Synthesis, CIRP Design Conf. (2008) pp. 29.

M. Wittke, "AR in der PKW-Entwicklung bei Volkswagen," Proc. 10. IFF Wissenschaftstage—Virtual Reality und Augmented Reality zum Planen, Testen und Betreiben technischer Syst. (2007) pp. 51-56.

O. Geißel, L. Longhitano, A. Katzenbach, "Operativer Einsatz von mixed reality technologien im Baubarkeitsprozess der Fahrzeugentwicklung," Proc. Augmented & Virtual Reality in der Produktentstehung Paderborner Workshop Augmented & Virtual Reality in der Produktentstehung (2008) pp. 175-189.

O. Geißel, L. Longhitano, A. Katzenbach, M. Resch, "Automotive mixed mock-up—Eine neue Entwicklungsplattform der Automobilindustrie," Proc. IFF Wissenschaftstage—Digitales Engineering und Virtuelle Techniken zum Planen, Testen und Betreiben technischer Syst. (2010) pp. 41-46.

J. Grey, "Human-computer interaction in life drawing, a fine artist's perspective," Proc. 6th Int. Conf. Inf. Visualisation (2002) pp. 761-770.

J. Garstka, G. Peters, "View-dependent 3d projection using depth-image-based head tracking," Proc. 8th IEEE Int. Workshop on Projector–Camera Syst. (2011) pp. 52-58.

P. Debevec, Y. Yu, "Efficient view-dependent image-based rendering with projective texture-mapping," Proc. 9th Eurographics Rendering Workshop (1998) pp. 105-116.

B. Heigl, R. Koch, M. Pollefeys, J. Danzler, L. Van Gool, "Plenoptic modeling and rendering from image sequences taken by a hand-held camera," Proc. Mustererkennung Symp. (1999) pp. 1-9.

Y. Mori, N. Fukushima, T. Fujii, M. Tanimoto, "View generation with 3D warping using depth information for FTV," Proc. 3DTV Conf.: The True Vision—Capture, Transmission and Display of 3D Video (2008) pp. 229-232.

S. Würmllin, E. Lamboray, M. Waschbüsch, P. Kaufmann, A. Smolic, M. Gross, "Image-space free-viewpoint video," Proc. Vision, Modeling, and Visualization (2005) pp. 665-673.

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.