Abstract

A head-mounted display system with fully-integrated eyetracking capability offers multi-fold benefits, not only to fundamental scientific research but also to emerging applications of such technology. A key limitation of the state-of-the-art eyetracked head-mounted display (ET-HMD) technology is the lack of compactness and portability. In this paper, we present an innovative design of a high resolution optical see-through ET-HMD system based on freeform optical technology. A prototype system is demonstrated, which offers a goggle-like compact form factor, non-obstructive see-through field of view and true high-definition image resolution for the virtual display. The see-through view, via the combination of a freeform prism and corrector, achieved better than 0.5 arc minute of angular resolution for the central region of approximately 40-degrees to ensure minimal impacts on the see-through vision of an HMD user.

© 2013 Optical Society of America

Full Article  |  PDF Article

References

  • View by:
  • |
  • |
  • |

  1. J. P. Rolland, A. Yoshida, L. D. Davis, and J. H. Reif, “High-resolution inset head-mounted display,” Appl. Opt.37(19), 4183–4193 (1998).
    [CrossRef] [PubMed]
  2. S. L. S. Liu, H. H. H. Hua, and D. C. D. Cheng, “A novel prototype for an optical see-through head-mounted display with addressable focus cues,” IEEE Trans. Vis. Comput. Graph.16(3), 381–393 (2010).
    [CrossRef] [PubMed]
  3. A. T. Duchowski and A. Çöltekin, “Foveated gaze-contingent displays for peripheral LOD management, 3D visualization, and stereo imaging,” ACM Trans. Multimed. Comput. Commun. Appl.3(4), 1–18 (2007).
    [CrossRef]
  4. L. Vaissie and J. Rolland, “Head mounted display with eyetracking capability,” U.S. patent US 6433760 B1 (2002).
  5. H. Hua, “Integration of eye tracking capability into optical see-through head-mounted displays,” Proc. SPIE4297, 496–503 (2001).
    [CrossRef]
  6. H. Hua, P. Krishnaswamy, and J. P. Rolland, “Video-based eyetracking methods and algorithms in head-mounted displays,” Opt. Express14(10), 4328–4350 (2006).
    [CrossRef] [PubMed]
  7. H. Hua, C. W. Pansing, and J. P. Rolland, “Modeling of an eye-imaging system for optimizing illumination schemes in an eye-tracked head-mounted display,” Appl. Opt.46(31), 7757–7770 (2007).
    [CrossRef] [PubMed]
  8. J. Baumgarten, T. Schuchert, S. Voth, P. Wartenberg, B. Richter, and U. Vogel, “Aspects of a head-mounted eye-tracker based on a bidirectional OLED microdisplay,” J. Inf. Disp.13(2), 1–5 (2011).
  9. S. Yamazaki, K. Inoguchi, Y. Saito, H. Morishima, and N. Taniguchi, “Thin wide-field-of-view HMD with free-form-surface prism and applications,” Proc. SPIE3639, 453–462 (1999).
    [CrossRef]
  10. D. Cheng, Y. Wang, H. Hua, and M. M. Talha, “Design of an optical see-through head-mounted display with a low f-number and large field of view using a freeform prism,” Appl. Opt.48(14), 2655–2668 (2009).
    [CrossRef] [PubMed]
  11. H. Hua and C. Gao, “A compact eyetracked optical see-through head-mounted display,” in Proc. SPIE 8288, Stereoscopic Displays and Applications XXIII, A. J. Woods, N. S. Holliman, and G. E. Favalora, eds. (2012), Vol. 8288, p. 82881F–82881F–9.

2011

J. Baumgarten, T. Schuchert, S. Voth, P. Wartenberg, B. Richter, and U. Vogel, “Aspects of a head-mounted eye-tracker based on a bidirectional OLED microdisplay,” J. Inf. Disp.13(2), 1–5 (2011).

2010

S. L. S. Liu, H. H. H. Hua, and D. C. D. Cheng, “A novel prototype for an optical see-through head-mounted display with addressable focus cues,” IEEE Trans. Vis. Comput. Graph.16(3), 381–393 (2010).
[CrossRef] [PubMed]

2009

2007

H. Hua, C. W. Pansing, and J. P. Rolland, “Modeling of an eye-imaging system for optimizing illumination schemes in an eye-tracked head-mounted display,” Appl. Opt.46(31), 7757–7770 (2007).
[CrossRef] [PubMed]

A. T. Duchowski and A. Çöltekin, “Foveated gaze-contingent displays for peripheral LOD management, 3D visualization, and stereo imaging,” ACM Trans. Multimed. Comput. Commun. Appl.3(4), 1–18 (2007).
[CrossRef]

2006

2001

H. Hua, “Integration of eye tracking capability into optical see-through head-mounted displays,” Proc. SPIE4297, 496–503 (2001).
[CrossRef]

1999

S. Yamazaki, K. Inoguchi, Y. Saito, H. Morishima, and N. Taniguchi, “Thin wide-field-of-view HMD with free-form-surface prism and applications,” Proc. SPIE3639, 453–462 (1999).
[CrossRef]

1998

Baumgarten, J.

J. Baumgarten, T. Schuchert, S. Voth, P. Wartenberg, B. Richter, and U. Vogel, “Aspects of a head-mounted eye-tracker based on a bidirectional OLED microdisplay,” J. Inf. Disp.13(2), 1–5 (2011).

Cheng, D.

Cheng, D. C. D.

S. L. S. Liu, H. H. H. Hua, and D. C. D. Cheng, “A novel prototype for an optical see-through head-mounted display with addressable focus cues,” IEEE Trans. Vis. Comput. Graph.16(3), 381–393 (2010).
[CrossRef] [PubMed]

Çöltekin, A.

A. T. Duchowski and A. Çöltekin, “Foveated gaze-contingent displays for peripheral LOD management, 3D visualization, and stereo imaging,” ACM Trans. Multimed. Comput. Commun. Appl.3(4), 1–18 (2007).
[CrossRef]

Davis, L. D.

Duchowski, A. T.

A. T. Duchowski and A. Çöltekin, “Foveated gaze-contingent displays for peripheral LOD management, 3D visualization, and stereo imaging,” ACM Trans. Multimed. Comput. Commun. Appl.3(4), 1–18 (2007).
[CrossRef]

Hua, H.

Hua, H. H. H.

S. L. S. Liu, H. H. H. Hua, and D. C. D. Cheng, “A novel prototype for an optical see-through head-mounted display with addressable focus cues,” IEEE Trans. Vis. Comput. Graph.16(3), 381–393 (2010).
[CrossRef] [PubMed]

Inoguchi, K.

S. Yamazaki, K. Inoguchi, Y. Saito, H. Morishima, and N. Taniguchi, “Thin wide-field-of-view HMD with free-form-surface prism and applications,” Proc. SPIE3639, 453–462 (1999).
[CrossRef]

Krishnaswamy, P.

Liu, S. L. S.

S. L. S. Liu, H. H. H. Hua, and D. C. D. Cheng, “A novel prototype for an optical see-through head-mounted display with addressable focus cues,” IEEE Trans. Vis. Comput. Graph.16(3), 381–393 (2010).
[CrossRef] [PubMed]

Morishima, H.

S. Yamazaki, K. Inoguchi, Y. Saito, H. Morishima, and N. Taniguchi, “Thin wide-field-of-view HMD with free-form-surface prism and applications,” Proc. SPIE3639, 453–462 (1999).
[CrossRef]

Pansing, C. W.

Reif, J. H.

Richter, B.

J. Baumgarten, T. Schuchert, S. Voth, P. Wartenberg, B. Richter, and U. Vogel, “Aspects of a head-mounted eye-tracker based on a bidirectional OLED microdisplay,” J. Inf. Disp.13(2), 1–5 (2011).

Rolland, J. P.

Saito, Y.

S. Yamazaki, K. Inoguchi, Y. Saito, H. Morishima, and N. Taniguchi, “Thin wide-field-of-view HMD with free-form-surface prism and applications,” Proc. SPIE3639, 453–462 (1999).
[CrossRef]

Schuchert, T.

J. Baumgarten, T. Schuchert, S. Voth, P. Wartenberg, B. Richter, and U. Vogel, “Aspects of a head-mounted eye-tracker based on a bidirectional OLED microdisplay,” J. Inf. Disp.13(2), 1–5 (2011).

Talha, M. M.

Taniguchi, N.

S. Yamazaki, K. Inoguchi, Y. Saito, H. Morishima, and N. Taniguchi, “Thin wide-field-of-view HMD with free-form-surface prism and applications,” Proc. SPIE3639, 453–462 (1999).
[CrossRef]

Vogel, U.

J. Baumgarten, T. Schuchert, S. Voth, P. Wartenberg, B. Richter, and U. Vogel, “Aspects of a head-mounted eye-tracker based on a bidirectional OLED microdisplay,” J. Inf. Disp.13(2), 1–5 (2011).

Voth, S.

J. Baumgarten, T. Schuchert, S. Voth, P. Wartenberg, B. Richter, and U. Vogel, “Aspects of a head-mounted eye-tracker based on a bidirectional OLED microdisplay,” J. Inf. Disp.13(2), 1–5 (2011).

Wang, Y.

Wartenberg, P.

J. Baumgarten, T. Schuchert, S. Voth, P. Wartenberg, B. Richter, and U. Vogel, “Aspects of a head-mounted eye-tracker based on a bidirectional OLED microdisplay,” J. Inf. Disp.13(2), 1–5 (2011).

Yamazaki, S.

S. Yamazaki, K. Inoguchi, Y. Saito, H. Morishima, and N. Taniguchi, “Thin wide-field-of-view HMD with free-form-surface prism and applications,” Proc. SPIE3639, 453–462 (1999).
[CrossRef]

Yoshida, A.

ACM Trans. Multimed. Comput. Commun. Appl.

A. T. Duchowski and A. Çöltekin, “Foveated gaze-contingent displays for peripheral LOD management, 3D visualization, and stereo imaging,” ACM Trans. Multimed. Comput. Commun. Appl.3(4), 1–18 (2007).
[CrossRef]

Appl. Opt.

IEEE Trans. Vis. Comput. Graph.

S. L. S. Liu, H. H. H. Hua, and D. C. D. Cheng, “A novel prototype for an optical see-through head-mounted display with addressable focus cues,” IEEE Trans. Vis. Comput. Graph.16(3), 381–393 (2010).
[CrossRef] [PubMed]

J. Inf. Disp.

J. Baumgarten, T. Schuchert, S. Voth, P. Wartenberg, B. Richter, and U. Vogel, “Aspects of a head-mounted eye-tracker based on a bidirectional OLED microdisplay,” J. Inf. Disp.13(2), 1–5 (2011).

Opt. Express

Proc. SPIE

S. Yamazaki, K. Inoguchi, Y. Saito, H. Morishima, and N. Taniguchi, “Thin wide-field-of-view HMD with free-form-surface prism and applications,” Proc. SPIE3639, 453–462 (1999).
[CrossRef]

H. Hua, “Integration of eye tracking capability into optical see-through head-mounted displays,” Proc. SPIE4297, 496–503 (2001).
[CrossRef]

Other

L. Vaissie and J. Rolland, “Head mounted display with eyetracking capability,” U.S. patent US 6433760 B1 (2002).

H. Hua and C. Gao, “A compact eyetracked optical see-through head-mounted display,” in Proc. SPIE 8288, Stereoscopic Displays and Applications XXIII, A. J. Woods, N. S. Holliman, and G. E. Favalora, eds. (2012), Vol. 8288, p. 82881F–82881F–9.

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (4)

Fig. 1
Fig. 1

Optical system layout of ET-HMD: (a) virtual display and optical see-through paths; (b) eye illumination and imaging paths

Fig. 2
Fig. 2

(a) MTF field plots of the virtual display path; (b) MTF field plots of the see-through path

Fig. 3
Fig. 3

(a) freeform wedge prism prototype, (b) ET-HMD prototype (c) Display image captured with a camera placed at eye position.

Fig. 4
Fig. 4

(a) Captured see-through view of 40-degree resolution target, (b) Standard eye chart at 20ft seeing through the freeform prisms. (c) Captured eye image under IR illumination for eye-gaze tracking.

Tables (1)

Tables Icon

Table 1 MTF Performance (Average/Standard Deviation) at Different Pupil Positions

Metrics