Abstract

A novel method enabling estimation of not only the screen surface as the conventional one, but the depth information from two-dimensional coordinates in an interactive projection system was proposed in this research. In this method, a one-shot black-and-white stripe pattern from a projector is projected on a screen plane, where the deformed pattern is captured by a charge-coupled device camera. An algorithm based on object/shadow simultaneous detection is proposed for fulfillment of the correspondence. The depth information of the object is then calculated using the triangulation principle. This technology provides a more direct feeling of virtual interaction in three dimensions without using auxiliary equipment or a special screen as interaction proxies. Simulation and experiments are carried out and the results verified the effectiveness of this method in depth detection.

© 2017 Optical Society of America

Full Article  |  PDF Article
OSA Recommended Articles
Three-dimensional measurement of object surfaces with complex shape and color distribution based on projection of color fringe patterns

Ke Chen, Jiangtao Xi, Yanguang Yu, Sheng Tong, and Qinghua Guo
Appl. Opt. 52(30) 7360-7366 (2013)

Depth measurements through controlled aberrations of projected patterns

Gabriel C. Birch, J. Scott Tyo, and Jim Schwiegerling
Opt. Express 20(6) 6561-6574 (2012)

Maximum a posteriori-based depth sensing with a single-shot maze pattern

Ruodai Li, Fu Li, Yi Niu, Guangming Shi, Lili Yang, and Xuemei Xie
Opt. Express 25(21) 25332-25352 (2017)

More Recommended Articles

References

  • View by:
  • Article Order
  • |
  • Year
  • |
  • Author
  • |
  • Publication
  1. K. D. D. Willis, “Pre-history of handheld projector-based interaction,” Pers. Ubiquitous Comput. 16(1), 5–15 (2012).
    [Crossref]
  2. K. Ni, Q. Zhou, L. Chen, P. Sun, H. Xu, Y. Gao, J. Ma, Y. Li, and M. Liu, “A location system based on two-dimensional position sensitive detector used in interactive projection systems,” Proc. SPIE 7850, 78502G (2010).
    [Crossref]
  3. X. Qiao, Q. Zhou, K. Ni, L. He, G. Wu, L. Mao, X. Cheng, and J. Ma, “Real-time interactive projection system based on infrared structured-light method,” Proc. SPIE 8558, 855802 (2012).
    [Crossref]
  4. P. Beardsley, J. van Baar, R. Raskar, and C. Forlines, “Interaction using a handheld projector,” IEEE Comput. Graph. Appl. 25(1), 39–43 (2005).
    [Crossref] [PubMed]
  5. Q. Zhou, K. Ni, Y. Lu, L. Chen, Y. Gao, L. He, H. Guo, J. Ma, Y. Li, and M. Liu, “Indirect measurement of the infrared pen point used in a short throw interactive projection system,” Proc. SPIE 7850, 78502F (2010).
    [Crossref]
  6. A. D. Wilson, “Play anywhere: a compact interactive tabletop projection-vision system,” in Proc. of the 18th Annual ACM Symposium on User Interface Software and Technology (2005), pp. 83–92.
  7. J. Letessier and F. Berard, “Visual tracking of bare fingers for interactive surfaces,” in Proc. of the 17th Annual ACM Symposium on User Interface Software and Technology (2004), pp. 199.
    [Crossref]
  8. C. Tomasi, A. Rafii, and I. Torunoglu, “Full-size projection keyboard for handheld devices,” Commun. ACM 46(7), 70–75 (2003).
    [Crossref]
  9. G. Tovi and W. Daniel, “Going deeper: a taxonomy of 3D on the tabletop,” in 2nd Annual IEEE International Workshop on Horizontal Interactive Human-Computed Systems (2007), pp. 137–144.
  10. I. Shahram, H. Steve, T. Stuart, D. Rosenfeld, N. Villar, A. Butler, and J. Westhues, “Going beyond the display: a surface technology with an electronically switchable diffuser,” in 21st Annual ACM Symposium on User Interface Software and Technology (2008), pp. 269–278.
  11. K. Yasuaki and N. Takeshi, “Tablescape plus: interactive small-sized vertical displays on a horizontal tabletop display,” in 2nd Annual IEEE International Workshop on Horizontal Interactive Human-Computed Systems (2007), pp. 155–162.
  12. C. R. Wren and Y. A. Ivanov, “Volumetric operations with surface margins,” in Computer Vision and Pattern Recognition: Technical Sketches (2001).
  13. P. Su, R. E. Parks, L. Wang, R. P. Angel, and J. H. Burge, “Software configurable optical test system: a computerized reverse Hartmann test,” Appl. Opt. 49(23), 4404–4412 (2010).
    [Crossref] [PubMed]
  14. Y. Wang, S. Negahdaripour, and M. D. Aykin, “Calibration and 3D reconstruction of underwater objects with non-single-view projection model by structured light stereo imaging,” Appl. Opt. 55(24), 6564–6575 (2016).
    [Crossref] [PubMed]
  15. P. S. Huang and S. Zhang, “Fast three-step phase-shifting algorithm,” Appl. Opt. 45(21), 5086–5091 (2006).
    [Crossref] [PubMed]
  16. Q. Zhang and X. Su, “High-speed optical measurement for the drumhead vibration,” Opt. Express 13(8), 3110–3116 (2005).
    [Crossref] [PubMed]
  17. S. Zhang, “Recent progresses on real-time 3D shape measurement using digital fringe projection techniques,” Opt. Lasers Eng. 48(2), 149–158 (2010).
    [Crossref]
  18. Y. Wang and S. Zhang, “Optimal fringe angle selection for digital fringe projection technique,” Appl. Opt. 52(29), 7094–7098 (2013).
    [Crossref] [PubMed]
  19. H. Kawasaki, R. Furukawa, R. Sagawa, and Y. Yagi, “Dynamic scene shape reconstruction using a single structured light pattern,” in IEEE Computer Vis. Pattern Recognition (2008), pp. 1–8.
  20. W. Lohry, V. Chen, and S. Zhang, “Absolute three-dimensional shape measurement using coded fringe patterns without phase unwrapping or projector calibration,” Opt. Express 22(2), 1287–1301 (2014).
    [Crossref] [PubMed]
  21. S. Zhang and P. Huang, “High-resolution, real-time 3D shape acquisition,” in Computer Society Conference on Computer Vision and Pattern Recognition Workshops (2004), pp. 28–38.
  22. P. S. Huang, C. P. Zhang, and F. P. Chiang, “High-speed 3-D shape measurement based on digital fringe projection,” Opt. Eng. 42(1), 163–168 (2003).
    [Crossref]
  23. O. Hilliges, S. Izadi, and A. D. Wilson, “Interactions in the air: adding further depth to interactive tabletops,” in Proc. of the 22nd Annual ACM Symposium on User Interface Software and Technology (2009), pp. 139–148.
    [Crossref]

2016 (1)

2014 (1)

2013 (1)

2012 (2)

K. D. D. Willis, “Pre-history of handheld projector-based interaction,” Pers. Ubiquitous Comput. 16(1), 5–15 (2012).
[Crossref]

X. Qiao, Q. Zhou, K. Ni, L. He, G. Wu, L. Mao, X. Cheng, and J. Ma, “Real-time interactive projection system based on infrared structured-light method,” Proc. SPIE 8558, 855802 (2012).
[Crossref]

2010 (4)

K. Ni, Q. Zhou, L. Chen, P. Sun, H. Xu, Y. Gao, J. Ma, Y. Li, and M. Liu, “A location system based on two-dimensional position sensitive detector used in interactive projection systems,” Proc. SPIE 7850, 78502G (2010).
[Crossref]

Q. Zhou, K. Ni, Y. Lu, L. Chen, Y. Gao, L. He, H. Guo, J. Ma, Y. Li, and M. Liu, “Indirect measurement of the infrared pen point used in a short throw interactive projection system,” Proc. SPIE 7850, 78502F (2010).
[Crossref]

S. Zhang, “Recent progresses on real-time 3D shape measurement using digital fringe projection techniques,” Opt. Lasers Eng. 48(2), 149–158 (2010).
[Crossref]

P. Su, R. E. Parks, L. Wang, R. P. Angel, and J. H. Burge, “Software configurable optical test system: a computerized reverse Hartmann test,” Appl. Opt. 49(23), 4404–4412 (2010).
[Crossref] [PubMed]

2006 (1)

2005 (2)

Q. Zhang and X. Su, “High-speed optical measurement for the drumhead vibration,” Opt. Express 13(8), 3110–3116 (2005).
[Crossref] [PubMed]

P. Beardsley, J. van Baar, R. Raskar, and C. Forlines, “Interaction using a handheld projector,” IEEE Comput. Graph. Appl. 25(1), 39–43 (2005).
[Crossref] [PubMed]

2003 (2)

P. S. Huang, C. P. Zhang, and F. P. Chiang, “High-speed 3-D shape measurement based on digital fringe projection,” Opt. Eng. 42(1), 163–168 (2003).
[Crossref]

C. Tomasi, A. Rafii, and I. Torunoglu, “Full-size projection keyboard for handheld devices,” Commun. ACM 46(7), 70–75 (2003).
[Crossref]

Angel, R. P.

Aykin, M. D.

Beardsley, P.

P. Beardsley, J. van Baar, R. Raskar, and C. Forlines, “Interaction using a handheld projector,” IEEE Comput. Graph. Appl. 25(1), 39–43 (2005).
[Crossref] [PubMed]

Berard, F.

J. Letessier and F. Berard, “Visual tracking of bare fingers for interactive surfaces,” in Proc. of the 17th Annual ACM Symposium on User Interface Software and Technology (2004), pp. 199.
[Crossref]

Burge, J. H.

Butler, A.

I. Shahram, H. Steve, T. Stuart, D. Rosenfeld, N. Villar, A. Butler, and J. Westhues, “Going beyond the display: a surface technology with an electronically switchable diffuser,” in 21st Annual ACM Symposium on User Interface Software and Technology (2008), pp. 269–278.

Chen, L.

Q. Zhou, K. Ni, Y. Lu, L. Chen, Y. Gao, L. He, H. Guo, J. Ma, Y. Li, and M. Liu, “Indirect measurement of the infrared pen point used in a short throw interactive projection system,” Proc. SPIE 7850, 78502F (2010).
[Crossref]

K. Ni, Q. Zhou, L. Chen, P. Sun, H. Xu, Y. Gao, J. Ma, Y. Li, and M. Liu, “A location system based on two-dimensional position sensitive detector used in interactive projection systems,” Proc. SPIE 7850, 78502G (2010).
[Crossref]

Chen, V.

Cheng, X.

X. Qiao, Q. Zhou, K. Ni, L. He, G. Wu, L. Mao, X. Cheng, and J. Ma, “Real-time interactive projection system based on infrared structured-light method,” Proc. SPIE 8558, 855802 (2012).
[Crossref]

Chiang, F. P.

P. S. Huang, C. P. Zhang, and F. P. Chiang, “High-speed 3-D shape measurement based on digital fringe projection,” Opt. Eng. 42(1), 163–168 (2003).
[Crossref]

Daniel, W.

G. Tovi and W. Daniel, “Going deeper: a taxonomy of 3D on the tabletop,” in 2nd Annual IEEE International Workshop on Horizontal Interactive Human-Computed Systems (2007), pp. 137–144.

Forlines, C.

P. Beardsley, J. van Baar, R. Raskar, and C. Forlines, “Interaction using a handheld projector,” IEEE Comput. Graph. Appl. 25(1), 39–43 (2005).
[Crossref] [PubMed]

Furukawa, R.

H. Kawasaki, R. Furukawa, R. Sagawa, and Y. Yagi, “Dynamic scene shape reconstruction using a single structured light pattern,” in IEEE Computer Vis. Pattern Recognition (2008), pp. 1–8.

Gao, Y.

Q. Zhou, K. Ni, Y. Lu, L. Chen, Y. Gao, L. He, H. Guo, J. Ma, Y. Li, and M. Liu, “Indirect measurement of the infrared pen point used in a short throw interactive projection system,” Proc. SPIE 7850, 78502F (2010).
[Crossref]

K. Ni, Q. Zhou, L. Chen, P. Sun, H. Xu, Y. Gao, J. Ma, Y. Li, and M. Liu, “A location system based on two-dimensional position sensitive detector used in interactive projection systems,” Proc. SPIE 7850, 78502G (2010).
[Crossref]

Guo, H.

Q. Zhou, K. Ni, Y. Lu, L. Chen, Y. Gao, L. He, H. Guo, J. Ma, Y. Li, and M. Liu, “Indirect measurement of the infrared pen point used in a short throw interactive projection system,” Proc. SPIE 7850, 78502F (2010).
[Crossref]

He, L.

X. Qiao, Q. Zhou, K. Ni, L. He, G. Wu, L. Mao, X. Cheng, and J. Ma, “Real-time interactive projection system based on infrared structured-light method,” Proc. SPIE 8558, 855802 (2012).
[Crossref]

Q. Zhou, K. Ni, Y. Lu, L. Chen, Y. Gao, L. He, H. Guo, J. Ma, Y. Li, and M. Liu, “Indirect measurement of the infrared pen point used in a short throw interactive projection system,” Proc. SPIE 7850, 78502F (2010).
[Crossref]

Hilliges, O.

O. Hilliges, S. Izadi, and A. D. Wilson, “Interactions in the air: adding further depth to interactive tabletops,” in Proc. of the 22nd Annual ACM Symposium on User Interface Software and Technology (2009), pp. 139–148.
[Crossref]

Huang, P.

S. Zhang and P. Huang, “High-resolution, real-time 3D shape acquisition,” in Computer Society Conference on Computer Vision and Pattern Recognition Workshops (2004), pp. 28–38.

Huang, P. S.

P. S. Huang and S. Zhang, “Fast three-step phase-shifting algorithm,” Appl. Opt. 45(21), 5086–5091 (2006).
[Crossref] [PubMed]

P. S. Huang, C. P. Zhang, and F. P. Chiang, “High-speed 3-D shape measurement based on digital fringe projection,” Opt. Eng. 42(1), 163–168 (2003).
[Crossref]

Izadi, S.

O. Hilliges, S. Izadi, and A. D. Wilson, “Interactions in the air: adding further depth to interactive tabletops,” in Proc. of the 22nd Annual ACM Symposium on User Interface Software and Technology (2009), pp. 139–148.
[Crossref]

Kawasaki, H.

H. Kawasaki, R. Furukawa, R. Sagawa, and Y. Yagi, “Dynamic scene shape reconstruction using a single structured light pattern,” in IEEE Computer Vis. Pattern Recognition (2008), pp. 1–8.

Letessier, J.

J. Letessier and F. Berard, “Visual tracking of bare fingers for interactive surfaces,” in Proc. of the 17th Annual ACM Symposium on User Interface Software and Technology (2004), pp. 199.
[Crossref]

Li, Y.

Q. Zhou, K. Ni, Y. Lu, L. Chen, Y. Gao, L. He, H. Guo, J. Ma, Y. Li, and M. Liu, “Indirect measurement of the infrared pen point used in a short throw interactive projection system,” Proc. SPIE 7850, 78502F (2010).
[Crossref]

K. Ni, Q. Zhou, L. Chen, P. Sun, H. Xu, Y. Gao, J. Ma, Y. Li, and M. Liu, “A location system based on two-dimensional position sensitive detector used in interactive projection systems,” Proc. SPIE 7850, 78502G (2010).
[Crossref]

Liu, M.

K. Ni, Q. Zhou, L. Chen, P. Sun, H. Xu, Y. Gao, J. Ma, Y. Li, and M. Liu, “A location system based on two-dimensional position sensitive detector used in interactive projection systems,” Proc. SPIE 7850, 78502G (2010).
[Crossref]

Q. Zhou, K. Ni, Y. Lu, L. Chen, Y. Gao, L. He, H. Guo, J. Ma, Y. Li, and M. Liu, “Indirect measurement of the infrared pen point used in a short throw interactive projection system,” Proc. SPIE 7850, 78502F (2010).
[Crossref]

Lohry, W.

Lu, Y.

Q. Zhou, K. Ni, Y. Lu, L. Chen, Y. Gao, L. He, H. Guo, J. Ma, Y. Li, and M. Liu, “Indirect measurement of the infrared pen point used in a short throw interactive projection system,” Proc. SPIE 7850, 78502F (2010).
[Crossref]

Ma, J.

X. Qiao, Q. Zhou, K. Ni, L. He, G. Wu, L. Mao, X. Cheng, and J. Ma, “Real-time interactive projection system based on infrared structured-light method,” Proc. SPIE 8558, 855802 (2012).
[Crossref]

K. Ni, Q. Zhou, L. Chen, P. Sun, H. Xu, Y. Gao, J. Ma, Y. Li, and M. Liu, “A location system based on two-dimensional position sensitive detector used in interactive projection systems,” Proc. SPIE 7850, 78502G (2010).
[Crossref]

Q. Zhou, K. Ni, Y. Lu, L. Chen, Y. Gao, L. He, H. Guo, J. Ma, Y. Li, and M. Liu, “Indirect measurement of the infrared pen point used in a short throw interactive projection system,” Proc. SPIE 7850, 78502F (2010).
[Crossref]

Mao, L.

X. Qiao, Q. Zhou, K. Ni, L. He, G. Wu, L. Mao, X. Cheng, and J. Ma, “Real-time interactive projection system based on infrared structured-light method,” Proc. SPIE 8558, 855802 (2012).
[Crossref]

Negahdaripour, S.

Ni, K.

X. Qiao, Q. Zhou, K. Ni, L. He, G. Wu, L. Mao, X. Cheng, and J. Ma, “Real-time interactive projection system based on infrared structured-light method,” Proc. SPIE 8558, 855802 (2012).
[Crossref]

K. Ni, Q. Zhou, L. Chen, P. Sun, H. Xu, Y. Gao, J. Ma, Y. Li, and M. Liu, “A location system based on two-dimensional position sensitive detector used in interactive projection systems,” Proc. SPIE 7850, 78502G (2010).
[Crossref]

Q. Zhou, K. Ni, Y. Lu, L. Chen, Y. Gao, L. He, H. Guo, J. Ma, Y. Li, and M. Liu, “Indirect measurement of the infrared pen point used in a short throw interactive projection system,” Proc. SPIE 7850, 78502F (2010).
[Crossref]

Parks, R. E.

Qiao, X.

X. Qiao, Q. Zhou, K. Ni, L. He, G. Wu, L. Mao, X. Cheng, and J. Ma, “Real-time interactive projection system based on infrared structured-light method,” Proc. SPIE 8558, 855802 (2012).
[Crossref]

Rafii, A.

C. Tomasi, A. Rafii, and I. Torunoglu, “Full-size projection keyboard for handheld devices,” Commun. ACM 46(7), 70–75 (2003).
[Crossref]

Raskar, R.

P. Beardsley, J. van Baar, R. Raskar, and C. Forlines, “Interaction using a handheld projector,” IEEE Comput. Graph. Appl. 25(1), 39–43 (2005).
[Crossref] [PubMed]

Rosenfeld, D.

I. Shahram, H. Steve, T. Stuart, D. Rosenfeld, N. Villar, A. Butler, and J. Westhues, “Going beyond the display: a surface technology with an electronically switchable diffuser,” in 21st Annual ACM Symposium on User Interface Software and Technology (2008), pp. 269–278.

Sagawa, R.

H. Kawasaki, R. Furukawa, R. Sagawa, and Y. Yagi, “Dynamic scene shape reconstruction using a single structured light pattern,” in IEEE Computer Vis. Pattern Recognition (2008), pp. 1–8.

Shahram, I.

I. Shahram, H. Steve, T. Stuart, D. Rosenfeld, N. Villar, A. Butler, and J. Westhues, “Going beyond the display: a surface technology with an electronically switchable diffuser,” in 21st Annual ACM Symposium on User Interface Software and Technology (2008), pp. 269–278.

Steve, H.

I. Shahram, H. Steve, T. Stuart, D. Rosenfeld, N. Villar, A. Butler, and J. Westhues, “Going beyond the display: a surface technology with an electronically switchable diffuser,” in 21st Annual ACM Symposium on User Interface Software and Technology (2008), pp. 269–278.

Stuart, T.

I. Shahram, H. Steve, T. Stuart, D. Rosenfeld, N. Villar, A. Butler, and J. Westhues, “Going beyond the display: a surface technology with an electronically switchable diffuser,” in 21st Annual ACM Symposium on User Interface Software and Technology (2008), pp. 269–278.

Su, P.

Su, X.

Sun, P.

K. Ni, Q. Zhou, L. Chen, P. Sun, H. Xu, Y. Gao, J. Ma, Y. Li, and M. Liu, “A location system based on two-dimensional position sensitive detector used in interactive projection systems,” Proc. SPIE 7850, 78502G (2010).
[Crossref]

Takeshi, N.

K. Yasuaki and N. Takeshi, “Tablescape plus: interactive small-sized vertical displays on a horizontal tabletop display,” in 2nd Annual IEEE International Workshop on Horizontal Interactive Human-Computed Systems (2007), pp. 155–162.

Tomasi, C.

C. Tomasi, A. Rafii, and I. Torunoglu, “Full-size projection keyboard for handheld devices,” Commun. ACM 46(7), 70–75 (2003).
[Crossref]

Torunoglu, I.

C. Tomasi, A. Rafii, and I. Torunoglu, “Full-size projection keyboard for handheld devices,” Commun. ACM 46(7), 70–75 (2003).
[Crossref]

Tovi, G.

G. Tovi and W. Daniel, “Going deeper: a taxonomy of 3D on the tabletop,” in 2nd Annual IEEE International Workshop on Horizontal Interactive Human-Computed Systems (2007), pp. 137–144.

van Baar, J.

P. Beardsley, J. van Baar, R. Raskar, and C. Forlines, “Interaction using a handheld projector,” IEEE Comput. Graph. Appl. 25(1), 39–43 (2005).
[Crossref] [PubMed]

Villar, N.

I. Shahram, H. Steve, T. Stuart, D. Rosenfeld, N. Villar, A. Butler, and J. Westhues, “Going beyond the display: a surface technology with an electronically switchable diffuser,” in 21st Annual ACM Symposium on User Interface Software and Technology (2008), pp. 269–278.

Wang, L.

Wang, Y.

Westhues, J.

I. Shahram, H. Steve, T. Stuart, D. Rosenfeld, N. Villar, A. Butler, and J. Westhues, “Going beyond the display: a surface technology with an electronically switchable diffuser,” in 21st Annual ACM Symposium on User Interface Software and Technology (2008), pp. 269–278.

Willis, K. D. D.

K. D. D. Willis, “Pre-history of handheld projector-based interaction,” Pers. Ubiquitous Comput. 16(1), 5–15 (2012).
[Crossref]

Wilson, A. D.

A. D. Wilson, “Play anywhere: a compact interactive tabletop projection-vision system,” in Proc. of the 18th Annual ACM Symposium on User Interface Software and Technology (2005), pp. 83–92.

O. Hilliges, S. Izadi, and A. D. Wilson, “Interactions in the air: adding further depth to interactive tabletops,” in Proc. of the 22nd Annual ACM Symposium on User Interface Software and Technology (2009), pp. 139–148.
[Crossref]

Wu, G.

X. Qiao, Q. Zhou, K. Ni, L. He, G. Wu, L. Mao, X. Cheng, and J. Ma, “Real-time interactive projection system based on infrared structured-light method,” Proc. SPIE 8558, 855802 (2012).
[Crossref]

Xu, H.

K. Ni, Q. Zhou, L. Chen, P. Sun, H. Xu, Y. Gao, J. Ma, Y. Li, and M. Liu, “A location system based on two-dimensional position sensitive detector used in interactive projection systems,” Proc. SPIE 7850, 78502G (2010).
[Crossref]

Yagi, Y.

H. Kawasaki, R. Furukawa, R. Sagawa, and Y. Yagi, “Dynamic scene shape reconstruction using a single structured light pattern,” in IEEE Computer Vis. Pattern Recognition (2008), pp. 1–8.

Yasuaki, K.

K. Yasuaki and N. Takeshi, “Tablescape plus: interactive small-sized vertical displays on a horizontal tabletop display,” in 2nd Annual IEEE International Workshop on Horizontal Interactive Human-Computed Systems (2007), pp. 155–162.

Zhang, C. P.

P. S. Huang, C. P. Zhang, and F. P. Chiang, “High-speed 3-D shape measurement based on digital fringe projection,” Opt. Eng. 42(1), 163–168 (2003).
[Crossref]

Zhang, Q.

Zhang, S.

Zhou, Q.

X. Qiao, Q. Zhou, K. Ni, L. He, G. Wu, L. Mao, X. Cheng, and J. Ma, “Real-time interactive projection system based on infrared structured-light method,” Proc. SPIE 8558, 855802 (2012).
[Crossref]

K. Ni, Q. Zhou, L. Chen, P. Sun, H. Xu, Y. Gao, J. Ma, Y. Li, and M. Liu, “A location system based on two-dimensional position sensitive detector used in interactive projection systems,” Proc. SPIE 7850, 78502G (2010).
[Crossref]

Q. Zhou, K. Ni, Y. Lu, L. Chen, Y. Gao, L. He, H. Guo, J. Ma, Y. Li, and M. Liu, “Indirect measurement of the infrared pen point used in a short throw interactive projection system,” Proc. SPIE 7850, 78502F (2010).
[Crossref]

Appl. Opt. (4)

Commun. ACM (1)

C. Tomasi, A. Rafii, and I. Torunoglu, “Full-size projection keyboard for handheld devices,” Commun. ACM 46(7), 70–75 (2003).
[Crossref]

IEEE Comput. Graph. Appl. (1)

P. Beardsley, J. van Baar, R. Raskar, and C. Forlines, “Interaction using a handheld projector,” IEEE Comput. Graph. Appl. 25(1), 39–43 (2005).
[Crossref] [PubMed]

Opt. Eng. (1)

P. S. Huang, C. P. Zhang, and F. P. Chiang, “High-speed 3-D shape measurement based on digital fringe projection,” Opt. Eng. 42(1), 163–168 (2003).
[Crossref]

Opt. Express (2)

Opt. Lasers Eng. (1)

S. Zhang, “Recent progresses on real-time 3D shape measurement using digital fringe projection techniques,” Opt. Lasers Eng. 48(2), 149–158 (2010).
[Crossref]

Pers. Ubiquitous Comput. (1)

K. D. D. Willis, “Pre-history of handheld projector-based interaction,” Pers. Ubiquitous Comput. 16(1), 5–15 (2012).
[Crossref]

Proc. SPIE (3)

K. Ni, Q. Zhou, L. Chen, P. Sun, H. Xu, Y. Gao, J. Ma, Y. Li, and M. Liu, “A location system based on two-dimensional position sensitive detector used in interactive projection systems,” Proc. SPIE 7850, 78502G (2010).
[Crossref]

X. Qiao, Q. Zhou, K. Ni, L. He, G. Wu, L. Mao, X. Cheng, and J. Ma, “Real-time interactive projection system based on infrared structured-light method,” Proc. SPIE 8558, 855802 (2012).
[Crossref]

Q. Zhou, K. Ni, Y. Lu, L. Chen, Y. Gao, L. He, H. Guo, J. Ma, Y. Li, and M. Liu, “Indirect measurement of the infrared pen point used in a short throw interactive projection system,” Proc. SPIE 7850, 78502F (2010).
[Crossref]

Other (9)

A. D. Wilson, “Play anywhere: a compact interactive tabletop projection-vision system,” in Proc. of the 18th Annual ACM Symposium on User Interface Software and Technology (2005), pp. 83–92.

J. Letessier and F. Berard, “Visual tracking of bare fingers for interactive surfaces,” in Proc. of the 17th Annual ACM Symposium on User Interface Software and Technology (2004), pp. 199.
[Crossref]

G. Tovi and W. Daniel, “Going deeper: a taxonomy of 3D on the tabletop,” in 2nd Annual IEEE International Workshop on Horizontal Interactive Human-Computed Systems (2007), pp. 137–144.

I. Shahram, H. Steve, T. Stuart, D. Rosenfeld, N. Villar, A. Butler, and J. Westhues, “Going beyond the display: a surface technology with an electronically switchable diffuser,” in 21st Annual ACM Symposium on User Interface Software and Technology (2008), pp. 269–278.

K. Yasuaki and N. Takeshi, “Tablescape plus: interactive small-sized vertical displays on a horizontal tabletop display,” in 2nd Annual IEEE International Workshop on Horizontal Interactive Human-Computed Systems (2007), pp. 155–162.

C. R. Wren and Y. A. Ivanov, “Volumetric operations with surface margins,” in Computer Vision and Pattern Recognition: Technical Sketches (2001).

H. Kawasaki, R. Furukawa, R. Sagawa, and Y. Yagi, “Dynamic scene shape reconstruction using a single structured light pattern,” in IEEE Computer Vis. Pattern Recognition (2008), pp. 1–8.

S. Zhang and P. Huang, “High-resolution, real-time 3D shape acquisition,” in Computer Society Conference on Computer Vision and Pattern Recognition Workshops (2004), pp. 28–38.

O. Hilliges, S. Izadi, and A. D. Wilson, “Interactions in the air: adding further depth to interactive tabletops,” in Proc. of the 22nd Annual ACM Symposium on User Interface Software and Technology (2009), pp. 139–148.
[Crossref]

Cited By

OSA participates in Crossref's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (13)

Fig. 1
Fig. 1 Principle of depth detection system.

Download Full Size | PPT Slide | PDF

Fig. 2
Fig. 2 Correspondence of stripe pattern.

Download Full Size | PPT Slide | PDF

Fig. 3
Fig. 3 Method for estimating the shadow and fingertip.

Download Full Size | PPT Slide | PDF

Fig. 4
Fig. 4 Five different heights at a point in simulation.

Download Full Size | PPT Slide | PDF

Fig. 5
Fig. 5 Selected nine measurement points on the screen.

Download Full Size | PPT Slide | PDF

Fig. 6
Fig. 6 Heights measured at the nine points.

Download Full Size | PPT Slide | PDF

Fig. 7
Fig. 7 Experimental platform.

Download Full Size | PPT Slide | PDF

Fig. 8
Fig. 8 Design sketch of interaction using paper rod.

Download Full Size | PPT Slide | PDF

Fig. 9
Fig. 9 32 points to be measured.

Download Full Size | PPT Slide | PDF

Fig. 10
Fig. 10 Depth information at 32 points.

Download Full Size | PPT Slide | PDF

Fig. 11
Fig. 11 Depth information at 600 random points.

Download Full Size | PPT Slide | PDF

Fig. 12
Fig. 12 Depth detection during writing by hand.

Download Full Size | PPT Slide | PDF

Fig. 13
Fig. 13 Error at a height of 22 mm.

Download Full Size | PPT Slide | PDF

Equations (5)

Equations on this page are rendered with MathJax. Learn more.

h D = L×Dcs Dcp+L
h D = lpp×m×Dcs Dcp+lpp×m
I=C(i+1)−C(i)≤w
s i (x,y)= b 1 i (x,y)+b 2 i (x,y)+u 1 i+1 (x,y)+u 2 i+1 (x,y) 4
Δh= lpp×Dcs×Δm Dcp+( 2m+Δm )+ m×(m+Δm)×lp p 2 Dcp

Metrics