Abstract

Nowadays, touch screens are widely used in many commercial devices. In this paper, we present an inexpensive webcam-based touch screen system based on a simple and generic finger detection technique. Only a single webcam and a regular screen are used to achieve this goal. By using the scene geometry and the camera model, we can determine the position of the finger on the screen. The technique we propose is simple and works well under various surrounding environments while the detecting method suits many finger colors and shapes. Our approach can also be used for realtime applications. Experimental results and practical applications are provided to ascertain the proposed method.

© 2014 IEEE

PDF Article

References

  • View by:
  • |
  • |

  1. M. P. Hoang, T. D. Nguyen, T. M. Hoang, "Implementation of webcam-based touchscreen," 2010 3rd Int. Conf. on Commun. Electron. (ICCE) (2010) pp. 201-206.
  2. K. T. R. Phares, Resistive touchscreen having multiple selectable regions for pressure discrimination U.S. Patent 5 815 141 (1998).
  3. D. O. Robert, G. Kable, C. O. Philip, A. Schlosser, Electrographic apparatus U.S. Patent 4 665 283 (1987).
  4. L. Xu, Infrared touch screen U.S. Patent Appl. 2011/0115748 A1 (2011).
  5. K. Cheng, M. Takatsuka, "Initial evaluation of a bare-hand interaction technique for large displays using a webcam," Proc. 1st ACM SIGCHI Symp. on Eng. Interactive Computing Syst. (2009) pp. 291-296.
  6. Z. Zhang, Y. Shan, "Visual screen: Transforming an ordinary screen into a touch screen," Proc. IAPR Workshop on Mach. Vision Appl. (2000) pp. 215-218.
  7. Y. Zhou, G. Morrison, "A real-time algorithm for finger detection in a camera based finger-friendly interactive board system," 5th Int. Conf. on Computer Vision Syst. (2007) pp. 21-24.
  8. X. Wang, X. Zhang, G. Dai, "Tracking of deformable human hand in real time as continuous input for gesture-based interaction," Proc. 12th Int.. Conf. on Intelligent User Interfaces (IUI '07) (2007) pp. 235-242.
  9. S. K. Kang, M. Y. Nam, P. K. Rhee, "Color based hand and finger detection technology for user interaction," 2008. Int.. Conf. on Convergence and Hybrid Inform. Technol. (ICHIT '08) (2008) pp. 229-236.
  10. D. Lee, Y. Park, "Vision-based remote control system by motion detection and open finger counting," IEEE Trans. Consumer Electron. 55, 2308-2313 (2009).
  11. L.-G. Zhang, Y. Chen, G. Fang, X. Chen, W. Gao, "A vision-based sign language recognition system using tied-mixture density hmm," Proc. 6th Int.. Conf. on Multimodal Interfaces (ICMI '04) (2004) pp. 198-204.
  12. A. Anagnostopoulos, A. Pnevmatikakis, "A realtime mixed reality system for seamless interaction between real and virtual objects," Proc. 3rd Int.. Conf. on Digital Interactive Media in Entertainment and Arts (DIMEA '08) (2008) pp. 199-204.
  13. L.-W. Chan, Y.-F. Chuang, M.-C. Yu, Y.-L. Chao, M.-S. Lee, Y.-P. Hung, J. Hsu, "Gesture-based interaction for a magic crystal ball," Proc. 2007 ACM Symp. on Virtual Reality Software and Technol. (VRST '07) (2007) pp. 157-164.
  14. D. O. Gorodnichy, A. Yogeswaran, "Detection and tracking of pianist hands and fingers," Proc. 3rd Can. Conf. Computer and Robot Vision (2006).
  15. R. Anchini, C. Liguori, V. Paciello, A. Paolillo, "A comparison between stereo-vision techniques for the reconstruction of 3-D coordinates of objects," IEEE Trans. Instrum. Meas. 55, 1459-1466 (2006).
  16. C.-H. Su, H.-S. Chiu, T.-M. Hsieh, "An efficient image retrieval based on HSV color space," 2011 Int.. Conf. on Elect. Control Eng. (ICECE) (2011) pp. 5746-5749.
  17. Lifecam HD5001 (2013) http://www.microsoft.com/hardware/en-us/p/lifecam-hd-5001/GNF-00001.
  18. OpenCV (2013) http://opencv.willowgarage.com/wiki.
  19. Vitruvian Man (2013) http://en.wikipedia.org/wiki/Vitruvian_Man.

2009 (1)

D. Lee, Y. Park, "Vision-based remote control system by motion detection and open finger counting," IEEE Trans. Consumer Electron. 55, 2308-2313 (2009).

2006 (1)

R. Anchini, C. Liguori, V. Paciello, A. Paolillo, "A comparison between stereo-vision techniques for the reconstruction of 3-D coordinates of objects," IEEE Trans. Instrum. Meas. 55, 1459-1466 (2006).

IEEE Trans. Consumer Electron. (1)

D. Lee, Y. Park, "Vision-based remote control system by motion detection and open finger counting," IEEE Trans. Consumer Electron. 55, 2308-2313 (2009).

IEEE Trans. Instrum. Meas. (1)

R. Anchini, C. Liguori, V. Paciello, A. Paolillo, "A comparison between stereo-vision techniques for the reconstruction of 3-D coordinates of objects," IEEE Trans. Instrum. Meas. 55, 1459-1466 (2006).

Other (17)

C.-H. Su, H.-S. Chiu, T.-M. Hsieh, "An efficient image retrieval based on HSV color space," 2011 Int.. Conf. on Elect. Control Eng. (ICECE) (2011) pp. 5746-5749.

Lifecam HD5001 (2013) http://www.microsoft.com/hardware/en-us/p/lifecam-hd-5001/GNF-00001.

OpenCV (2013) http://opencv.willowgarage.com/wiki.

Vitruvian Man (2013) http://en.wikipedia.org/wiki/Vitruvian_Man.

L.-G. Zhang, Y. Chen, G. Fang, X. Chen, W. Gao, "A vision-based sign language recognition system using tied-mixture density hmm," Proc. 6th Int.. Conf. on Multimodal Interfaces (ICMI '04) (2004) pp. 198-204.

A. Anagnostopoulos, A. Pnevmatikakis, "A realtime mixed reality system for seamless interaction between real and virtual objects," Proc. 3rd Int.. Conf. on Digital Interactive Media in Entertainment and Arts (DIMEA '08) (2008) pp. 199-204.

L.-W. Chan, Y.-F. Chuang, M.-C. Yu, Y.-L. Chao, M.-S. Lee, Y.-P. Hung, J. Hsu, "Gesture-based interaction for a magic crystal ball," Proc. 2007 ACM Symp. on Virtual Reality Software and Technol. (VRST '07) (2007) pp. 157-164.

D. O. Gorodnichy, A. Yogeswaran, "Detection and tracking of pianist hands and fingers," Proc. 3rd Can. Conf. Computer and Robot Vision (2006).

M. P. Hoang, T. D. Nguyen, T. M. Hoang, "Implementation of webcam-based touchscreen," 2010 3rd Int. Conf. on Commun. Electron. (ICCE) (2010) pp. 201-206.

K. T. R. Phares, Resistive touchscreen having multiple selectable regions for pressure discrimination U.S. Patent 5 815 141 (1998).

D. O. Robert, G. Kable, C. O. Philip, A. Schlosser, Electrographic apparatus U.S. Patent 4 665 283 (1987).

L. Xu, Infrared touch screen U.S. Patent Appl. 2011/0115748 A1 (2011).

K. Cheng, M. Takatsuka, "Initial evaluation of a bare-hand interaction technique for large displays using a webcam," Proc. 1st ACM SIGCHI Symp. on Eng. Interactive Computing Syst. (2009) pp. 291-296.

Z. Zhang, Y. Shan, "Visual screen: Transforming an ordinary screen into a touch screen," Proc. IAPR Workshop on Mach. Vision Appl. (2000) pp. 215-218.

Y. Zhou, G. Morrison, "A real-time algorithm for finger detection in a camera based finger-friendly interactive board system," 5th Int. Conf. on Computer Vision Syst. (2007) pp. 21-24.

X. Wang, X. Zhang, G. Dai, "Tracking of deformable human hand in real time as continuous input for gesture-based interaction," Proc. 12th Int.. Conf. on Intelligent User Interfaces (IUI '07) (2007) pp. 235-242.

S. K. Kang, M. Y. Nam, P. K. Rhee, "Color based hand and finger detection technology for user interaction," 2008. Int.. Conf. on Convergence and Hybrid Inform. Technol. (ICHIT '08) (2008) pp. 229-236.

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.