Abstract

An augmented reality (AR) smartglass display combines real-world scenes with digital information enabling the rapid growth of AR-based applications. We present an augmented reality-based approach for three-dimensional (3D) optical visualization and object recognition using axially distributed sensing (ADS). For object recognition, the 3D scene is reconstructed, and feature extraction is performed by calculating the histogram of oriented gradients (HOG) of a sliding window. A support vector machine (SVM) is then used for classification. Once an object has been identified, the 3D reconstructed scene with the detected object is optically displayed in the smartglasses allowing the user to see the object, remove partial occlusions of the object, and provide critical information about the object such as 3D coordinates, which are not possible with conventional AR devices. To the best of our knowledge, this is the first report on combining axially distributed sensing with 3D object visualization and recognition for applications to augmented reality. The proposed approach can have benefits for many applications, including medical, military, transportation, and manufacturing.

© 2016 Optical Society of America

Augmented reality three-dimensional visualization with multifocus sensing

Julia R. Alonso, Ariel Fernández, and Bahram Javidi
Opt. Continuum 1(2) 355-365 (2022)

Three-dimensional imaging and visualization of partially occluded objects using axially distributed stereo image sensing

Donghak Shin and Bahram Javidi
Opt. Lett. 37(9) 1394-1396 (2012)

Augmented reality three-dimensional display with light field fusion

Songlin Xie, Peng Wang, Xinzhu Sang, and Chengyu Li
Opt. Express 24(11) 11483-11494 (2016)

Three-dimensional imaging and visualization using off-axially distributed image sensing

Yongri Piao, Miao Zhang, Donghak Shin, and Hoon Yoo
Opt. Lett. 38(16) 3162-3164 (2013)

Three-dimensional object visualization and detection in low light illumination using integral imaging

Adam Markman, Xin Shen, and Bahram Javidi
Opt. Lett. 42(16) 3068-3071 (2017)