Abstract

The advent of inexpensive smartphones/tablets/phablets equipped with cameras has resulted in the average person capturing cherished moments as images/videos and sharing them on the internet. However, at several locations, an amateur photographer may be frustrated with the captured images. For example, the object of interest to the photographer might be occluded or fenced. Currently available image de-fencing methods in the literature are limited by non-robust fence detection and can handle only static occluded scenes whose video is captured by constrained camera motion. In this work, we propose an algorithm to obtain a de-fenced image using a few frames from a video of the occluded static or dynamic scene. We also present a new fenced image database captured under challenging scenarios such as clutter, poor lighting, viewpoint distortion, etc. Initially, we propose a supervised learning-based approach to detect fence pixels and validate its performance with qualitative as well as quantitative results. We rely on the idea that freehand panning of the fenced scene is likely to render visible hidden pixels of the reference frame in other frames of the captured video. Our approach necessitates the solution of three problems: (i) detection of spatial locations of fences/occlusions in the frames of the video, (ii) estimation of relative motion between the observations, and (iii) data fusion to fill in occluded pixels in the reference image. We assume the de-fenced image as a Markov random field and obtain its maximum a posteriori estimate by solving the corresponding inverse problem. Several experiments on synthetic and real-world data demonstrate the effectiveness of the proposed approach.

© 2016 Optical Society of America

Full Article  |  PDF Article
OSA Recommended Articles
Super-resolution image de-fencing using a nonlocal nonconvex prior

Sankaraganesh Jonna, Sukla Satapathy, and Rajiv R. Sahay
Appl. Opt. 57(2) 322-333 (2018)

Joint image and depth completion in shape-from-focus: Taking a cue from parallax

Rajiv R. Sahay and A. N. Rajagopalan
J. Opt. Soc. Am. A 27(5) 1203-1213 (2010)

Three-dimensional profilometric reconstruction using flexible sensing integral imaging and occlusion removal

Xin Shen, Adam Markman, and Bahram Javidi
Appl. Opt. 56(9) D151-D157 (2017)

References

You do not have subscription access to this journal. Citation lists with outbound citation links are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access OSA Member Subscription

Supplementary Material (8)

NameDescription
» Visualization 1: MOV (7855 KB)      Video corresponding to Fig. 1.
» Visualization 2: MP4 (500 KB)      Video corresponding to Fig. 11.
» Visualization 3: MOV (5101 KB)      Video corresponding to Figs. 12(a) and 12(e).
» Visualization 4: MP4 (13036 KB)      Video corresponding to Figs. 12(b) and 12(f).
» Visualization 5: MP4 (30481 KB)      Video corresponding to Figs. 12(c) and 12(g).
» Visualization 6: MP4 (12917 KB)      Video corresponding to Figs. 12(d) and 12(h).
» Visualization 7: MP4 (5821 KB)      Video corresponding to Fig. 13.
» Visualization 8: MP4 (18535 KB)      Video corresponding to Fig. 17.

Cited By

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access OSA Member Subscription

Figures (17)

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access OSA Member Subscription

Tables (3)

You do not have subscription access to this journal. Article tables are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access OSA Member Subscription

Equations (12)

You do not have subscription access to this journal. Equations are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access OSA Member Subscription

Metrics

You do not have subscription access to this journal. Article level metrics are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access OSA Member Subscription