Abstract

Today’s smartphones/phablets/tablets are equipped with cameras that have enabled people to capture their favorite moments. However, images or videos taken at public places using inexpensive low-resolution cameras are often degraded by the presence of occlusions such as fences/barricades. In order to reconstruct a fence-free high-resolution image, we use a video of a scene captured by panning a hand-held camera and model the effects of various degradations. Initially, we obtain the spatial locations of fences by semantic segmentation and subsequently estimate the subpixel motion between the degraded low-resolution frames. The unknown high-resolution de-fenced image is modeled as a nonlocal discontinuity-adaptive Markov random field (NL-DAMRF) and its maximum a posteriori estimate is obtained by minimizing an appropriate objective function. We propose a nonlocal extension of DAMRF prior to preserve high-frequency information in the reconstruction process. Specifically, we use the graduated nonconvexity algorithm to minimize the proposed nonconvex energy function. Experiments with both synthetic and real-world data demonstrate the efficacy of the proposed algorithm.

© 2018 Optical Society of America

Detection and removal of fence occlusions in an image using a video of the static/dynamic scene

Sankaraganesh Jonna, Krishna K. Nakka, Vrushali S. Khasare, Rajiv R. Sahay, and Mohan S. Kankanhalli
J. Opt. Soc. Am. A 33(10) 1917-1930 (2016)

Simultaneous digital super-resolution and nonuniformity correction for infrared imaging systems

Pablo Meza, Guillermo Machuca, Sergio Torres, Cesar San Martin, and Esteban Vera
Appl. Opt. 54(21) 6508-6515 (2015)

Fast super-resolution using an adaptive Wiener filter with robustness to local motion

Russell C. Hardie and Kenneth J. Barnard
Opt. Express 20(19) 21053-21073 (2012)

Unified multiframe super-resolution of matte, foreground, and background

Sahana M. Prabhu and A. N. Rajagopalan
J. Opt. Soc. Am. A 30(8) 1524-1534 (2013)

Bidirectional texture function image super-resolution using singular value decomposition

Wei Dong, Hui-Liang Shen, Zhi-Wei Pan, and John H. Xin
Appl. Opt. 56(10) 2745-2753 (2017)