Abstract

Since distortions in camera-captured document images significantly affect the accuracy of optical character recognition (OCR), distortion removal plays a critical role for document digitalization systems using a camera for image capturing. This paper proposes a novel framework that performs three-dimensional (3D) reconstruction and rectification of camera-captured document images. While most existing methods rely on additional calibrated hardware or multiple images to recover the 3D shape of a document page, or make a simple but not always valid assumption on the corresponding 3D shape, our framework is more flexible and practical since it only requires a single input image and is able to handle a general locally smooth document surface. The main contributions of this paper include a new iterative refinement scheme for baseline fitting from connected components of text line, an efficient discrete vertical text direction estimation algorithm based on convex hull projection profile analysis, and a 2D distortion grid construction method based on text direction function estimation using 3D regularization. In order to examine the performance of our proposed method, both qualitative and quantitative evaluation and comparison with several recent methods are conducted in our experiments. The experimental results demonstrate that the proposed method outperforms relevant approaches for camera-captured document image rectification, in terms of improvements on both visual distortion removal and OCR accuracy.

© 2016 Optical Society of America

Image rectification for stereoscopic visualization

Jin Zhou and Baoxin Li
J. Opt. Soc. Am. A 25(11) 2721-2733 (2008)

Multiview three-dimensional imaging using a Risley-prism-based spatially adaptive virtual camera field

Xingsheng Liu and Anhu Li
Appl. Opt. 61(13) 3619-3629 (2022)

Deep end-to-end rolling shutter rectification

Praveen Kandula, T. Lokesh Kumar, and A. N. Rajagopalan
J. Opt. Soc. Am. A 37(10) 1574-1582 (2020)

Optimized stereo reconstruction of free-form space curves based on a nonuniform rational B-spline model

Yi Jun Xiao and Y. F. Li
J. Opt. Soc. Am. A 22(9) 1746-1762 (2005)

Three-dimensional reconstruction of mobile binocular stereo vision based on push-broom line structured light for a workpiece surface

Yue Wang, Xueyou Han, Jing Rui, Hailan Zhang, Lei Yin, Xuefeng Zhang, and Xiangjun Wang
J. Opt. Soc. Am. A 40(11) 2096-2107 (2023)