Abstract

In the dairy farming industry, we can obtain the temperature, color, and location information of dairy cows by patrol inspection robot so as to monitor the health status and abnormal behaviors of dairy cows. We build and calibrate a heterogeneous binocular stereo vision (HBSV) system comprising a high-definition color camera and infrared thermal camera and mount it on a patrol inspection robot. First, based on the traditional chessboard, an easy-to-make calibration board for the HBSV system is designed. Second, an accurate locating and sorting algorithm for the calibration points of the calibration board is designed. Then, the cameras are calibrated and the HBSV system is stereo-calibrated. Finally, target locating is achieved based on the above calibration results and Yolo target detection technology. In this paper, several experiments are carried out from many aspects. The target locating average error of HBSV system is 3.11%, which satisfies the needs of the dairy farming environment. The video’s FPS captured by using HBSV is 7.3, which is 78% higher than that by using binocular stereo vision system and infrared thermal camera. The results show that the HBSV system has application value to a certain degree.

© 2021 Optical Society of America

Calibration method for structure parameters of a binocular stereo vision system equipped with polarizers

Zimiao Zhang, Kai Xu, Fumin Zhang, Shihai Zhang, and Yahui Nie
J. Opt. Soc. Am. A 39(4) 523-534 (2022)

Binocular vision calibration method for a long-wavelength infrared camera and a visible spectrum camera with different resolutions

Li Xicai, Wu Qinqin, and Wang Yuanqing
Opt. Express 29(3) 3855-3872 (2021)

Accurate stereo vision system calibration with chromatic concentric fringe patterns

Shiyong An, Hongyu Yang, Pei Zhou, Wenfan Xiao, Jiangping Zhu, and Yanqiong Guo
Appl. Opt. 60(35) 10954-10963 (2021)

Extrinsic parameter calibration of stereo vision sensors using spot laser projector

Zhen Liu, Yang Yin, Shaopeng Liu, and Xu Chen
Appl. Opt. 55(25) 7098-7105 (2016)

Research on calibration of a binocular stereo-vision imaging system based on the artificial neural network

FangFang Han, YongXin Bian, Bin Liu, Qi Zeng, and YiFan Tian
J. Opt. Soc. Am. A 40(2) 337-354 (2023)