Abstract

Different from conventional microimaging techniques, polarization imaging can generate multiple polarization images in a single perspective by changing the polarization angle. However, how to efficiently fuse the information in these multiple polarization images by a convolutional neural network (CNN) is still a challenging problem. In this paper, we propose a hybrid 3D–2D convolutional neural network called MuellerNet, to classify biological cells with Mueller matrix images (MMIs). The MuellerNet includes a normal stream and a polarimetric stream, in which the first Mueller matrix image is taken as the input of normal stream, and the rest MMIs are stacked to form the input of a polarimetric stream. The normal stream is mainly constructed with a backbone network and, in the polarimetric stream, the attention mechanism is used to adaptively assign weights to different convolutional maps. To improve the network’s discrimination, a loss function is introduced to simultaneously optimize parameters of the two streams. Two Mueller matrix image datasets are built, which include four types of breast cancer cells and three types of algal cells, respectively. Experiments are conducted on these two datasets with many well-known and recent networks. Results show that the proposed network efficiently improves the classification accuracy and helps to find discriminative features in MMIs.

© 2021 Optical Society of America

Classification of morphologically similar algae and cyanobacteria using Mueller matrix imaging and convolutional neural networks

Xianpeng Li, Ran Liao, Jialing Zhou, Priscilla T. Y. Leung, Meng Yan, and Hui Ma
Appl. Opt. 56(23) 6520-6530 (2017)

Polarimetric learning: a Siamese approach to learning distance metrics of algal Mueller matrix images

Xianpeng Li, Ran Liao, Hui Ma, Priscilla T. Y. Leung, and Meng Yan
Appl. Opt. 57(14) 3829-3837 (2018)

Classification of marine microalgae using low-resolution Mueller matrix images and convolutional neural network

Zhidi Liu, Ran Liao, Hui Ma, Jiajin Li, Priscilla T. Y. Leung, Meng Yan, and Jiarui Gu
Appl. Opt. 59(31) 9698-9709 (2020)

Learning feature fusion for target detection based on polarimetric imaging

Sihao Gao, Yu Cao, Wenjing Zhang, Qian Dai, Jun Li, and Xiaojun Xu
Appl. Opt. 61(7) D15-D21 (2022)

Demonstration of a terahertz multi-spectral 3×3 Mueller matrix polarimetry system for 2D and 3D imaging

Shao-Xin Huang, Geng-Bo Wu, Ka-Fai Chan, Bao-Jie Chen, Ming-Yao Xia, Thomas Fromenteze, Cyril Decroze, and Chi Hou Chan
Opt. Express 29(10) 14853-14867 (2021)