Abstract

Fluorescence microscopy technology uses fluorescent dyes to provide highly specific visualization of cell components, which plays an important role in understanding the subcellular structure. However, fluorescence microscopy has some limitations such as the risk of non-specific cross labeling in multi-labeled fluorescent staining and limited number of fluorescence labels due to spectral overlap. This paper proposes a deep learning-based fluorescence to fluorescence (Fluo-Fluo) translation method, which uses a conditional generative adversarial network to predict a fluorescence image from another fluorescence image and further realizes the multi-label fluorescent staining. The cell types used include human motor neurons, human breast cancer cells, rat cortical neurons, and rat cardiomyocytes. The effectiveness of the method is verified by successfully generating virtual fluorescence images highly similar to the true fluorescence images. This study shows that a deep neural network can implement Fluo-Fluo translation and describe the localization relationship between subcellular structures labeled with different fluorescent markers. The proposed Fluo-Fluo method can avoid non-specific cross labeling in multi-label fluorescence staining and is free from spectral overlaps. In theory, an unlimited number of fluorescence images can be predicted from a single fluorescence image to characterize cells.

© 2022 Chinese Laser Press

Deep learning 2D and 3D optical sectioning microscopy using cross-modality Pix2Pix cGAN image translation

Huimin Zhuge, Brian Summa, Jihun Hamm, and J. Quincy Brown
Biomed. Opt. Express 12(12) 7526-7543 (2021)

High-throughput, high-resolution deep learning microscopy based on registration-free generative adversarial network

Hao Zhang, Chunyu Fang, Xinlin Xie, Yicong Yang, Wei Mei, Di Jin, and Peng Fei
Biomed. Opt. Express 10(3) 1044-1063 (2019)

Virtual labeling of mitochondria in living cells using correlative imaging and physics-guided deep learning

Ayush Somani, Arif Ahmed Sekh, Ida S. Opstad, Åsa Birna Birgisdottir, Truls Myrmel, Balpreet Singh Ahluwalia, Alexander Horsch, Krishna Agarwal, and Dilip K. Prasad
Biomed. Opt. Express 13(10) 5495-5516 (2022)

Computational tissue staining of non-linear multimodal imaging using supervised and unsupervised deep learning

Pranita Pradhan, Tobias Meyer, Michael Vieth, Andreas Stallmach, Maximilian Waldner, Michael Schmitt, Juergen Popp, and Thomas Bocklitz
Biomed. Opt. Express 12(4) 2280-2298 (2021)

Deep-learning-based whole-brain imaging at single-neuron resolution

Kefu Ning, Xiaoyu Zhang, Xuefei Gao, Tao Jiang, He Wang, Siqi Chen, Anan Li, and Jing Yuan
Biomed. Opt. Express 11(7) 3567-3584 (2020)