Abstract

We proposed a novel cryptographic imaging scheme that is the combination of optical encryption and computational decryption. To prevent personal privacy from being spied upon amid the imaging formation process, in this study we applied a coded mask to optically encrypt the scene and utilized the deep neural network for computational decryption. For encryption, the sensor recorded a new representation of the original signal, not being distinguishable by humans on purpose. For decryption, we successfully reconstructed the image with the mean squared error equal to 0.028, and 100% for the classification through the Japanese Female Facial Expression dataset. By means of the feature visualization, we found that the coded mask served as a linear operator to synthesize the spatial fidelity of the original scene, but kept the features for the post-recognition process. We believe the proposed framework can inspire more possibilities for the unconventional imaging system.

© 2021 Optical Society of America

Lensless facial recognition with encrypted optics and a neural network computation

Ming-Hsuan Wu, Ya-Ti Chang Lee, and Chung-Hao Tien
Appl. Opt. 61(26) 7595-7601 (2022)

Needle-based deep-neural-network camera

Ruipeng Guo, Soren Nelson, and Rajesh Menon
Appl. Opt. 60(10) B135-B140 (2021)

Semantic representation learning for a mask-modulated lensless camera by contrastive cross-modal transferring

Ya-Ti Chang Lee and Chung-Hao Tien
Appl. Opt. 63(8) C24-C31 (2024)

Single-pixel imaging for edge images using deep neural networks

Ikuo Hoshi, Masaki Takehana, Tomoyoshi Shimobaba, Takashi Kakue, and Tomoyoshi Ito
Appl. Opt. 61(26) 7793-7797 (2022)

FEDResNet: a flexible image encryption and decryption scheme based on end-to-end image diffusion with dilated ResNet

Leqing Zhu, Weiwei Qu, Xingyang Wen, and Chunxiang Zhu
Appl. Opt. 61(31) 9124-9134 (2022)