Abstract
Metasurfaces are promising platforms for integrated compact optical systems. Traditional metasurface holography design algorithms are limited to information capacity due to finite spatial bandwidth production, which is insufficient for the growing demand for big data storage and encryption. Here, we propose and demonstrate deep learning empowered ultra-dense complex-amplitude holography using step-moving cascaded metasurfaces. Using deep learning artificial intelligence optimization strategy, the barriers of traditional algorithms can be conquered to meet diverse practical requirements. Two metasurfaces are cascaded to form the desired holography. One of them can move to switch the reconstruction images due to diffraction propagation accumulated during the cascaded path. The diffraction pattern from the first metasurface propagates at a different distance and meets with the second metasurface, reconstructing the target holographic reconstructions in the far-field. Such a technique can provide a new solution for multi-dimensional beam shaping, optical encryption, camouflage, integrated on-chip ultra-high-density storage, etc.
© 2022 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
1. Introduction
As a generic ultra-thin flat optics component, metasurface has attracted great enthusiasm due to its powerful multi-dimensional optical manipulation capabilities [1–9]. Due to the design freedom of meta-structure, the fundamental properties of light, such as amplitude, phase, polarization, wavelength, and spin/orbital angular momentum, can be independently or simultaneously modulated [10–15]. As an outstanding representative of optical information processing, metasurface holography demonstrates multi-dimensional conspicuous information-carrying and encrypting capacity. Braiding metasurfaces and computer-generated hologram algorithms can achieve vectorial holography, colourful holography, stereo holography, and dynamic holography [16–23]. Metasurface holography provides higher spatial bandwidth products, a larger diffraction angle, and integration capabilities compared to traditional optical elements.
Deep learning is an inevitable topic in the big data and artificial intelligence era because of its robust feature learning and systemic optimization capabilities [24,25]. As implemented in the computational optics field, deep learning neural networks mainly include two types, that is, data-driven and physics-driven neural networks, respectively [26–30]. The former one is mainly to build a training neural network model with a large amount of raw data for training, convergence, and generalization. This situation mainly shows the ability to learn the characteristics from the stereotype data or models [31–34]. While the latter one can be achieved by inserting a series of analytical physical/mathematical models. Such a physics-driven neural network is more suitable for known theoretical models because it has a faster convergence speed and low computational cost without collecting massive prior data. Therefore, it has excellent computational imaging and optical diffraction performance, especially in real-time computing and ultra-high information density application scenarios. Thereafter, with the help of deep learning neural network, the design limitations of few-layer metasurface holography can be eliminated to some extent, and the functionalities can be further improved [35–40].
Here we propose and demonstrate a cascaded metasurface holography strategy for multiple images reconstruction using a physical-driven neural network. And the cascaded metasurfaces consist of two complex amplitude profiles, where the second piece is a moving component along the forward propagation path. In detail, the first metasurface produces a diffractive pattern that accumulates different angular spectrum along the propagation path. The region of interest (ROI) within the diffractive pattern can generate enough differences by tuning the distance and meet the second decrypted metasurface, and then a completely different holographic image can be reconstructed in the far-field. Meanwhile, we built a physics-driven neural network model to inverse design the two cascaded complex amplitude distributions. On the other hand, the supercell in each layer for possessing complex-amplitude modulation is composed of 2 × 2 anisotropic nanofins based on the Pancharatnam−Berry (PB) phase principle. Hence the encoding of each metasurface can be achieved by using the data from a neural network. In this way, the information density and the flexibility of holographic display can be strikingly improved compared to traditional computer holographic technologies. And the information security and privacy can be guaranteed. In addition, the cascaded metasurface holography with one moving piece of metasurface may open new frontiers for optical encryption, data storage, dynamic display, and other applications.
2. Methods and results
In the following, we demonstrate the strategy of cascaded metasurface holography based on a physical-driven neural network illustrated in Fig. 1. By constructing an optical diffraction neural network model, the plane wave modulates by the front metasurface A (MA) and hits the second metasurface B (MB) after diffractive propagation within a separation distance. One cannot observe any useful information when illuminating the circularly polarization light upon the former MA. While another new piece of MB is cascaded on a forward diffractive path at 1 mm distance, the Table Tennis image is reconstructed in the far-field. When MB moves forward along the propagation axis with known step size, Athletics, Equestrian, Gymnastics Artistic, Taekwondo, Hockey images will appear in sequence, and even more images will be reconstructed moving MB forward further. By using the data generated from the neural network model, the cascaded metasurfaces can be inversely designed. Each supercell is composed of 2 × 2 nanofins to form the complex amplitude modulation. The structural dimensions of the four nanofins structures are the same, but their orientation angles are different. That is, we have found a set of holographic solutions in which two-phase profiles from both metasurfaces are cascaded through Fresnel diffraction propagation to form meaningful holographic reconfiguration.
Based on the above strategy, we construct a neural network with movable distances, as shown in Fig. 2. The separated distances (D1, D2, D3…) between physical diffractive layer 1 (PDL1) and layer 2 (PDL2) are set as input parameters. The connection between both layers is constructed by the angular spectrum diffraction theory. The propagation of light satisfies the condition of a linear space-invariant system, which can be expressed as follows:
Then, we constructed the loss function (mean square error, MSE) of the network which connects the output and the ground truth ($G({x,y} )$):
The Adam (Tensorflow 2.0) is chosen as the optimizer. The learning rate is set as 0.0001. The complex-amplitude matrix is 100 × 100. After a finite number of iterative neural network training, the neural network converged. The complex-amplitude distribution of PDL1 and PDL2 can be output. To build a complex-amplitude metasurface array, a supercell as complex amplitude pixel is designed as prototype with 2 × 2 nanofins. And the supercell is transformed into nanofins’ rotation angles according to an inverse dual-pole model solution. The output complex-response of the supercell comes from averaging the complex amplitude of single nanofin in the supercell. The complex amplitude of supercell can be expressed as follows:
where, θ1 and θ2 represent the azimuth angle of the diagonal (N1) and anti-diagonal (N2) orientation of the corresponding nanofin, respectively. σ means the helicity of the incident beam, which is defined as ±1, respectively. Finally, one can encode the azimuth matrix according to Eq. (5) to form the complex amplitude distributions of both layers accordingly.To build the complex-amplitude metasurface, silicon nanofin is the selected as nano-antenna material, shown in Fig. 3(a). We used particle swarm optimization (PSO) to optimize an anisotropic nanofin using the finite differential time difference (FDTD) method. The lattice constant is fixed at 340nm, and the height is 500nm. The length and width of each nanofin are 260nm and 120nm, respectively. The broadband transmission curve of single nanofin is verified using rigorous coupled wave analysis method, shown in Fig. 3(b). The orthogonal handedness polarization conversion efficiency at broadband 720–1050nm exceeds 80%. According to Eq. (5), the theoretical and FDTD calculated intensity distribution are obtained and shown in Fig. 3(c–d). Those are not related to incident wavelength due to the dispersionless property of the PB phase. Therefore, we choose the incident wavelength of 845nm to verify the transmitted light field distribution of nanofin with the FDTD method. The simulated amplitude and phase distribution are demonstrated in Fig. 3(e–f). Comparing the FDTD simulation results and theoretical results, the distribution of amplitude and phase are almost the same.
Further, we verified the cascaded metasurface holography using FDTD simulations in Fig. 4. Six propagation distances are set as discrete controllable parameters. Correspondingly, six different holographic images resulting from such a cascaded system can be reconstructed in the far-field. The distance between the two metasurfaces ranges from 1mm to 1.5mm, with a separation of 0.1mm. After 12000 epoch training, the loss function reaches the threshold of convergence. The complex amplitude and rotation profile distribution of the two-layer metasurface is calculated as shown in Fig. 4(a–b). We have obtained six holographic reconstruction images in the far-field using our physics driven neural network: the digits and letters ‘6’, ‘8’, ‘B’, ‘X’, ‘E’, ‘S’ in Fig. 4(c). Even though there is some noise between those images, the whole set is still recognizable with satisfactory qualities.
In order to quantitatively evaluate the image quality of holographic reconstruction, we establish evaluation functions. The mean square error (MSE) and the peak signal-to-noise ratios (PSNR) are expressed:
In fact, our proposed method enables more holographic storage with limited cascaded metasurface size with varying distances. After 20,000 iterations of training, we obtained a holographic reconstruction image that changed 26 distances, as shown in Fig. 5. The complex amplitude distribution of the neural network output cascaded system is shown in Fig. 5(a–b). We achieve the reconstruction of 26 images shown in Fig. 5(c). The distance between the two layers of metasurfaces ranges from 1mm to 2.25mm, with a step of 0.05mm. The simulated wavelength is 845nm. The pixel size is 0.68µm. We still get holographic reconstructions with recognizable features. Moreover, in the case of this configuration, there is still expanded room for improvement in the holographic information capacity. We select two kinds of different patterns, the digits, and capital letters. In the case of 26 hologram capacity, both their PSNR and structural similarity remain relatively uniform levels. Their mean normalized MSE and PSNR are 0.017, 18.15dB, respectively. For the pattern of digits and letters, the structural similarity (SSIM) of the holographic reconstruction images are high. The method for calculating SSIM is:
3. Summary
In summary, we propose and demonstrate a holographic encryption strategy using a moving cascaded complex-amplitude metasurface. We construct a physical-driven neural network to inverse design the cascaded holographic system with a precise and easier reliable method. Compared with the traditional computer-generated holograms, the holographic encryption information capacity and storage density can be strikingly increased while ensuring the image qualities by utilizing the limited space bandwidth product. The in-plane alignment error is on the order of one pixel, while the axial distance error is about 2 µm in the case of 6 hologram capacity. In the case of misalignment, holographic reconstruction quality can be significantly reduced. Therefore, the alignment required accuracy of this method is relatively high. The holograms stored in the cascaded metasurfaces are strictly encrypted, while the single layer has no information displayed. Apart from that, the experimental challenges can be alleviated by increasing the array size and pixel size. High-precision alignment is achieved through high-precision fabrication and experimental setups for high quality experimental detection. Therefore, Meanwhile, such cascaded metasurfaces can be used for massive information storage, optical camouflage, and dynamic holographic display. This further enriches many practical applications in other fields such as active modulation, dynamic holographic display, encryption, and storage.
Funding
National Key Research and Development Program of China (2021YFA1401200); National Natural Science Foundation of China (U21A20140, 92050117, 12104046, 62005017); Beijing Outstanding Young Scientist Program (BJJWZYJH01201910007022); Fok Ying Tung Education Foundation (161009); Administrative Commission of Zhongguancun Science Park (Z211100004821009).
Disclosures
The authors declare no conflicts of interest.
Data availability
Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.
References
1. X. G. Zhang, W. X. Jiang, H. L. Jiang, Q. Wang, H. W. Tian, L. Bai, Z. J. Luo, S. Sun, Y. Luo, C. Qiu, and T. J. Cui, “An Optically Driven Digital Metasurface for Programming Electromagnetic Functions,” Nat Electron 3(3), 165–171 (2020). [CrossRef]
2. G. Hu, X. Hong, K. Wang, J. Wu, H. Xu, W. Zhao, W. Liu, S. Zhang, F. Garcia-Vidal, B. Wang, P. Lu, and C. Qiu, “Coherent Steering of Nonlinear Chiral Valley Photons with a Synthetic Au-Ws2 Metasurface,” Nat. Photonics 13(7), 467–472 (2019). [CrossRef]
3. D. Lin, P. Fan, E. Hasman, and M. L. Brongersma, “Dielectric Gradient Metasurface Optical Elements,” Science 345(6194), 298–302 (2014). [CrossRef]
4. D. Wen, F. Yue, G. Li, G. Zheng, K. Chan, S. Chen, M. Chen, K. F. Li, P. W. H. Wong, K. W. Cheah, E. Y. B. Pun, S. Zhang, and X. Chen, “Helicity Multiplexed Broadband Metasurface Holograms,” Nat. Commun. 6(1), 8241 (2015). [CrossRef]
5. L. Li, H. Ruan, C. Liu, Y. Li, Y. Shuang, A. Alu, C. Qiu, and T. J. Cui, “Machine-Learning Reprogrammable Metasurface Imager,” Nat. Commun. 10(1), 1082 (2019). [CrossRef]
6. G. Zheng, H. Muehlenbernd, M. Kenney, G. Li, T. Zentgraf, and S. Zhang, “Metasurface Holograms Reaching 80% Efficiency,” Nat. Nanotechnol. 10(4), 308–312 (2015). [CrossRef]
7. A. V. Kildishev, A. Boltasseva, and V. M. Shalaev, “Planar Photonics with Metasurfaces,” Science, 339 (2013).
8. W. Ye, F. Zeuner, X. Li, B. Reineke, S. He, C. Qiu, J. Liu, Y. Wang, S. Zhang, and T. Zentgraf, “Spin and Wavelength Multiplexed Nonlinear Metasurface Holography,” Nat. Commun. 7(1), 11930 (2016). [CrossRef]
9. Y. Hu, X. Liu, M. Jin, Y. Tang, X. Zhang, K. F. Li, Y. Zhao, G. Li, and J. Zhou, “Dielectric Metasurface Zone Plate for the Generation of Focusing Vortex Beams,” PhotoniX 2(1), 10 (2021). [CrossRef]
10. H. Hsiao, C. H. Chu, and D. P. Tsai, “Fundamentals and Applications of Metasurfaces,” Small Methods 1, 1600064 (2017). [CrossRef]
11. Q. He, S. Sun, S. Xiao, and L. Zhou, “High-Efficiency Metasurfaces: Principles, Realizations, and Applications,” Adv. Opt. Mater. 6, 1800415 (2018). [CrossRef]
12. M. L. Tseng, H. Hsiao, C. H. Chu, M. K. Chen, G. Sun, A. Liu, and D. P. Tsai, “Metalenses: Advances and Applications,” Adv. Opt. Mater. 6(18), 1800554 (2018). [CrossRef]
13. W. Wan, J. Gao, and X. Yang, “Metasurface Holograms for Holographic Imaging,” Adv. Opt. Mater. 5(21), 1700541 (2017). [CrossRef]
14. X. Wang, Z. Nie, Y. Liang, J. Wang, T. Li, and B. Jia, “Recent Advances On Optical Vortex Generation,” Nanophotonics 7(9), 1533–1556 (2018). [CrossRef]
15. K. Y. Bliokh, F. J. Rodriguez-Fortuno, F. Nori, and A. V. Zayats, “Spin-Orbit Interactions of Light,” Nat. Photonics 9(12), 796–808 (2015). [CrossRef]
16. X. Li, R. Zhao, Q. Wei, G. Geng, J. Li, S. Zhang, L. Huang, and Y. Wang, “Code Division Multiplexing Inspired Dynamic Metasurface Holography,” Adv. Funct. Mater. 31(35), 2103326 (2021). [CrossRef]
17. Q. Jiang, Z. He, G. Jin, and L. Cao, “Complex Amplitude Modulation Metasurface with Dual Resonance in Transmission Mode,” Practical Holography XXXIII: Displays Materials, and Applications 9, 109440A (2019). [CrossRef]
18. Z. Deng and G. Li, “Metasurface Optical Holography,” Mater. Today Phys. 3, 16–32 (2017). [CrossRef]
19. Q. Xiao, Q. Ma, T. Yan, L. W. Wu, C. Liu, Z. X. Wang, X. Wan, Q. Cheng, and T. J. Cui, “Orbital-Angular-Momentum-Encrypted Holography Based On Coding Information Metasurface,” Adv. Opt. Mater. 9(11), 2002155 (2021). [CrossRef]
20. Y. Hu, L. Li, Y. Wang, M. Meng, L. Jin, X. Luo, Y. Chen, X. Li, S. Xiao, H. Wang, Y. Luo, C. Qiu, and H. Duan, “Trichromatic and Tripolarization-Channel Holography with Noninterleaved Dielectric Metasurface,” Nano Lett 20(2), 994–1002 (2020). [CrossRef]
21. Q. Jiang, G. Jin, and L. Cao, “When Metasurface Meets Hologram: Principle and Advances,” Adv. Opt. Photonics 11(3), 518–576 (2019). [CrossRef]
22. R. Zhao, X. Xiao, G. Geng, X. Li, J. Li, X. Li, Y. Wang, and L. Huang, “Polarization and Holography Recording in Real- and K-Space Based On Dielectric Metasurface,” Adv. Funct. Mater. 31(27), 2100406 (2021). [CrossRef]
23. Q. Xu, X. Su, X. Zhang, L. Dong, L. Liu, Y. Shi, Q. Wang, M. Kang, A. Alu, S. Zhang, J. Han, and W. Zhang, “A Mechanically Reprogrammable Pancharatnam-Berry Metasurface for Microwaves,” Adv. Photonics 4, 016002 (2022). [CrossRef]
24. N. Wang, W. Yan, Y. Qu, S. Ma, S. Z. Li, and M. Qiu, “Intelligent Designs in Nanophotonics: From Optimization Towards Inverse Creation,” PhotoniX 2(1), 22 (2021). [CrossRef]
25. M. Lyu, H. Wang, G. Li, S. Zheng, and G. Situ, “Learning-Based Lensless Imaging through Optically Thick Scattering Media,” Adv. Photonics 1(03), 1 (2019). [CrossRef]
26. T. Zeng, Y. Zhu, and E. Y. Lam, “Deep Learning for Digital Holography: A Review,” Opt. Express 29(24), 40572–40593 (2021). [CrossRef]
27. Y. Rivenson, Y. Wu, and A. Ozcan, “Deep Learning in Holography and Coherent Imaging,” Light: Sci. Appl. 8(1), 85 (2019). [CrossRef]
28. R. Horisaki, R. Takagi, and J. Tanida, “Deep-Learning-Generated Holography,” Appl. Opt. 57(14), 3859–3863 (2018). [CrossRef]
29. Z. Xu, S. Zuo, and E. Y. Lam, “End-to-End Learning for Digital Hologram Reconstruction,” High-speed Biomedical Imaging and Spectroscopy III: Toward Big Data Instrumentation and Management 10505 (2018).
30. W. Chen, D. Zhang, S. Long, Z. Liu, and J. Xiao, “Nearly Dispersionless Multicolor Metasurface Beam Deflector for Near Eye Display Designed by a Physics-Driven Deep Neural Network,” Appl. Opt. 60(13), 3947–3953 (2021). [CrossRef]
31. H. Wang, M. Lyu, and G. Situ, “Eholonet: A Learning-Based End-to-End Approach for in-Line Digital Holographic Reconstruction,” Opt. Express 26(18), 22603–22614 (2018). [CrossRef]
32. Y. Wu, Y. Rivenson, Y. Zhang, Z. Wei, H. Gunaydin, X. Lin, and A. Ozcan, “Extended Depth-of-Field in Holographic Imaging Using Deep-Learning-Based Autofocusing and Phase Recovery,” Optica 5(6), 704–710 (2018). [CrossRef]
33. Z. Ren, Z. Xu, and E. Y. Lam, “Learning-Based Nonparametric Autofocusing Or Digital Holography,” Optica 5(4), 337–344 (2018). [CrossRef]
34. Y. Rivenson, Y. Zhang, H. Gnaydin, D. Teng, and A. Ozcan, “Phase Recovery and Holographic Image Reconstruction Using Deep Learning in Neural Networks,” Light: Sci. Appl. 7(2), 17141 (2018). [CrossRef]
35. F. Yang, B. O. Raeker, D. T. Nguyen, J. D. Miller, Z. Xiong, A. Grbic, and J. S. Ho, “Antireflection and Wavefront Manipulation with Cascaded Metasurfaces,” Phys. Rev. Appl. 14(6), 064044 (2020). [CrossRef]
36. C. A. Curwen, J. L. Reno, and B. S. Williams, “Broadband Metasurface Design for Terahertz Quantum-Cascade Vecsel,” Electron. lett. 56(23), 1264–1267 (2020). [CrossRef]
37. X. Yi, X. Ling, Z. Zhang, Y. Li, X. Zhou, Y. Liu, S. Chen, H. Luo, and S. Wen, “Generation of Cylindrical Vector Vortex Beams by Two Cascaded Metasurfaces,” Opt. Express 22(14), 17207–17215 (2014). [CrossRef]
38. Z. Li, W. Liu, D. Ma, S. Yu, H. Cheng, D. Choi, J. Tian, and S. Chen, “Inverse Design of Few-Layer Metasurfaces Empowered by the Matrix Theory of Multilayer Optics,” Phys. Rev. Appl. 17(2), 024008 (2022). [CrossRef]
39. D. Zhu, Z. Liu, L. Raju, A. S. Kim, and W. Cai, “Building Multifunctional Metasystems Via Algorithmic Construction,” ACS Nano 15(2), 2318–2326 (2021). [CrossRef]
40. D. Liao, M. Wang, K. F. Chan, C. H. Chan, and H. Wang, “A Deep-Learning Enabled Discrete Dielectric Lens Antenna for Terahertz Reconfigurable Holographic Imaging,” Antennas Wirel. Propag. Lett. 21(4), 823–827 (2022). [CrossRef]