Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

On-chip size, low-noise fringe pattern projector offering highly accurate 3D measurement

Open Access Open Access

Abstract

Fringe pattern projectors are quite useful for highly accurate three-dimensional (3D) measurement when a projector or LED array is used for illumination. We have fabricated a 0.2 mm × 0.2 mm structured light source, which was an on-chip size surface-emitting laser that utilized a holographically modulated two-dimensional (2D) photonic crystal (PC). This will make possible an extremely compact 3D measurement system that will positively impact mobile systems. However, the fringe pattern tends to cause speckle-like noise that leads to severe positional error in 3D measurement. Here we present a simple approach to projecting a low-noise fringe pattern from our surface-emitting lasers by using a one-dimensional (1D) focusing hologram. This method improves the flatness of the fringe pattern by around four times.

© 2023 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

Structured illumination is widely used in the fields of optical metrology [1], such as 3D measurement [24], facial imaging [2,5], dental imaging [2], and super-resolution microscopy [6]. In the case of 3D measurement, the illumination patterns are roughly classified into dot and fringe patterns. The spatial resolution of the dot pattern depends on the size of the dot, while that of the fringe pattern is several hundredths of the fringe period since phase-shift methods can be applied [13]. Therefore, the fringe pattern is useful for highly accurate 3D measurements when a projector [1,2] or LED array [7] is utilized for illumination. With an on-chip size projector, it will be possible to realize an extremely compact 3D measurement system that positively impacts the mobile 3D measurement system as well as measurement in very narrow spaces, such as in-vivo environments.

In this context, the photonic crystal surface-emitting laser (PCSEL) proposed in Refs. [815], which utilized a 2D PC as a lasing cavity, is a great framework because of its compactness, high mode stability, and high directional beam control. On the basis of the PCSEL technologies, we incorporated the concept of holographic modulation into the 2D PC cavity. The holographic modulation is realized by a positional and areal shift of the holes in which the basic idea comes from the detour phase hologram [1618] known since the 1960s. We introduced holographic modulation into the 2D PC and proposed an on-chip pattern projector, which we named the integrable phase-modulating surface-emitting laser (iPMSEL) [1925]. So far, we have demonstrated a variety of patterns, including the structured illuminations such as large-scale dot patterns and fringe patterns [23]. However, unlike the dot pattern, the fringe pattern tends to cause speckle-like noise, which is an issue that needs to be addressed since this noise causes severe positional errors in the 3D measurement.

A clue to how to suppress the noise is the interference between neighboring dots in the far-field plane that degrades the quality of the beam pattern, i.e., a set of dot patterns. Figure 1(a) shows the far-field pattern (FFP) of vertical lines of dot patterns from the iPMSELs fabricated as in Ref. [23], which consists of continuous dots, while Fig. 1(b) shows lines of a dot pattern where all points along the vertical axis are thinned out. In the case of the continuous-dot lines, the dots become broader and grain-like noise and discontinuity are observed, while in that of the thinned-out lines, the dots are narrow as designed. Presumably, the continuous-dot lines show the presence of the interference between neighboring dots, which broadens the point spread function. Such interference between neighboring dots in the far-field plane presumably contributes to the noise in the fringe pattern. One approach to address this issue is thinning out the continuing points. This suppresses the broadening of the point spread function, as shown in Fig. 1(b), but it causes a discontinuity at the position where the dot is thinned out. It would be preferable to have an alternative approach that suppresses the interference between neighboring dots while providing a continuous pattern. In this Letter, we present a simple approach to reducing the noise of the fringe pattern on the basis of the idea that a 1D line of dot patterns with spacings between each dot is extended by a 1D focusing hologram.

 figure: Fig. 1.

Fig. 1. FFP of the line dot hologram patterns from the iPMSEL where (a) dots are continuous, and (b) every dot is thinned out. Yellow dot patterns schematically indicate alignment of the dot pattern in the far-field plane.

Download Full Size | PDF

The device structure is similar to that in the previous work [23] except for the holographic design. Before the explanation of the holographic design, the fabrication process is briefly described here.

Figure 2(a) shows the schematic of the device structure. First, the n-AlGaAs cladding layer, the i-InGaAs/AlGaAs active layer, and the i-GaAs layer are grown on the n-GaAs substrate by metalorganic chemical vapor deposition (MOCVD). Then the holographically modulated PC structure, where the hole is rotated on the periodic lattice point of the 2D PC in accordance with the phase distribution [as shown in Fig. 2(b)], is formed on the GaAs layer. In this case, the lattice constant (a), filling factor (areal ratio of the holes against the unit cell), and radius of the circle where the center of gravity of the hole is rotating (r), are 202 nm, 28%, and 0.08a, respectively. This layer simultaneously acts as a lasing cavity as well as a holographic modulator, so hereafter we call it the phase-modulating layer. After the formation of the phase-modulating layer, the p-AlGaAs cladding layer, and p-GaAs contacting layer are grown successively by MOCVD. Then the p and the n electrodes are formed by using an ordinary lithography process. The output beam is emitted by opening a window of the n-electrode where an anti-reflection coating is formed. As shown in Fig. 2(a), the output beam is one-dimensionally focused 1D dot patterns where the focal length is 0.1 mm and they then spread along an axis to form the fringe patterns.

 figure: Fig. 2.

Fig. 2. Device structure of the iPMSEL. (a) Perspective view, and (b) manner of hole movement in the phase-modulating layer.

Download Full Size | PDF

The holographic design of the 1D focusing beam is as follows. In the Fresnel diffraction integral [26], the diffraction field is expressed as a Fourier transform of the product of the complex object field and a quadratic exponential as

$$\scalebox{0.9}{$\displaystyle{U_d}({{x_d},{y_d}} )= \frac{{{e^{jkz}}}}{{j\lambda z}}{e^{j\frac{k}{{2z}}({x_d}^2 + {y_d}^2)}}\iint\!{\left\{ {{U_o}({{x_o},{y_o}} ){e^{j\frac{k}{{2z}}(x_o^2 + y_o^2)}}} \right\}\!{e^{ - j\frac{{2\pi }}{{\lambda z}}({{x_d}{x_o} + {y_d}{y_o}} )}}} d{x_o}d{y_o},$}$$
where Ud(xd,yd) is the diffraction field, (xd,yd) is the coordinate in the diffraction plane, Uo(xo,yo) is the object field, (xo,yo) is the coordinate in the object plane, λ is the wavelength, and z is the coordinate of the diffraction plane along the propagating axis. In Eq. (1), the quadratic exponential term in the integral provides focusing different from Fraunhofer diffraction. Similarly, the 1D focusing is realized by the product of the object field for a 1D line of dot patterns that have spacing between each dot and the quadratic exponential along the orthogonal axis. The phase for 1D focusing is given by
$${\phi _{Focus}}({{x_o},{y_o}} )={-} \frac{{2\pi }}{\lambda }\left( {\sqrt {y_o^2 + {f^2}} - f} \right) \approx{-} \frac{{\pi y_o^2}}{{\lambda f}},$$
where f is the focal length. The product of the exponential terms means the sum of the phase, so the phases between dot patterns ϕDot(r) and the quadratic term ϕFocus(r) are added. Note that the phase of the 1D dot patterns is calculated with the aid of the iterative Fourier transformation algorithm [2729], the same as previous works [1924]. Moreover, the phase of the shift vector that diffracts in-plane light waves of the M-point band edge within the light line is also added [21]. It is described as ϕShift(r) = (π/a)(Nxa + Nya) where Nx and Ny are the integers that correspond to the number of the lattice points of the hole on the X and Y axes, respectively. For intuitive understanding, the concept is depicted in Fig. 3(a), while the procedure is summarized in Fig. 3(b). Finally, the phase distribution is obtained as ϕFinal= ϕDot+ ϕFocus+ ϕShift, which is shown in Fig. 4. Fifteen of the 1D dot patterns are designed as in Fig. 5(a) in wavenumber space. The Fourier transformation of cos(ϕFinal) is shown in Fig. 5(b) in wavenumber space where the wave vector ranges from –0.2 to 0.2 in which the wavenumber k = 2π/λ is normalized as 1. The cosine term includes not only the +1st order beam, described as exp(Final), but also the –1st order beam, described as exp(–Final), as the actual FFP does. Note that the +1st order beam is designed as the right half of the 1D focusing lines in Fig. 5(b), whereas the –1st order beam corresponds to the left half of the lines, that is actually a diverging beam since the sign of the focusing phase in Eq. (2) is opposite. Meanwhile, the ±1st order beam acts the same in the far-field plane. In Fig. 5(b), 30 1D dot patterns are extended vertically by the 1D focusing term and form 30 fringe patterns without contacting neighboring dots. Although the fringe patterns are aperiodic on the outer side, their central position is periodically aligned on the flat screen. The range, without severe distortion, is described later.

 figure: Fig. 3.

Fig. 3. (a) Schematic of the 1D focusing and (b) procedure of holographic design of the 1D focusing.

Download Full Size | PDF

 figure: Fig. 4.

Fig. 4. Phase distribution of the 1D focusing.

Download Full Size | PDF

 figure: Fig. 5.

Fig. 5. Fourier spectrum of (a) line of dots pattern and (b) 1D focusing including the ±1st order beam.

Download Full Size | PDF

The iPMSEL is operated by the laser diode (LD) driver (ILX lightwave, LDP-3830) with the Peltier controller (Daitron, DPC-100). The FFP is acquired by the CCD camera (Hamamatsu, ORCA-05 G) through the FFP optics for narrow angle (Hamamatsu, A3267-15) and wide angle (Hamamatsu, A3267-12). The beam profile is measured by the beam profiler (Hamamatsu, Lepas-12). The FFP is shown in Fig. 6 in which pulse width, pulse duty, operation current, and temperature are 50 ns, 1%, 4 A, and 25°C, respectively. The FFP of a narrow angular range around surface normal is shown in Fig. 6(a). It shows the fringe patterns that aligned around 5° near the center. Compared with Fig. 1(a), grain-like noise and discontinuity due to the interference of the neighboring point are successfully suppressed in the 1D focusing fringe. Note that the slight broadening of the width shown in Fig. 6(a) might be caused by the broadening of the point spread function as shown in the PCSEL under high operation current [9]. It also indicates that the width of the fringe can be increased by increasing the operating current to some extent which is useful for adjusting the fringe pattern. Figure 6(b) shows the FFP in a wide angular range. The fringe extends over ±45°. Note that the fringe is distorted outside around ±30° because it extends linearly in the wavenumber space. The tendency of periodic mesh among flat screen, angular space, and wavenumber space is summarized in previous work [23]. Note that the phase-shifting method can be used to evaluate the 3D shape even in the distorted fringe. The slight interference seen in the upper and lower sides in Fig. 6(b) corresponds to that in the Fourier spectrum shown in Fig. 5(b).

 figure: Fig. 6.

Fig. 6. FFP of the 1D focusing iPMSEL in (a) a narrow angular range and (b) a wide angular range.

Download Full Size | PDF

To quantify the improvement, the fringe patterns between conventional continuous-dot lines, as shown in Fig. 1(a), and the 1D focusing pattern, as shown in Fig. 6(a), are compared as follows. First, the pixel error of the CCD camera is removed by processing the 3 × 3 median filter twice in ImageJ, since the pixel errors severely disturb the evaluation of the fringe. Figure 7(a) shows the 100 × 100 pixels from the center of Fig. 1(a) after removing the pixel error, while Fig. 7(b) shows that of Fig. 6(a). After removing the pixel error, mean value and standard deviation of the 10 × 1024 pixel in the central fringe as a reference for a line of fringe are calculated by using ImageJ. The fluctuation of the fringe is calculated by division of the standard deviation by the mean value. The fluctuation of the fringe in Fig. 1(a) is 30.5% while that in Fig. 6(a) is 7.6%, so the 1D focusing method improves the flatness by around four times. Thanks to avoiding the interference between neighboring dot patterns in the far-field plane, low-noise fringe patterns are achieved. We also evaluated the phase of the 1D focusing fringe patterns by using the 4-step phase-shifting method [2] in Supplement 1 which reflects the surface shape without severe speckle error.

 figure: Fig. 7.

Fig. 7. 100 × 100 pixels from the center of the FFP in (a) Fig. 1(a) and (b) Fig. 6(a) after removing the pixel error.

Download Full Size | PDF

In this Letter, we propose a simple method to obtain a low-noise fringe pattern on the basis of the idea that 1D line dot patterns having spacings between each dot are extended by a 1D focusing hologram. In contrast to the conventional continuous-dot array pattern, the grain-like noise and discontinuity in the FFP due to the interference between neighboring point patterns is avoided in our method. Although the 1D focusing fringe causes a slight distortion in the angular range above ±30°, this technique opens the way to highly accurate 3D shape measurement with chip-sized compactness.

Acknowledgments

The authors are grateful to A. Hiruma, H. Toyoda, T. Hara, M. Niigaki, Y. Yamashita, K. Nozaki, T. Hirohata, T. Edamura, and A. Watanabe of HPK for their encouragement throughout this work, and to A. Higuchi and M. Hitaka for their assistance with epitaxial growth. This work was supported partly by Japan Science and Technology Agency (JST); Center of Innovation Program (COI) (JPMJCE1311).

Disclosures

The authors declare no conflicts of interest.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Supplemental document

See Supplement 1 for supporting content.

REFERENCES

1. C. Zuo, J. Qian, S. Feng, W. Yin, Y. Li, P. Fan, J. Han, K. Qian, and Q. Chen, Light: Sci. Appl. 11, 39 (2022). [CrossRef]  

2. J. Geng, Adv. Opt. Photonics 3, 128 (2011). [CrossRef]  

3. S. Zhang, Opt. Lasers Eng 106, 119 (2018). [CrossRef]  

4. C. Zuo, T. Tao, S. Feng, L. Huang, A. Asundi, and Q. Chen, Opt. Lasers Eng 102, 70 (2018). [CrossRef]  

5. A. Breitbarth, T. Schardt, C. Kind, J. Brinkmann, P.-G. Dittrich, and G. Notni, Proc. SPIE 11144, 1114407 (2019). [CrossRef]  

6. M. G. L. Gustafsson, J. Microsc. 198, 82 (2000). [CrossRef]  

7. M. Fujigaki, Y. Oura, D. Asai, and Y. Murata, Opt. Express 21, 23169 (2013). [CrossRef]  

8. M. Imada, S. Noda, A. Chutinan, T. Tokuda, M. Murata, and G. Sasaki, Appl. Phys. Lett. 75, 316 (1999). [CrossRef]  

9. K. Hirose, Y. Liang, Y. Kurosaka, A. Watanabe, T. Sugiyama, and S. Noda, Nat. Photonics 8, 406 (2014). [CrossRef]  

10. M. Yoshida, M. D. Zoysa, K. Ishizaki, Y. Tanaka, M. Kawasaki, R. Hatsuda, B. Song, J. Gelleta, and S. Noda, Nat. Mater. 18, 121 (2019). [CrossRef]  

11. R. Morita, T. Inoue, M. D. Zoysa, K. Ishizaki, and S. Noda, Nat. Photonics 15, 311 (2021). [CrossRef]  

12. T. Inoue, M. Yoshida, J. Gelleta, K. Izumi, K. Yoshida, K. Ishizaki, M. D. Zoysa, and S. Noda, Nat. Commun. 13, 3262 (2022). [CrossRef]  

13. T. Okino, K. Kitamura, D. Yasuda, Y. Liang, and S. Noda, in Conference on Lasers and Electro-Optics (CLEO), OSA Technical Digest (2015), paper SW1F.1.

14. S. Noda, K. Kitamura, T. Okino, D. Yasuda, and Y. Tanaka, IEEE J. Select. Topics Quantum Electron. 23, 4900107 (2017). [CrossRef]  

15. R. Sakata, K. Ishizaki, M. D. Zoysa, S. Fukuhara, T. Inoue, Y. Tanaka, K. Iwata, R. Hatsuda, M. Yoshida, J. Gelleta, and S. Noda, Nat. Commun. 11, 3487 (2020). [CrossRef]  

16. B. R. Brown and A. W. Lohmann, Appl. Opt. 5, 967 (1966). [CrossRef]  

17. A. W. Lohmann and D. P. Paris, Appl. Opt. 6, 1739 (1967). [CrossRef]  

18. B. R. Brown and A. W. Lohmann, IBM J. Res. Dev. 13, 160 (1969). [CrossRef]  

19. Y. Kurosaka, K. Hirose, T. Sugiyama, Y. Takiguchi, and Y. Nomoto, Sci. Rep. 6, 30138 (2016). [CrossRef]  

20. Y. Takiguchi, K. Hirose, T. Sugiyama, Y. Nomoto, S. Uenoyama, and Y. Kurosaka, Opt. Express 26, 10787 (2018). [CrossRef]  

21. K. Hirose, Y. Takiguchi, T. Sugiyama, Y. Nomoto, S. Uenoyama, and Y. Kurosaka, Opt. Express 26, 29854 (2018). [CrossRef]  

22. Y. Kurosaka, K. Hirose, A. Ito, M. Hitaka, A. Higuchi, T. Sugiyama, Y. Takiguchi, Y. Nomoto, S. Uenoyama, and T. Edamura, in Conference on Lasers and Electro-Optics (CLEO), OSA Technical Digest (2019), paper SM4N.2.

23. K. Hirose, H. Kamei, T. Sugiyama, and Y. Kurosaka, Opt. Express 28, 37307 (2020). [CrossRef]  

24. Y. Kurosaka, K. Hirose, H. Kamei, and T. Sugiyama, Phys. Rev. B 103, 245310 (2021). [CrossRef]  

25. K. Hirose, H. Kamei, and T. Sugiyama, Opt. Express 30, 3066 (2022). [CrossRef]  

26. J. Goodman, Introduction to Fourier Optics, 3rd ed., (Roberts & Co. Publishers, 2005).

27. R. W. Gerchberg and W. O. Saxton, Optik 35, 237 (1972).

28. J. R. Fienup, Appl. Opt. 21, 2758 (1982). [CrossRef]  

29. O. Ripoll, V. Kettunen, and H. P. Herzig, Opt. Eng. 43, 2549 (2004). [CrossRef]  

Supplementary Material (1)

NameDescription
Supplement 1       document

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (7)

Fig. 1.
Fig. 1. FFP of the line dot hologram patterns from the iPMSEL where (a) dots are continuous, and (b) every dot is thinned out. Yellow dot patterns schematically indicate alignment of the dot pattern in the far-field plane.
Fig. 2.
Fig. 2. Device structure of the iPMSEL. (a) Perspective view, and (b) manner of hole movement in the phase-modulating layer.
Fig. 3.
Fig. 3. (a) Schematic of the 1D focusing and (b) procedure of holographic design of the 1D focusing.
Fig. 4.
Fig. 4. Phase distribution of the 1D focusing.
Fig. 5.
Fig. 5. Fourier spectrum of (a) line of dots pattern and (b) 1D focusing including the ±1st order beam.
Fig. 6.
Fig. 6. FFP of the 1D focusing iPMSEL in (a) a narrow angular range and (b) a wide angular range.
Fig. 7.
Fig. 7. 100 × 100 pixels from the center of the FFP in (a) Fig. 1(a) and (b) Fig. 6(a) after removing the pixel error.

Equations (2)

Equations on this page are rendered with MathJax. Learn more.

$$\scalebox{0.9}{$\displaystyle{U_d}({{x_d},{y_d}} )= \frac{{{e^{jkz}}}}{{j\lambda z}}{e^{j\frac{k}{{2z}}({x_d}^2 + {y_d}^2)}}\iint\!{\left\{ {{U_o}({{x_o},{y_o}} ){e^{j\frac{k}{{2z}}(x_o^2 + y_o^2)}}} \right\}\!{e^{ - j\frac{{2\pi }}{{\lambda z}}({{x_d}{x_o} + {y_d}{y_o}} )}}} d{x_o}d{y_o},$}$$
$${\phi _{Focus}}({{x_o},{y_o}} )={-} \frac{{2\pi }}{\lambda }\left( {\sqrt {y_o^2 + {f^2}} - f} \right) \approx{-} \frac{{\pi y_o^2}}{{\lambda f}},$$
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.