Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Confocal fluorescence microscopy for geometry parameter measurements of submerged micro-structures

Open Access Open Access

Abstract

Due to the challenging environment of micro-manufacturing techniques where the workpiece is submerged in a fluid, a contactless in situ capable measurement is required for quality control. However, the in situ conditions and the small specimen dimensions hinder the use of conventional metrology. Confocal fluorescence microscopy is shown to enable step height measurements of a specimen submerged in a 2.6 mm thick fluid layer with an uncertainty of 8.8 μm by fitting a model of the fluorescence intensity to the measured signal. To ascertain the potential of the proposed measurement approach, the minimal achievable uncertainty of 0.07 μm for a shot-noise-limited signal is derived.

© 2019 Optical Society of America under the terms of the OSA Open Access Publishing Agreement

The continuing trend towards smaller dimensions in manufacturing of technical parts sees an increasing use of techniques such as electro-chemical machining (ECM) or laser-chemical machining (LCM) that employ an electrolytic fluid in combination with a localized energy input to achieve a contactless material removal for the production of micro-structures [1] with high aspect ratios and sharp surface gradients. The advantages over conventional techniques such as micro-milling or laser ablation, e.g., are lower cost, lack of tool wear, and reduced thermal stress induction [2]. Since the workpiece is submerged in a fluid, the in situ measurement that is needed for quality assessment or closed-loop control is not trivial. The challenging manufacturing environment hinders the use of conventional measurement techniques for several reasons: The general lack of accessibility to the workpiece prevents the use of tactile geometry acquisition, demonstrating the need for contactless optical measurement methods. Optical micro-topography measurement techniques can be divided into interferometric methods (such as displacement interferometry [3,4] and digital holography), as well as non-interferometric techniques (such as laser-scanning confocal microscopy [4], light sheet microscopy, or HiLo microscopy [5]). However, these techniques are prone to the in situ conditions of the LCM process such as process-induced currents, thermal gradients, and refractive index fluctuations for the case of interferometric methods [3,6], or high surface angles or curvatures for the case of confocal microscopy [7]. For the application in environments where the surface of the measured object is completely covered by a fluid, the in situ topography measurement of highly curved micro-surfaces remains a challenging task for optical metrology. In contrast to other optical measurement systems, confocal fluorescence microscopy shows promise as an in situ capable measurement technique, because it does not detect the light reflected by the specimen such as conventional confocal techniques, but rather the light emitted by the fluorescent fluid covering it. Thus, light is detected even under angles >75° from the surface normal [4], allowing the measurement of a specimen with sharp edges and high surface angles [7,8], with a lateral resolution comparable to conventional confocal microscopy. The positions of the specimen surface and the fluid surface are determined through the change in the fluorescence signal, while the confocal volume is scanned vertically (perpendicular to the fluid surface) through the fluid. Consequently, this method was already successfully applied for the measurement of metallic micro-spheres with high curvatures by coating the specimen surface with a thin fluorescent film <100nm [7] to increase the angular range of the scattered light. As a result, the otherwise occurring “bat wing” artifacts, where the surface position uncertainty is higher at steep edges due to the reflected light not being captured by the objective, were not present [7]. Another application utilized the method for an in situ measurement of the tool wear of a cutting tool edge thinly covered (< 113 μm) by a fluorescent cutting fluid [8,9]. For micro-manufacturing applications such as LCM and ECM, however, the specimens are neither submerged in a thin fluid layer nor a thinly deposited fluorophore film of 0.1 μm–100 μm [7,10], but thicker fluid layers >1mm [6]. The fluorescence signal in thick fluid layers exhibits dependencies on the fluorophore concentration, fluid depth, and index of refraction that could not be observed in thin fluid layers. Thus, the development of a signal processing method, which is based on a physical model of the fluorescence signal considering these effects, is necessary for the accurate measurement of geometric parameters of specimens submerged in thick fluid layers. The aim of this Letter is to determine the potential of the proposed measurement approach, based on confocal fluorescence microscopy, for the in situ measurement in micro-manufacturing applications where micro-structures are submerged in fluid layers >1mm. For this purpose, the uncertainty of a step height measurement is compared to the theoretically achievable uncertainty of an ideal, shot-noise-limited signal, and the influence of the measurement parameters fluid depth and fluorophore concentration on the achievable uncertainty is evaluated.

The confocal fluorescence microscopy setup (see Fig. 1) is based on the well-established confocal microscopy technique: Light from a green diode laser (λ=532nm) is expanded by a Keplerian beam expander and redirected by a beam splitter to the objective lens (NA=0.42, WD=20mm), exciting the fluorophore molecules dissolved in the fluid (dilute aqueous solution of Rhodamine B) surrounding the specimen. The specimen container is positioned using a three-axis linear stage to enable a scanning of the position of the focus through the fluid. Both the fluorescence light emitted by the fluid (λ=565nm), as well as the scattered excitation light (λ=532nm), are collected by the objective lens, passed back through the beam splitter and are focused on a pinhole (diameter: 5 μm) that attenuates light originating far from the focal plane, thus producing the confocal effect. Behind the pinhole, a notch filter with a center wavelength of 532 nm and a full width at half-maximum of 17 nm separates the excitation light from the fluorescence light, which is ultimately detected by a charge-coupled device.

 figure: Fig. 1.

Fig. 1. Diagram of the confocal fluorescence microscopy setup. The fluorescence signal (bottom right) is detected during the vertical movement of the confocal volume through the fluid.

Download Full Size | PDF

The measurement principle is based on the detection of the fluorescence intensity emitted from the fluid covering the specimen using the confocal principle, which prevents fluorescence light not originating from a volume within the focus of the objective (confocal volume) from contributing to the fluorescence signal. Scanning the confocal volume of the excitation laser vertically (in z-direction) through the fluid produces a characteristic fluorescence intensity signal (see Fig. 1). For values of z far outside the boundaries of the fluid z0<z<z1, no signal is detected, since no fluorescent fluid is present within the confines of the confocal volume. Using a suitable signal processing of the measured fluorescence signal, the desired surface position z0 of the specimen is obtained.

For the purpose of modeling the confocally acquired fluorescence intensity, the confocal volume needs to be considered first. The confocal volume function I(r,z) describes the spatially distributed contribution of each infinitesimal volume element to the detected fluorescence light power. As such, the total detected fluorescence signal corresponds to the integral of the confocal volume function over each dimension (x,y,z). In a first approximation, the confocal volume function I(r,z) can be described by a three-dimensional Gaussian function [11,12]:

I(r,z)=Aϵexp(2w02(r2+z2κ2)),withr=(xy).
The e2-width of this distribution is denoted by w0 in the x-, y-direction and by κ·w0 in z-direction, where κ>1 is a constant factor dependent on the detection pinhole of the confocal setup. The factor ϵ is the attenuation coefficient of the fluid (directly proportional to the fluorophore concentration) and A a parameter containing both the excitation light power and the quantum yield of the fluorophore. Note that several assumptions were made in the current model to simplify the signal processing, including the disregard of saturation effects, the limitation that the fluid be a dilute solution (to stay within the scope of the Lambert–Beer law), and the neglect of fluorescence absorption by the fluid, which are all ultimately sources of model uncertainties. Since the fluorescence light is generated by the excitation of the fluid, and only light from inside the confocal volume is detected, the detector signal rapidly decreases if this volume moves outside the fluid. Thus, the fluid can be represented by a z-dependent weighting function η(z), which is zero outside the fluid and decreases exponentially with z inside the fluid layer, according to the Lambert–Beer law of absorption [13]. To obtain a function for the fluorescence intensity signal S(z) detected at position z, see Fig. 1, the contribution of each volume element is added up by integrating the weighted confocal volume function over each spatial dimension. The total integral can be expressed as a vertical (z) convolution of the horizontal (x,y) integral I(r,z)dr with the fluid weighting function η(z):
S(z)=η(z)*I(r,z)dr,η(z)={eϵ·(zz1)z0zz10otherwise.
Evaluating the convolution integral in Eq. (2) with the confocal volume function I(r,z) from Eq. (1) gives the function of the detected fluorescence intensity signal S(z) as
S(z)=S0·(erf(zz02Ξ+ϵΞ)erf(zz12Ξ+ϵΞ))·eϵ(zz1)+C,
with S0=12Aϵw02Ξπ3/2eΞ2ϵ2, Ξ=142κw0 and C=const. The surface position z0 is then determined by a nonlinear regression of the measured fluorescence intensity signal with the model function S(z) using a least squares method (Levenberg–Marquardt). The approximation parameters are the amplitude S0, the offset C, the fluorophore concentration-dependent attenuation coefficient ϵ, the confocal volume shape parameter Ξ, and the positions z1 (fluid surface) and z0 (specimen surface).

The fluorescence intensity signal resulting from a measurement of a single lateral point on a submerged specimen with a referenced step geometry is shown in Fig. 2.

 figure: Fig. 2.

Fig. 2. Measured fluorescence intensity signal S˜(zi) with the fitted model function S(z) [see Eq. (3)] of a single (x,y)-point. The parameter z0 (surface position) resulting from the fit is circled.

Download Full Size | PDF

The different media are shaded according to the model parameters resulting from the fit, revealing a fluid depth of 2.6 mm. The surface position profile of the step (z0 at different y-positions) was determined twice for two different x-positions; see Fig. 3(a) (29 measurements) and Fig. 3(b) (23 measurements). After correcting the total tilt of the step by subtracting a linear regression of the lower surface from all points, the step height h was determined by subtracting the mean lower from the mean upper surface position, meaning that both propagate into the resulting step height uncertainty:

h=z¯0,upperz¯0,lower.
Correcting the influence of the fluid refractive index on the focus position using an experimentally determined correction factor results in h=(258.2±8.8)μm and h=(245.2±11.4)μm, where the uncertainty value is the standard uncertainty.

 figure: Fig. 3.

Fig. 3. Results of the surface position (z0) measurements of a step with a nominal height of 253.5(2) μm. Both results (a) and (b) were measured at different lateral positions x.

Download Full Size | PDF

The step height results were verified by a reference measurement using the existing method of tactile profilometry, resulting in href=(253.5±0.2)μm. A comparison with the results obtained using confocal fluorescence microscopy shows no systematic deviations. However, the measured surface positions show a relatively large stochastic scattering (up to 20% with respect to the step height), most likely caused by the model uncertainties (such as the assumptions mentioned on page 2) and detector noise.

The inhomogeneous surface quality of the submerged step object and a cross-sensitivity of the model fit regarding starting and boundary parameters are also likely contributors.

The first measurement results demonstrate, in principle, the suitability of confocal fluorescence microscopy to determine geometry parameters such as the step height in thick fluid layers using a model-based signal processing. However, the current uncertainties of 8.8 μm and 11.4 μm exceed typical requirements of 1μm for micro-manufacturing metrology. In order to assess the potential of the measurement approach, the lower uncertainty limit for the surface position and the step height measurement is derived and compared to the experimental uncertainties.

To obtain the uncertainty, σz0=Var(z0) of the surface position z0 from the measurement with the nonlinear least squares approximation approach, the covariance matrix of the estimator θ_S=[S^0,C^,ϵ^,Ξ^,z^0,z^1]T based on the fit function S(z) from Eq. (3) is calculated. Applying an uncertainty propagation calculation to the least squares estimator results in the estimator’s covariance matrix [14]:

Cov(θ_S,θ_S)=(HSTCS˜1HS)1,
where HS denotes the Jacobian matrix with the partial derivatives of the approximation function S(z) with respect to every parameter of θ_S at each position zi of the measured fluorescence intensity signal S˜(zi) with i=1,,N:
HS=[SS^0|z1SC^|z1Sε^|z1SΞ^|z1Sz^0|z1Sz^1|z1SS^0|zNSC^|zNSε^|zNSΞ^|zNSz^0|zNSz^1|zN].
Since the covariance between the individual values is assumed to be zero, the covariance matrix CS˜RN×N of the measured fluorescence signal S˜=(S˜(z1),,S˜(zN))RN takes the form of a diagonal matrix whose main diagonal contains the variance σS˜(zi)2 of each zi of the fluorescence signal:
CS˜=diag(σS˜(z1)2,,σS˜(zN)2).
The surface position uncertainty σz0 is obtained from the square root of the fifth diagonal element of the estimator’s covariance matrix from Eq. (5).

To estimate the lowest achievable surface position uncertainty σz0, an intensity signal solely influenced by Poisson distributed shot noise is considered at first. Based on the full-well depth (12000e) and the quantum efficiency (0.40) of the used CCD sensor chip (SONY ICX205AL), the mean number of detected photons N(zi) is calculated with the signal model function S(z) from Eq. (3). Since the detected signal is the sum over 20×20 pixels, the maximum amounts to 1.15·106photons. According to the Poisson distribution, the variance of the shot noise consequently corresponds to the mean number of photons: σS˜(zi)2=N(zi). With this variance entered in Eq. (7), the achievable uncertainty with the estimator of Eq. (5) in case of shot noise amounts to σz0=0.16μm for a single surface position measurement. Note that the estimated uncertainty was verified by Monte Carlo simulations.

The uncertainty propagation of Eq. (4) results in a step height uncertainty of σh=0.07μm for the 23 position measurements of the second experiment; see Fig. 3(b). As a result, the shot noise limit is about a factor of 125 smaller than the lowest standard deviation of the experimental results. This illustrates the potential of the measurement approach when decreasing the uncertainty of the fluorescence signal to the physical limit.

The uncertainty calculation is repeated, but with the average variance of the measured fluorescence signal S˜(zi) from Fig. 2 around the model curve S(z), i.e., σS˜(zi)2=1.26·109, in units of photons. As a result, the calculated surface position uncertainty is σz0=8.56μm, and the propagated uncertainty for the step height measurement based again on 23 surface positions is σh=3.75μm. The estimated uncertainty is a factor of 54 larger than the shot noise limit, indicating the presence of additional noise sources and model uncertainties. However, the lowest standard deviation of the experimental results [see Fig. 3(b)] is still a factor of about 2.3 larger, which suggest varying measurement conditions such as the shape of the fluid surface or the surface micro-topography of the specimen.

In order to analyze the effect of the fluid depth df=(z1z0) and the concentration-dependent attenuation coefficient ϵ on the uncertainty σz0, calculated with the average variance of the signal around the model, the relation between the three quantities is illustrated in Figs. 4 and 5. The calculations reveal that pairs of (ϵ,df) exist for which the uncertainty σz0 of the surface position is at a minimum (shown in black circles/squares). The minimum decreases with higher ϵ and lower fluid depths df, which can be approximated by a power function shown as green and blue curves in Figs. 4 and 5, respectively. The resulting trade-off between df and ϵ enables the selection of a suitable fluorophore concentration for any particular application-dependent fluid depth to achieve a minimal measurement uncertainty.

 figure: Fig. 4.

Fig. 4. Calculated uncertainty of the surface position z0 as a function of fluid depth df=z1z0 for different attenuation coefficients ϵ. The uncertainty minima (black squares) are fitted with a power function (green) over df with respect to ϵ.

Download Full Size | PDF

 figure: Fig. 5.

Fig. 5. Calculated uncertainty of the surface position z0 as a function of attenuation coefficients ϵ for different fluid depths df=z1z0. The uncertainty minima (black circles) are fitted with a power function (blue) over ϵ with respect to df.

Download Full Size | PDF

The comparison between the lowest measured step height uncertainty (8.8 μm) and the calculated uncertainties using the variances of an ideal, shot-noise-limited signal (0.07 μm) and of the fit-residuum (3.75 μm) demonstrate the untapped potential of the measurement technique. The results indicate that the step height uncertainty is currently mainly limited by model uncertainties or model assumptions, respectively, detector noise and natural surface height variations of the specimen.

In conclusion, a sub-micrometer measurement uncertainty seems feasible with the proposed model-based measurement approach, since the minimal achievable surface position uncertainty for a measurement with a fluid thickness of 2.6 mm amounts to 0.07 μm. The theoretical uncertainty of the measurement approach was shown to be lower than the experiment, suggesting that the measurement system can be optimized by identifying and eliminating other sources of uncertainty. Hence, the main sources of model uncertainties such as the assumptions of the confocal volume shape, influence of the specimen reflectivity, or negligible fluorescence absorption need to be studied in more detail in future studies.

Funding

Deutsche Forschungsgemeinschaft (DFG) (SFB747).

REFERENCES

1. Y. Qin, Micromanufacturing Engineering Technology (Elsevier, 2015).

2. N. Ahmed, S. Darwish, and A. M. Alahmari, Mater. Manuf. Process. 31, 1121 (2016). [CrossRef]  

3. C. Gerhard and F. Vollertsen, Prod. Eng. Res. Dev. 4, 141 (2010). [CrossRef]  

4. H. Hansen, K. Carneiro, H. Haitjema, and L. De Chiffre, CIRP Ann. 55, 721 (2006). [CrossRef]  

5. K. Philipp, A. Smolarski, N. Koukourakis, A. Fischer, M. Sturmer, U. Wallrabe, and J. W. Czarske, Opt. Express 24, 15029 (2016). [CrossRef]  

6. P. Zhang, A. von Freyberg, and A. Fischer, Int. J. Adv. Manuf. Technol. 93, 3693 (2017). [CrossRef]  

7. J. Liu, C. Liu, J. Tan, B. Yang, and T. Wilson, J. Microsc. 261, 300 (2016). [CrossRef]  

8. K. Maruno, M. Michihata, Y. Mizutani, and Y. Takaya, Int. J. Autom. Technol. 10, 106 (2016). [CrossRef]  

9. Y. Takaya, K. Maruno, M. Michihata, and Y. Mizutani, CIRP Ann. 65, 467 (2016). [CrossRef]  

10. M. Michihata, A. Fukui, T. Hayashi, and Y. Takaya, Meas. Sci. Technol. 25, 064004 (2014). [CrossRef]  

11. N. O. Petersen, Foundations for Nanoscience and Nanotechnology (CRC Press, 2017).

12. S. Rüttinger, V. Buschmann, and B. Krämner, J. Microsc. 232, 343 (2008). [CrossRef]  

13. W. Malzer and B. Kanngießer, Spectrochim. Acta, Part B 60, 1334 (2005). [CrossRef]  

14. S. M. Kay, Fundamentals of Statistical Signal Processing, Volume I: Estimation Theory (Prentice Hall, 1993), Vol. 1.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (5)

Fig. 1.
Fig. 1. Diagram of the confocal fluorescence microscopy setup. The fluorescence signal (bottom right) is detected during the vertical movement of the confocal volume through the fluid.
Fig. 2.
Fig. 2. Measured fluorescence intensity signal S ˜ ( z i ) with the fitted model function S ( z ) [see Eq. (3)] of a single ( x , y ) -point. The parameter z 0 (surface position) resulting from the fit is circled.
Fig. 3.
Fig. 3. Results of the surface position ( z 0 ) measurements of a step with a nominal height of 253.5(2) μm. Both results (a) and (b) were measured at different lateral positions x .
Fig. 4.
Fig. 4. Calculated uncertainty of the surface position z 0 as a function of fluid depth d f = z 1 z 0 for different attenuation coefficients ϵ . The uncertainty minima (black squares) are fitted with a power function (green) over d f with respect to ϵ .
Fig. 5.
Fig. 5. Calculated uncertainty of the surface position z 0 as a function of attenuation coefficients ϵ for different fluid depths d f = z 1 z 0 . The uncertainty minima (black circles) are fitted with a power function (blue) over ϵ with respect to d f .

Equations (7)

Equations on this page are rendered with MathJax. Learn more.

I ( r , z ) = A ϵ exp ( 2 w 0 2 ( r 2 + z 2 κ 2 ) ) , with r = ( x y ) .
S ( z ) = η ( z ) * I ( r , z ) d r , η ( z ) = { e ϵ · ( z z 1 ) z 0 z z 1 0 otherwise .
S ( z ) = S 0 · ( erf ( z z 0 2 Ξ + ϵ Ξ ) erf ( z z 1 2 Ξ + ϵ Ξ ) ) · e ϵ ( z z 1 ) + C ,
h = z ¯ 0 , upper z ¯ 0 , lower .
Cov ( θ _ S , θ _ S ) = ( H S T C S ˜ 1 H S ) 1 ,
H S = [ S S ^ 0 | z 1 S C ^ | z 1 S ε ^ | z 1 S Ξ ^ | z 1 S z ^ 0 | z 1 S z ^ 1 | z 1 S S ^ 0 | z N S C ^ | z N S ε ^ | z N S Ξ ^ | z N S z ^ 0 | z N S z ^ 1 | z N ] .
C S ˜ = diag ( σ S ˜ ( z 1 ) 2 , , σ S ˜ ( z N ) 2 ) .
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.