Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Modal phase measuring deflectometry

Open Access Open Access

Abstract

In this work, a model based method is applied to phase measuring deflectometry, named modal phase measuring deflectometry. The height and slopes of the surface under test are represented by mathematical models and updated by optimizing the model coefficients to minimize the discrepancy between the reprojection in ray tracing and the actual measurement. The pose of the screen relative to the camera is pre-calibrated and further optimized together with the shape coefficients of the surface under test. Simulations and experiments are conducted to demonstrate the feasibility of the proposed approach.

© 2016 Optical Society of America

1. Introduction

Three-dimensional (3D) shape information is always placed at the top of the wish list while an object is under investigation. Extensive studies have been conducted to measure 3D shapes of different surfaces in multiple scales [1, 2]. Similar to interferometry, phase measuring deflectometry (PMD) was proposed primarily for specular surfaces [3–5], but different from interferometry, PMD is an incoherent method with a capability of providing full-field topography data for free-form surfaces [6]. Just years after its first proposal, progress in several aspects has been made: Tang et al. utilized the PMD technique for aspherical mirror measurement [7]. Dynamic 3D shape measurement has been demonstrated with the fringe reflection technique [8]. Liu el al. used cross fringe patterns to implement fast and accurate PMD [9]. Su et al. carried out series of work with their SCOTS on mirror measurement including telescope mirrors and x-ray mirrors [10–12]. Yue et al. addressed the carrier removal in PMD with analytical description [13]. Not limited in visible light, deflectometry has been pushed into fields of infrared [14] and ultraviolet [15]. Via comparison with interferometry, Faber et al. demonstrated PMD to be a serious competitor for interferometry [6].

However, as a slope metrology tool, there is an inherent ambiguity in deflectometry about the calculation for the height and slopes of the surface under test (SUT). Classically the surface height is reconstructed from slopes through integration [16, 17], while the slopes are determined with prior height knowledge. Due to the uncertainty of the prior knowledge on the height, the slopes are determined with errors and these slope errors will propagate into the resultant height via the integration process. The height-slope ambiguity issue was traditionally ignored or partially solved by roughly assuming a prior height distribution [18], a height-known seeding point [19], iterative reconstruction [20], or stereo vision [3]. Recently, Liu et al. proposed several ways to reconstruct the specular surface shape from a single image with no ambiguity [21, 22]. Another issue we will discuss is the system calibration, which is an everlasting topic in metrology. The classical PMD calibration method can be split into three separate steps for the calibration of screen, cameras, and the system geometry [3,4]. A flexible way to calibrate the PMD system with a markerless flat mirror was proposed by Xiao et al. [23] and a similar idea has been applied to calibrate a stereoscopic PMD system by Ren et al. [24]. A laser tracker was employed to measure the system geometry [12, 25]. In this work, we present a method to simultaneously estimate the height and slopes of the SUT in PMD by using mathematical models (e.g. Chebyshev polynomials, Zernike polynomials, or B-splines), which is called modal phase measuring deflectometry (MPMD). Moreover, a post-optimization for the screen geometry after the pre-calibration of the PMD system is also addressed in MPMD.

Section 2 introduces the principle of the proposed MPMD with its post-optimization. Simulations for both monoscopic PMD (mono-PMD) and stereoscopic PMD (stereo-PMD) configurations are carried out in section 3 to demonstrate the performance of MPMD. The feasibility of the proposed method is verified with experiments in section 4. Some features in using the proposed MPMD are discussed in section 5, and section 6 concludes the work.

2. Principle

The fundamental principle of deflectometry is the law of reflection. The angle of incidence equals the angle of reflection when light coming from the screen goes into the camera after the reflection on the specular surface as depicted in Fig. 1(a). Conventionally, this scene is considered in a reverse way illustrated in Fig. 1(b). The probe ray P = (xn, yn, 1)T from the camera is reflected by the specular surface at point X = (xc, yc, zc)T = zcP and hits the screen at its corresponding point m, where (xc, yc, zc) stands for the sampling position in camera coordinates, and (xn, yn) = (xc, yc) / zc denotes the normalized camera coordinates in the plane zc = 1.

 figure: Fig. 1

Fig. 1 Sketches of PMD can be drawn either in physical principle with light from the screen (a) or in ray tracing with probe from camera (b).

Download Full Size | PDF

Unlike the classical PMD that calculates the slopes from the fringe phases with pre-known or roughly known height values and then integrates slopes to get the resultant height distribution, the proposed method reconstructs both height and slopes at the same time. The modal wavefront reconstruction method [26–28] is introduced into PMD with a deeper consideration on simultaneously reconstructing both height and slopes from the measured fringe phases, instead of just getting height from slopes. The essential idea of MPMD is to represent both height and slopes of the SUT with well-established mathematical models w and to optimize the coefficient vector c to best explain the captured fringe patterns in measurement. In order to avoid recalculating basis function during iterations in optimization, which could be time consuming, the shape models are defined in the normalized camera coordinates (xn, yn).

zc=wΤc,
zcxn=wxΤc,
zcyn=wyΤc,
where w is the vector of the known basis functions, which can be Chebyshev polynomials, Zernike polynomials, or B-splines. Vectors wx and wy are the known derivatives derived from the corresponding basis function [29, 30]. The unknown vector c contains the coefficients to be optimized for each mode. The length of c is determined by the number of terms in Chebyshev and Zernike polynomials, or the number of control points in B-splines.

Considering the following relations

{zcxn=zcxcxcxn+zcycycxn=zcxc(zc+xnzcxn)+ynzcyczcxnzcyn=zcxcxcyn+zcycycyn=xnzcxczcyn+zcyc(zc+ynzcyn).

The x- and y-slopes in camera coordinates (xc, yc) are represented as

zcxc=zcxnzc+xnzcxn+ynzcyn,
zcyc=zcynzc+xnzcxn+ynzcyn.

Therefore, the normal of the mirror surface facing towards the camera is N=(zcxc,zcyc,1)Τ. For a probe vector P, its sampling point on the SUT is X and the vector of the reflected ray from X can be calculated as

r=p2p,nn,
where n=NN is the normalized normal and p=PP is the normalized probe vector.

The reflected ray can be determined once its direction (r) and one point on it (X) are known. If we want to calculate the corresponding intersection m^ on the screen, it is required to have the pose of the screen relative to the camera (3x1 rotation vector ω, 3x1 translation vector T), which can be obtained through a pre-calibration procedure. The same as the classical calibration [3, 4], the pre-calibration includes the camera calibration, screen calibration, and geometric calibration. Once the pose of the screen is initialized via pre-calibration, the intersection m^ can be calculated by solving equations of the screen plane and reflected ray. Another purpose of pre-calibration is to initialize coefficient vector c by fitting a camera calibration plane close to where the SUT is going to place.

The coefficient vector c and the pose of the screen (ω, T) in camera coordinates are optimized by minimizing the differences between the reprojection m^and the measurement m on the screen among the N pairs of correspondence in a least squares sense. This nonlinear least squares problem in Eq. (8) can be solved by the Levenberg-Marquardt algorithm.

[ω^,T^,c^]=argminω,T,cn=1Nm^n(ω,T,c)mn2.

In addition, the proposed MPMD method can easily adapt to multi-camera PMD system as shown in Fig. 2. The probe vector of the primary camera Pp determines the sampling point on SUT Xp = zcPp. The model is established in the normalized camera coordinates of the primary camera.

 figure: Fig. 2

Fig. 2 The MPMD approach can be applied to multi-camera PMD.

Download Full Size | PDF

The probe vector for the same point Xp in the kth camera can be determined with the camera calibration parameters. Interpolation on the measured correspondences is necessary to get mkfor point Xp in the kth camera. The calculation procedure of reprojection point m^kis the same as that for mono-PMD. We minimize the discrepancy between the reprojection m^k,n and the measurement mk,n on screen for N sampling points in K cameras in total. The optimization problem finally yields

[ω^,T^,c^]=argminω,T,ck=1Kn=1Nm^k,n(ω,T,c)mk,n(ω,T,c)2,
where mk,n is also a function of parameters (ω, T, c) except the primary camera which always keeps the same probe ray with no interpolation process. The problem in Eq. (9) can be solved by a nonlinear least squares solver.

3. Simulation

Series of simulations for both mono-PMD and stereo-PMD system are conducted to demonstrate the feasibility of the proposed MPMD approach. In this section, the system configuration in our simulation is first described, and then the evaluation of the measured shape error is discussed. After the reconstruction under perfect system calibration is addressed, the reconstruction under imperfect pre-calibration will be demonstrated to show the effectiveness of the post-optimization.

System configurations

In simulation, the stereo-PMD system keeps the same configuration of the mono-PMD system as shown in Fig. 3(a) by just adding one more camera as “the second eye” shown in Fig. 3(b). Both the SUT-to-camera distance and the SUT-to-screen distance are about 2.5 meters. The dimensions of the same SUT in Figs. 3(a)-3(b) are around 200 mm × 200 mm × 0.55 mm. The shape can be shown in Fig. 3(c) and analytically expressed as

 figure: Fig. 3

Fig. 3 Simulated PMD systems: (a) mono-PMD, (b) stereo-PMD, and (c) the SUT.

Download Full Size | PDF

z=110(cos(2πx200+x)+sin(2πy100))+105x2+2×105y2,100x100100y100.

The noise on fringe phase is set as 2π/100 rad rms which is not difficult to achieve in practical phase retrieval, especially in PMD. The fringe period is 16 screen pixels with the pixel pitch of the screen is 187.5 μm. Therefore, the measurement uncertainty of a pattern point in one direction on the screen is 30 μm rms.

Error evaluation

If we only concern on the shape of a SUT, instead of its absolute coordinates, the piston, tip and tilt terms in the result can be removed from the error evaluation as illustrated in Fig. 4. In MPMD, the screen pose can be adjusted with the model coefficient during optimization. It will introduce additional piston, tip and tilt terms into the absolute height result, which are the dominating errors of the reconstructed absolute height result.

 figure: Fig. 4

Fig. 4 Error evaluation. Absolute height (a), absolute height error (b), shape with piston, tip and tilt terms removed (c) and shape error (d).

Download Full Size | PDF

In most applications of the PMD, the shape of the specular surface is the goal, so we evaluate the shape error with piston, tip, and tilt removed in this work.

Reconstruction under perfect calibration

If the system calibration is perfect, there is no need to optimize the screen pose. The shape is reconstructed by estimating coefficients c. The number of terms used in Chebyshev polynomials or Zernike polynomials is 289, the same as the number of control points in B-splines, to have comparable results and avoid possible one-sided understandings. It could be interesting to compare different models in MPMD, but it is out of the scopes of this work.

Figures 5(a)-5(c) illustrate the reconstruction errors with Chebyshev, Zernike, and B-spline models in mono-PMD system in Fig. 3(a). The results of stereo-PMD system with the same models are shown in Figs. 5(d)-5(f). All these results indicate the MPMD can reconstruct the SUT with a shape error less than 1 μm rms with the simulated system configuration and phase noise condition, if the system is perfectly calibrated.

 figure: Fig. 5

Fig. 5 Shape errors by using MPMD in different PMD systems: (a-c) mono-PMD, (d-f) stereo-PMD, and with different models: (a, d) Chebyshev, (b, e) Zernike, (c, f) B-spline.

Download Full Size | PDF

Reconstruction under imperfect calibration

However, the practical system calibration is never perfect. In fact, the inaccurate system calibration is one of the major error sources in PMD, which limits its practical application. The pre-calibration error is simulated and added into the true pose of the screen as shown in Fig. 6.

 figure: Fig. 6

Fig. 6 The calibration error of the screen pose is added in simulation.

Download Full Size | PDF

If we trust the inaccurate system calibration and directly apply the MPMD approach with Chebyshev polynomials as the model for an instance, large shape error shown in Fig. 7(e) will observed from the reconstruction result in Fig. 7.

 figure: Fig. 7

Fig. 7 Large error occurs if inaccurate geometric calibration is trusted in the optimization with Chebyshev polynomials in the mono-PMD system. (a) Reconstructed shape, (b) reprojection on the screen, (c) reprojection residuals, (d) vectors of reprojection residuals, and (e) shape error.

Download Full Size | PDF

The height and slopes represented together by coefficients are modified to “best” reflect the probe rays onto the screen as illustrated in Figs. 7(b)-7(d). However, the screen in ray tracing is “placed” at a wrong location owning to the incorrect geometry knowledge. If the pre-calibration result is only used as an initial value in the post-optimization, the screen pose can be optimized with the shape estimation as described in Eq. (8) for a mono-PMD system.

The model coefficients and the screen pose are adjusted to have the best match between the reprojected and measured correspondences on the screen as shown in Fig. 8. Along with the reduction of reprojection residuals in iteration, the shape error decreases as well. Comparing to the shape error by trusting inaccurate calibration, the post-optimization effectively reduces the shape reconstruction error from 449 μm rms in Fig. 7(e) to 3.15 μm rms in Fig. 8(e). A similar observation is made in Fig. 9 when the post-optimization is implemented to a stereo-PMD system according to Eq. (9).

 figure: Fig. 8

Fig. 8 Shape error significantly reduces, when the inaccurate pose of screen is used as an initial guess in the optimization with Chebyshev polynomials in the mono-PMD system. (a) Reconstructed shape, (b) reprojection on the screen, (c) reprojection residuals, (d) vectors of reprojection residuals, and (e) shape error.

Download Full Size | PDF

 figure: Fig. 9

Fig. 9 The shape of SUT is successfully reconstruction in a form of Chebyshev polynomials in the stereo-PMD system. (a) Reconstructed shape, (b) reprojection of the two camera rays on the screen, (c) reprojection residuals, (d) vectors of reprojection residuals, and (e) shape error.

Download Full Size | PDF

Figures 9(b)-9(d) indicates the reprojections of both left and right camera rays are close to the measured correspondences on screen. The resultant shape error is 0.461 μm rms in the stereo-PMD system.

4. Experiment

Experiments are carried out to demonstrate the feasibility of MPMD in practical measurements. An LCD screen (Dell P2414H with 1920 × 1080 pixels and 0.2745 mm × 0.2745 mm pixel pitch) and a CCD camera (Manta G-145 with 1388 × 1038 pixels and 12-bit pixel depth) compose a mono-PMD system. Another camera (Manta G-145 with 1388 × 1038 pixels and 12-bit pixel depth) is added for a stereoscopic configuration as shown in Fig. 10. The SUT is 200 mm long and 95.3 mm wide and the mirror is concave along one dimension.

 figure: Fig. 10

Fig. 10 Experiment setup mainly consists of two cameras, one LCD screen, and the SUT.

Download Full Size | PDF

Before we can take a measurement, the PMD system needs to be calibrated. As mentioned above, the purpose of the pre-calibration is to initialize the parameters for screen pose and model coefficients.

Pre-calibration for both mono-PMD and stereo-PMD systems

The pre-calibration procedure can be the same as the classical PMD calibration. The pre-calibrated system geometry is illustrated in Fig. 11. An LCD screen displaying phase shifting fringe patterns is employed as the calibration target for camera calibration.

 figure: Fig. 11

Fig. 11 System geometry is pre-calibrated as the initial values for the optimization.

Download Full Size | PDF

A flat mirror with markers is used to determine the screen pose in camera coordinates by showing the several reflections of the screen to cameras as shown in the dashed rectangles in Fig. 11. An optimization is finally operated to refine the screen pose as suggested by Xiao et al. [23].

Measurement

Phase shifting method with multi-frequency phase unwrapping strategy [31–33] is utilized for absolute phase measurement. The period of the finest fringe is 16 screen pixels. The sinusoidal fringe patterns coded with x-phase and y-phase are sequentially displayed on the screen and captured by cameras. Figures 12(a) and 12(b) show two typical images captured by the camera. The corresponding screen coordinates shown in Figs. 12(c) and 12(d) are calculated from the absolute phases, fringe period and screen pixel pitch.

 figure: Fig. 12

Fig. 12 Two typical captured fringe patterns with x- (a) and y- (b) phases, and the corresponding coordinates on screen in x- (c) and y- (d) directions.

Download Full Size | PDF

Once the correspondence m is determined according to fringe phases, the model coefficients of the SUT c and the screen pose (ω, T) can be estimated together. The initial values of the model coefficients can be calculated from one of the camera calibration planes, which should be close to the SUT. The initial pose of the screen are set as the screen geometry from pre-calibration.

At first, by using the proposed MPMD method, we reconstruct the SUT with the mono-PMD data. Uniform cubic B-splines with 17 × 17 control points are used as the shape model. Figure 13 illustrates the iterative results in the mono-PMD system.

 figure: Fig. 13

Fig. 13 Iterative optimization with mono-PMD data starts from the initial guess (a), reduces the reprojection residuals (b), and finalizes the result with convergence (c).

Download Full Size | PDF

Figure 13 indicates that the root mean square (RMS) of the reprojection residuals declines along iterations in the mono-PMD configuration. Large reprojection errors in Fig. 13(a) are expected while the initial values of the model coefficients and screen pose are entered. It can be found in Fig. 13(b) the reprojected correspondence m^ is getting closer to the measured one m while the iteration updates. The resultant shape is finalized in Fig. 13(c) when the shape change or the variation of the reprojection error is negligible.

Moreover, the stereo-PMD data are also utilized to reconstruct the same SUT with MPMD method based on Eq. (9). After several iterations as illustrated in Fig. 14, the stereo-PMD delivers the shape result. Figure 14(a) shows both camera rays trace large errors at the start of the iteration. It is mainly because the shape coefficients are initialized from a plane pose used in camera calibration.

 figure: Fig. 14

Fig. 14 Iterative reconstruction with stereo-PMD data starts from the initial guess (a), reduces reprojection residuals of both left and right rays (b), and ends up with a final result (c).

Download Full Size | PDF

Figure 14 reveals that the reprojection errors of both left and right rays are getting smaller during optimization and finally reduce to 82.3 μm rms for the left ray and 67.3 μm rms for the right ray in Fig. 14(c). These RMS values are close to that in mono-PMD (81.7 μm rms) in Fig. 13(c). The two reconstruction results in Fig. 13(c) and Fig. 14(c) are compared in Figs. 15(a)-15(b) and their difference is displayed in Fig. 15(c). Their height difference is about 8.20 μm rms. The mono-PMD offers the resultant radius of curvature as 153.69 mm and the stereo-PMD finds a result of 154.48 mm, while the radius of curvature of the SUT is about 154.88 mm.

 figure: Fig. 15

Fig. 15 Comparison of reconstruction results from mono-PMD in the 1st test (a) and the 2nd test (d), stereo-PMD in the 1st test (b) and the 2nd test (e). Height differences (c) = (a) – (b), (f) = (d) – (e), (g) = (a) – (d), and (h) = (b) – (e).

Download Full Size | PDF

In order to investigate the repeatability of MPMD used in both mono-PMD and stereo-PMD data sets, another set of measurement is carried out and the results of mono-PMD and stereo-PMD are shown in Figs. 15(d)-15(e). Figure 15(f) displays their height difference with 8.45 μm rms. The main interest is to compare the two sets of measurement with the same reconstruction method to see how repeatable the reconstructions are. Figure 15(g) denotes there is 0.725 μm rms height difference between the reconstructions from two different sets of mono-PMD data with the proposed MPMD. A similar observation is made on stereo-PMD side with 0.898 μm rms height difference in Fig. 15(h). With the proposed MPMD method, sub-micron level repeatable results can be reconstructed from both mono-PMD and stereo-PMD data in our experiment.

5. Discussion

Several aspects of MPMD including the initial values, noise influence, and model mismatch are discussed and highlighted in this section for a better and comprehensive understanding of this method.

Initial values

The post-optimization in MPMD reduces the requirement on calibration by including the screen pose into the optimization with the model coefficients of the SUT. Usually certain affordable geometry error on screen pose will affect the shape result little. However, it does not mean the geometry calibration is not important anymore. In fact, the system pre-calibration provides initial values of the screen pose and the SUT model coefficients for the nonlinear optimization, which is vital to achieve good reconstruction with less shape error, especially in a form of the two-dimensional 2nd order polynomial. An example under different quality of pre-calibrations by using Zernike polynomials as the shape model is demonstrated in Fig. 16.

 figure: Fig. 16

Fig. 16 Pre-calibration is still important although MPMD relaxes the calibration. A good calibration (a) offers better initial values for a better reconstruction with less shape error (b), comparing to a poor calibration (c) with its corresponding large reconstruction error (d).

Download Full Size | PDF

Figure 16 reveals that MPMD method gets a relatively lower shape error under a good pre-calibration. The reconstruction can be much worse if the pre-calibration is poorly handled with providing an initial guess far from the reality as shown in Figs. 16(c)-16(d).

Noise influence

In classical PMD, the phase noise directly links to the slope noise, so the noise influence occurs at the integration step and depends on the integration algorithm. However, in MPMD, the measurement noise affects the nonlinear optimization and usually it ends up with a global shape error as a result.

Mismatch between the SUT and the model

Another important error source is the mismatch between the SUT and the model with a limited number of polynomial orders or control points. For example, Figs. 17(a)-17(d) shows a reconstruction of the SUT by 289 orders of Zernike polynomials. In contrast, if we only use 36 orders of Zernike polynomials in reconstruction, the larger reprojection residuals and shape error can be observed in Figs. 17(e)-17(h) due to the insufficient Zernike modes to well represent the SUT.

 figure: Fig. 17

Fig. 17 Number of model coefficients may influence the reconstruction accuracy. Reprojection residuals (a-b) are smaller and the reconstructed shape (c) is more accurate with less shape error (d) with 289 orders of Zernike polynomials than those (e-h) with 36 orders of Zernike polynomials

Download Full Size | PDF

The proposed MPMD is not good at reconstructing local waviness on the specular SUT. In some applications, high frequency components are interested and significant. It requires a large number of model coefficients to represent these high frequency terms. However, this will highly increase the computing time and become impractical. How to better deal with the reprojection residuals and reconstruct the high frequency components in MPMD will be addressed in our future work.

6. Conclusion

Modal phase measuring deflectometry is proposed in this work for mono-PMD, stereo-PMD, and multi-camera PMD configurations. The surface shape is represented by mathematical models (e.g. Chebyshev, Zernike, or B-spline). The model coefficients are adjusted to minimize the reprojection error on the screen. The reconstruction problem becomes a nonlinear optimization problem to match the reprojected correspondences with measured ones. In addition, the screen geometry from calibration is not simply trusted, but used as initial values and optimized with the surface shape optimization. Both simulation and experiment demonstrate the proposed MPMD is effective in 3D shape reconstruction for specular surfaces.

Funding

US Department of Energy, Office of Science, Office of Basic Energy Sciences (contract No.DE-AC-02-98CH10886).

Acknowledgments

We would like to thank Yuankun Liu in Sichuan University for the extensive discussion on system calibration, Miaomiao Liu in NICTA for the helpful discussion on shape reconstruction, and Dennis Kuhne in the optics and metrology group of NSLS-II for the mechanical machining.

References and links

1. P. de Groot, “Principles of interference microscopy for the measurement of surface topography,” Adv. Opt. Photonics 7(1), 1–65 (2015). [CrossRef]  

2. F. Chen, G. M. Brown, and M. Song, “Overview of three-dimensional shape measurement using optical methods,” Opt. Eng. 39(1), 10–22 (2000). [CrossRef]  

3. M. C. Knauer, J. Kaminski, and G. Häusler, “Phase measuring deflectometry: a new approach to measure specular free-form surfaces,” Proc. SPIE 5457, 366–376 (2004).

4. M. Petz and R. Tutsch, “Reflection grating photogrammetry: a technique for absolute shape measurement of specular free-form surfaces,” Proc. SPIE 5869, 58691 (2005).

5. T. Bothe, W. Li, C. von Kopylow, and W. P. O. Jüptner, “High-resolution 3D shape measurement on specular surfaces by fringe reflection,” Proc. SPIE 5457, 411–422 (2004).

6. C. Faber, E. Olesch, R. Krobot, and G. Häusler, “Deflectometry challenges interferometry: the competition gets tougher!” Proc. SPIE 8493, 84930R (2012).

7. Y. Tang, X. Su, Y. Liu, and H. Jing, “3D shape measurement of the aspheric mirror by advanced phase measuring deflectometry,” Opt. Express 16(19), 15090–15096 (2008). [CrossRef]   [PubMed]  

8. L. Huang, C. S. Ng, and A. K. Asundi, “Dynamic three-dimensional sensing for specular surface with monoscopic fringe reflectometry,” Opt. Express 19(13), 12809–12814 (2011). [CrossRef]   [PubMed]  

9. Y. Liu, E. Olesch, Z. Yang, and G. Häusler, “Fast and accurate deflectometry with crossed fringes,” Adv. Opt. Technol. 3, 441–445 (2014).

10. P. Su, R. E. Parks, L. Wang, R. P. Angel, and J. H. Burge, “Software configurable optical test system: a computerized reverse Hartmann test,” Appl. Opt. 49(23), 4404–4412 (2010). [CrossRef]   [PubMed]  

11. P. Su, Y. Wang, J. H. Burge, K. Kaznatcheev, and M. Idir, “Non-null full field X-ray mirror metrology using SCOTS: a reflection deflectometry approach,” Opt. Express 20(11), 12393–12406 (2012). [CrossRef]   [PubMed]  

12. R. Huang, P. Su, J. H. Burge, and M. Idir, “X-ray mirror metrology using SCOTS/deflectometry,” Proc. SPIE 8848, 88480G (2013). [CrossRef]  

13. H. Yue, Y. Wu, B. Zhao, Z. Ou, Y. Liu, and Y. Liu, “A carrier removal method in phase measuring deflectometry based on the analytical carrier phase description,” Opt. Express 21(19), 21756–21765 (2013). [CrossRef]   [PubMed]  

14. T. Su, A. Maldonado, P. Su, and J. H. Burge, “Instrument transfer function of slope measuring deflectometry systems,” Appl. Opt. 54(10), 2981–2990 (2015). [CrossRef]   [PubMed]  

15. D. Sprenger, C. Faber, M. Seraphim, and G. Häusler, “UV-Deflectometry: No parasitic reflections,” in Proc. 112th Annual Meeting of the DGaOA (2010), A19.

16. L. Huang, M. Idir, C. Zuo, K. Kaznatcheev, L. Zhou, and A. Asundi, “Comparison of two-dimensional integration methods for shape reconstruction from gradient data,” Opt. Lasers Eng. 64, 1–11 (2015). [CrossRef]  

17. S. Ettl, J. Kaminski, M. C. Knauer, and G. Häusler, “Shape reconstruction from gradient data,” Appl. Opt. 47(12), 2091–2097 (2008). [CrossRef]   [PubMed]  

18. L. Huang, C. S. Ng, and A. K. Asundi, “Fast full-field out-of-plane deformation measurement using fringe reflectometry,” Opt. Lasers Eng. 50(4), 529–533 (2012). [CrossRef]  

19. W. Li, M. Sandner, A. Gesierich, and J. Burke, “Absolute optical surface measurement with deflectometry,” Proc. SPIE 8494, 84940 (2012).

20. E. Olesch, C. Faber, and G. Häusler, “Deflectometric Self-Calibration for arbitrary specular surfaces,” in Proc. 112th Annual Meeting of the DGaOA (DGaO, 2011).

21. M. Liu, R. Hartley, and M. Salzmann, “Mirror Surface Reconstruction from a Single Image,” IEEE Trans. Pattern Anal. Mach. Intell. 37(4), 760–773 (2015). [CrossRef]   [PubMed]  

22. L. Miaomiao, R. Hartley, and M. Salzmann, “Mirror Surface Reconstruction from a Single Image,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2013), 129–136.

23. Y.-L. Xiao, X. Su, and W. Chen, “Flexible geometrical calibration for fringe-reflection 3D measurement,” Opt. Lett. 37(4), 620–622 (2012). [CrossRef]   [PubMed]  

24. H. Ren, F. Gao, and X. Jiang, “Iterative optimization calibration method for stereo deflectometry,” Opt. Express 23(17), 22060–22068 (2015). [CrossRef]   [PubMed]  

25. R. Huang, P. Su, J. H. Burge, L. Huang, and M. Idir, “High-accuracy aspheric X-ray mirror metrology using Software Configurable Optical Test System/deflectometry,” Opt. Eng. 54(8), 084103 (2015). [CrossRef]  

26. I. Mochi and K. A. Goldberg, “Modal wavefront reconstruction from its gradient,” Appl. Opt. 54(12), 3780–3785 (2015). [CrossRef]  

27. F. Dai, F. Tang, X. Wang, O. Sasaki, and P. Feng, “Modal wavefront reconstruction based on Zernike polynomials for lateral shearing interferometry: comparisons of existing algorithms,” Appl. Opt. 51(21), 5028–5037 (2012). [CrossRef]   [PubMed]  

28. G. Dai, “Modal wave-front reconstruction with Zernike polynomials and Karhunen-Loève functions,” J. Opt. Soc. Am. A 13(6), 1218–1225 (1996). [CrossRef]  

29. P. C. L. Stephenson, “Recurrence relations for the Cartesian derivatives of the Zernike polynomials,” J. Opt. Soc. Am. A 31(4), 708–715 (2014). [CrossRef]   [PubMed]  

30. F. Brunet, “Contributions to parametric image registration and 3d surface reconstruction,” European Ph. D. in Computer Vision, Université dAuvergne, Clérmont-Ferrand, France, and Technische Universitat Munchen, Germany (2010).

31. J. Tian, X. Peng, and X. Zhao, “A generalized temporal phase unwrapping algorithm for three-dimensional profilometry,” Opt. Lasers Eng. 46(4), 336–342 (2008). [CrossRef]  

32. L. Huang and A. K. Asundi, “Phase invalidity identification framework with the temporal phase unwrapping method,” Meas. Sci. Technol. 22(3), 035304 (2011). [CrossRef]  

33. C. Zuo, L. Huang, M. Zhang, Q. Chen, and A. Asundi, “Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review,” Opt. Lasers Eng. 85, 84–103 (2016). [CrossRef]  

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (17)

Fig. 1
Fig. 1 Sketches of PMD can be drawn either in physical principle with light from the screen (a) or in ray tracing with probe from camera (b).
Fig. 2
Fig. 2 The MPMD approach can be applied to multi-camera PMD.
Fig. 3
Fig. 3 Simulated PMD systems: (a) mono-PMD, (b) stereo-PMD, and (c) the SUT.
Fig. 4
Fig. 4 Error evaluation. Absolute height (a), absolute height error (b), shape with piston, tip and tilt terms removed (c) and shape error (d).
Fig. 5
Fig. 5 Shape errors by using MPMD in different PMD systems: (a-c) mono-PMD, (d-f) stereo-PMD, and with different models: (a, d) Chebyshev, (b, e) Zernike, (c, f) B-spline.
Fig. 6
Fig. 6 The calibration error of the screen pose is added in simulation.
Fig. 7
Fig. 7 Large error occurs if inaccurate geometric calibration is trusted in the optimization with Chebyshev polynomials in the mono-PMD system. (a) Reconstructed shape, (b) reprojection on the screen, (c) reprojection residuals, (d) vectors of reprojection residuals, and (e) shape error.
Fig. 8
Fig. 8 Shape error significantly reduces, when the inaccurate pose of screen is used as an initial guess in the optimization with Chebyshev polynomials in the mono-PMD system. (a) Reconstructed shape, (b) reprojection on the screen, (c) reprojection residuals, (d) vectors of reprojection residuals, and (e) shape error.
Fig. 9
Fig. 9 The shape of SUT is successfully reconstruction in a form of Chebyshev polynomials in the stereo-PMD system. (a) Reconstructed shape, (b) reprojection of the two camera rays on the screen, (c) reprojection residuals, (d) vectors of reprojection residuals, and (e) shape error.
Fig. 10
Fig. 10 Experiment setup mainly consists of two cameras, one LCD screen, and the SUT.
Fig. 11
Fig. 11 System geometry is pre-calibrated as the initial values for the optimization.
Fig. 12
Fig. 12 Two typical captured fringe patterns with x- (a) and y- (b) phases, and the corresponding coordinates on screen in x- (c) and y- (d) directions.
Fig. 13
Fig. 13 Iterative optimization with mono-PMD data starts from the initial guess (a), reduces the reprojection residuals (b), and finalizes the result with convergence (c).
Fig. 14
Fig. 14 Iterative reconstruction with stereo-PMD data starts from the initial guess (a), reduces reprojection residuals of both left and right rays (b), and ends up with a final result (c).
Fig. 15
Fig. 15 Comparison of reconstruction results from mono-PMD in the 1st test (a) and the 2nd test (d), stereo-PMD in the 1st test (b) and the 2nd test (e). Height differences (c) = (a) – (b), (f) = (d) – (e), (g) = (a) – (d), and (h) = (b) – (e).
Fig. 16
Fig. 16 Pre-calibration is still important although MPMD relaxes the calibration. A good calibration (a) offers better initial values for a better reconstruction with less shape error (b), comparing to a poor calibration (c) with its corresponding large reconstruction error (d).
Fig. 17
Fig. 17 Number of model coefficients may influence the reconstruction accuracy. Reprojection residuals (a-b) are smaller and the reconstructed shape (c) is more accurate with less shape error (d) with 289 orders of Zernike polynomials than those (e-h) with 36 orders of Zernike polynomials

Equations (10)

Equations on this page are rendered with MathJax. Learn more.

z c = w Τ c,
z c x n = w x Τ c,
z c y n = w y Τ c,
{ z c x n = z c x c x c x n + z c y c y c x n = z c x c ( z c + x n z c x n )+ y n z c y c z c x n z c y n = z c x c x c y n + z c y c y c y n = x n z c x c z c y n + z c y c ( z c + y n z c y n ) .
z c x c = z c x n z c + x n z c x n + y n z c y n ,
z c y c = z c y n z c + x n z c x n + y n z c y n .
r=p2 p,n n,
[ ω ^ , T ^ , c ^ ]=arg min ω,T,c n=1 N m ^ n ( ω,T,c ) m n 2 .
[ ω ^ , T ^ , c ^ ]=arg min ω,T,c k=1 K n=1 N m ^ k,n ( ω,T,c ) m k,n ( ω,T,c ) 2 ,
z= 1 10 ( cos( 2πx 200+x )+sin( 2πy 100 ) )+ 10 5 x 2 +2× 10 5 y 2 , 100x100 100y100 .
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.