## Abstract

In this paper we propose a robust method to suppress the noise components in digital holography (DH), called SPADEDH (SPArsity DEnoising of Digital Holograms), that does not consider any prior knowledge or estimation about the statistics of the noise. In the full digital holographic process we must mainly deal with two kinds of noise. The first one is an additive uncorrelated noise that corrupts the observed irradiance, the other one is the multiplicative phase noise called speckle noise. We consider both lensless and microscope configurations and we prove that the proposed algorithm works efficiently in all considered cases suppressing the aforementioned noise components. In addition, for digital holograms recorded in lensless configuration, we show the improvement in a display test by using a Spatial Light Modulator (SLM).

© 2012 Optical Society of America

## 1. Introduction

In DH [1] the amplitude information of the object wavefront can be obtained quantitatively and analyzed digitally without the need for wet chemical processing. Due to this fact, many spectacular applications, such as microscopic imaging and phase-contrast digital holographic microscopy [2], 3D object recognition [3] and 3D dynamic display [4] have been demonstrated. In each case, the quality of the processing outputs is strongly dependent on the noise of the holograms. To obtain full benefits using the imaging techniques listed above for phase reconstruction, object recognition and 3D display, a pre-processing on the digital holograms is necessary in order to optimize the signal to noise ratio. To this purpose, several techniques that suppress/reduce noise components in DH are known in the literature. In off-axis DH the recorded intensity is normally corrupted by a mixture of speckle noise and additive noise. Classic filter-based methods, as Fourier domain denoising [5] and wavelet domain denoising [6], have extensively been studied, but they can be applied only to some transform domains. Moreover, such denoising methods are greatly influenced by the change of signal parameters like frequency, amplitude, etc. Great effort has been spent on removing principally the speckle noise in speckle interferometry [7] and DH [8–10]. In particular, the approaches described in [9,10] can be applied as a denoising methods without the knowledge of noise statistics, but introducing others information about the signal, i.e. different recording of the same object. In order to effectively overcome the above-mentioned shortcomings of these denoising methods, it is relevant to design reconstruction algorithms which are robust even in the presence of moderate or high-power noise level. To this end, we propose a denoising technique, called SPADEDH, that permits to obtain a robust denoising, for both additive noise and multiplicative noise on off-axis digital holograms in the hypothesis of high signal to noise ratio regime. Trying to solve a denoising problem implies that given the context of the noisy data, and defining a distortion measure (e.g., mean square error (MSE), or hamming distance), the objective is to find the reconstruction algorithm that achieves the minimum distortion measure at the receiver, assuming that noise statistics are not known at the receiver. This problem does no admit as optimal solution neither the Lasso estimator, formalized in [11], or other greedy algorithms, like Stagewise Orthogonal Matching Pursuit (StOMP) algorithm [12]. Both algorithms are an ad hoc solution for which a rigorous analysis capable of quantifying how suboptimal they are with respect to the optimal solution it is not available. These approaches are used in denoising scenarios, mainly due to their optimality in noiseless compressed sensing (CS) scenarios [13–15] and the well-known Lipschitz continuity [16], which makes the reconstruction algorithms designed for the noiseless measurements robust with respect to noise, a significant advantage when compared to strategies which incorporate knowledge of noise statistics [17]. Having said that, for speckle noise, statistics can be assumed to be known and various statistical approaches can be applied [18]. These considerations make the two aforementioned algorithms extremely robust with respect to imperfect knowledge of the noise statistics. Additionally, the proposed technique provides the possibility of reducing the number of measurements needed to reconstruct the denoised hologram, which is specially advantageous since the measurement time can be reduced. As a result so that, objects which are difficult to keep in fixed positions can be measured within higher accuracy. In summary, our approach can be defined as a *l*_{1} minimization algorithm, solved by StOMP, which is able to suppress the noise components on digital holograms without any prior knowledge or estimation about the statistics of noise. We have tested the SPADEDH method to various types of digital holograms, using different objects, from microscopic to macroscopic size, recorded in different conditions and with different wavelengths (either in visible as well as in IR spectrum [19]), in order to show the robustness of the proposed method, with respect the variation of experimental parameters.

## 2. Noise model

In off-axis DH the noiseless hologram *H* is formed in the interference plane:

*O*is the diffracted field produced by the object and

*R*is the reference. With a simple mathematical manipulation, we can rewrite the Eq. (1) as follow: where

*q*is called zero-order diffraction term, while the contribution in Eq. (2) contains both +1 and −1 diffraction orders. The hologram

*H*is recorded by a CCD and it is usually corrupted by a mixture of speckle noise and additive noise described by Eq. (2): where

*n*and

_{s}*n*are speckle noise, modeled by a multiplicative uniform noise, and an additive zero mean Gaussian noise respectively. The numerical process produces a digital version of the hologram that is reconstructed using a numerical version of the diffraction integral [20]. In order to suppress both noise components, we consider a zero-order term suppression using a high-pass convolution kernel [20]. Therefore, the hologram that we will consider as input of the SPADEDH algorithm is

_{a}## 3. SPADEDH algorithm

CS techniques can guarantee good performance in terms of signal reconstruction error for moderate or low-power noise scenarios, thanks to the Lipschitz continuity of the *l*_{0} and *l*_{1} norms. Therefore, the *l*_{0} and *l*_{1}-minimization techniques as well as all suitable greedy algorithms typical of the CS literature, can potentially provide a practical solution in all those applications, like medical imaging [21], sub-Nyquist sampling systems [22], compressive sensor networks [23], compressive imaging architectures [24], images analysis [21,25], and DH [26–30] where the number of measurements need to be small. In our setting, we focus on the reconstruction of a digital holograms from its noisy measurements. It is well known that if we could assign to our signal of interest a statistical characterization, the conditional estimator is the optimal denoising algorithm if a MSE distortion measure is considered, while a Maximum A Posteriori probability (MAP) estimator or the Discrete Universal DEnoising (DUDE) [31] algorithm are optimal solutions when different distortion measures are considered. However, each of these approaches explores some statistical priors of the signal which make the signal reconstruction algorithm not robust with respect to a large class of digital holograms, and in most practical scenarios such priors are not available. A more robust approach is to model the digital hologram as a non-random sparse signal and resort to a CS scheme which only explores as prior knowledge the sparsity of the signal. In fact, given measurements **y** and the knowledge that the original signal **x** is sparse or compressible on the Fourier basis, it is natural to attempt to recover **x** by solving an *l*_{0}-minimization problem. Since the *l*_{0}-minimization is a not convex objective function, we consider a relaxation of the optimization problem using the *l*_{1} norm. When the measurements are not corrupted by noise, the optimization can be written as

**v**= Ψ

**x**, where Ψ is the

*n*×

*n*basis matrix that transform the original data

**x**in a sparse signal, Φ is

*m*×

*n*matrix generated by randomly sampling the columns, with

*m*<

*n*, and

*ε*is related to the noise level. In order to obtain a good reconstruction from noisy measurements, parameter

*ε*needs to be optimized based on the noisy statistics (typically second order statistics). Examples of these and similar types of reconstruction algorithms where some knowledge of the noise statistics are required, are presented in [25–27]. However, in most practical scenarios, the statistic characterization of the noise is not available and a typical way to obtain such knowledge is to estimate the statistics through a preliminary processing based on several noisy measurements of the signal. Furthermore, once the noise statistics are obtained, the optimization of the parameter

*ε*in Eq. (7) is by itself quite complex [32]. The SPADEDH algorithm overcomes this limitation solving the denoising problem for digital holograms without any prior knowledge or estimation about the statistics of noise. Specifically, we propose as reconstruction algorithm the following optimization problem:

**h**̃ = vec(H̃) is the recorded digital hologram, in which vec(·) is an operator that creates a column vector from a matrix and the basis matrix is Ψ = F

*, where F*

_{δ}*is the numerical reconstruction of the digital hologram at distance*

_{δ}*δ*through the discrete version of the Fresnel-Kirchhoff integral. The denoised hologram is obviously computed as

**h**

*= F*

_{den}_{−}

_{δ}**v**

*, i.e. through the back propagation of the solution of the denoising problem in Eq. (8). Note that the choice of F*

_{den}*as a basis matrix is related to the fact that the numerical reconstruction of ideal noiseless hologram is a sparse signal. In fact, it is composed by the three diffraction terms without overlapping and they occupy, in general, about half of the pixels available. As shown in Eq. (8), in order to decouple the impact over the distortion by the noise from the one produced by the compression rate, we will just analyze the reconstruction algorithm under the assumption that Φ = I*

_{δ}*, where I*

_{n}*is the identity matrix.*

_{n}## 4. Numerical results

In our analysis we consider different types of digital holograms in order to show the robustness of the proposed method: speckle holograms of two statuettes acquired with two different laser sources, an infrared laser at 10.6 *μm* and a visible laser at 532 *nm*, respectively, and the hologram of a Micro Electro Mechanical System (MEMS). Basically two kinds of experimental set-ups were used to acquire these digital holograms: a lensless set-up to record the speckle holograms and a microscope configuration one to acquire MEMS hologram in reflection mode, that is necessary to acquire holograms of opaque objects as the MEMS. The lensless set-up is described in detail in [34], while the microscope configuration in reflection mode, is shown in [35]. We solve the optimization problem in Eq. (8) for the test cases using StOMP, which is a greedy algorithm similar to Orthogonal Matching Pursuit, but faster in the sense that it requires less iterations in the recovery process. Note that the results from this section were obtained minimizing the *ℓ*_{1}-norm of the estimated signal via StOMP, as opposed to traditional denoising approaches in which the total variation of the signal estimate is minimized [36]. Since we are considering the case for which Φ = I* _{n}*, a low complex recovery is desirable, due to the fact that each greedy step is computationally more demanding than in the traditional CS setting for which

*m*≪

*n*. In addition to that, for

*n*large, StOMP has a performance comparable to that achievable by

*ℓ*

_{1}minimization based in linear programming. This condition holds in our setting since the dimension of

**h**̃ is large in general for images (in our case

*n*= 1024 × 1024 for the speckle hologram recorded at 532

*nm*and the MEMS hologram, while

*n*= 640 × 480 for the speckle hologram recorded at 10.6

*μm*), and further increases when we move to higher resolutions.

For lensless holograms, in the Fresnel-Kirchhoff integral F* _{δ}*, we use the in-focus distance, while for the hologram recorded in microscope configuration we use the Back Focal Plane (BFP) distance because, in this case, we have the biggest degree of sparsity in that plane. In particular, for the hologram acquired at 10.6

*μm*, as it is in-focus in the Fourier plane, we use

*δ*= ∞. The results of the SPADEDH algorithm are shown in Fig. 1. In all cases, the final holograms are obtained by the back propagation, of the denoised complex field

**v**

*, in the hologram plane. In order to evaluate the results, for lensless holograms, we perform also a display test, by using a SLM as a (potentially 3D) projection system (see Fig. 2), while, for the hologram recorded in microscopic configuration, we compute the amplitude in-focus reconstruction. We compare SPADEDH algorithm with the Discrete Fourier Filter (DFF) [5]. This method consists into numerically compute the propagation from the discrete hologram plane to the discrete Fourier planed. Then, the Fourier plane data are filtered and inverse discrete Fourier transformed to the image plane. This is repeated*

_{den}*N*times and the resulting

*N*intensities are summed. In our implementation of this method, we set

*N*= 100. Note that, this method is based on the perfect knowledge of the hologram bandwidth. In order to quantify the efficiency of the SPADEDH method, in terms of how much noise we are able to remove from the original reconstruction, we define two different parameters: the signal to distortion ratio (SDR) and a measure of contrast C, given in [37]

_{2}is the

*l*

_{2}norm, Ĩ = |F

_{δ}**h**̃| is the amplitude of the original infocus digital reconstruction and Î = |F

_{d}**h**

*| is the processed one and, in Eq. (10),*

_{den}*σ*(I) and 〈I〉 represent the image gray-level standard deviation and mean, respectively, and I is the amplitude of the in-focus digital reconstruction of original hologram in one case and in the other case is the amplitude of the processed one. In Table 1 and Table 2 we report the computation of the two parameters of efficiency for the cases under analysis.

These results show that the SPADEDH algorithm provides gains both in terms of SDR and image contrast *C* and this shows its effective efficiency and robustness with respect the variation of experimental parameters. Finally, in order to evaluate the improvement of projections in the display test, we compute the of intensity into signal regions (SR) percentage increase, shown in the Fig. 2

*G*≈ 31%, while for the statuette of Venus results

*G*≈ 16%.

## 5. Conclusion

We propose an efficient and robust algorithm for noise removal in off-axis DH based on *l*_{1} minimization problem, that does not consider any prior information of the noise statistics. Numerical results show the goodness and robustness of the SPADEDH algorithm for both lensless holograms of centimeters size objects at Vis as well as at long IR wavelengths and for holograms recorded in microscopic configuration, with respect the DFF technique. In the first case, the display of denoised holograms shows the improvement in terms of the efficiency of the optical reconstruction. In fact, an increasing of intensity of the reconstructed in object image was observed. Also for the holograms recorded in microscope configuration we obtained good results in terms of denoising in the BFP spectrum as well as an improvement in the reconstruction efficiency in terms of both SDR and image contrast.

## Acknowledgments

We are grateful to Dr. A. Gertrude and Dr. M. Locatelli of CNR-Istituto Nazionale di Ottica of Firenze to have acquired the hologram of Venus.

## References and links

**1. **U. Schnars and W. Jptner, “Direct recording of holograms by a CCD target and numerical reconstruction,” Appl. Opt. **33**, 179–181 (1994). [CrossRef] [PubMed]

**2. **P. Ferraro, D. Alferi, S. De Nicola, L. De Petrocellis, A. Finizio, and G. Pierattini, “Quantitative phase-contrast microscopy by a lateral shear approach to digital holographic image reconstruction,” Opt. Lett. **31**, 1405–1407 (2006). [CrossRef] [PubMed]

**3. **B. Javidi and E. Tajahuerce, “Three-dimensional object recognition by use of digital holography,” Opt. Lett. **25**, 610–612 (2000). [CrossRef]

**4. **M. Paturzo, P. Memmolo, A. Finizio, R. Nsnen, T.J. Naughton, and P. Ferraro, “Synthesis and display of dynamic holographic 3D scenes with real-world objects,” Opt. Express **18**, 8806–8815 (2010). [CrossRef] [PubMed]

**5. **J. Maycock, B. M. Hennelly, J. B. McDonald, Y. Frauel, A. Castro, B. Javidi, and T. J. Naughton, “Reduction of speckle in digital holography by discrete Fourier filtering,” J. Opt. Soc. Am. A **24**, 1617–1622 (2007). [CrossRef]

**6. **D. Donoho, “De-Noising by soft thresholding,” IEEE Trans. Inf. Theory **38**(2), 613–627 (1995). [CrossRef]

**7. **S. Mirza, R. Kumar, and C. Shakher, “Study of various preprocessing schemes and wavelet filters for speckle noise reduction in digital speckle pattern interferometric fringes,” Opt. Eng. **44**(4), 045603, (2005). [CrossRef]

**8. **J. Garcia-Sucerquia, J. A. H. Ramirez, and D. V. Prieto, “Reduction of speckle noise in digital holography by using digital image processing,” Optik **116**, 44–48 (2005). [CrossRef]

**9. **B. Javidi, P. Ferraro, S. Hong, and D. Alfieri, “Three-dimensional image fusion using multi-wavelengths digital holography,” Opt. Lett. **30**(2), 144–146 (2005). [CrossRef] [PubMed]

**10. **C. Do and B. Javidi, “Three-dimensional computational holographic imaging and recognition using independent component analysis,” Proc. R. Soc. London **464**, 409–422 (2008). [CrossRef]

**11. **M. Elad, M.A.T. Figueiredo, and M. Yi, “On the role of sparse and redundant representations in image processing,” Proc. IEEE **98**(6), 972–982 (2010). [CrossRef]

**12. **D. Donoho, Y. Tsaig, I. Drori, and J-L Starck, “Sparse solution of underdetermined linear equations by stagewise orthogonal matching pursuit,” Stanford Technical Report 1–39 (2006).

**13. **D. Donoho, “Compressed sensing,” IEEE Trans. Inf. Theory **52**(4), 1289–1306 (2006). [CrossRef]

**14. **E. Candes, J. Romberg, and T. Tao, “Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information,” IEEE Trans. Inf. Theory **52**(2), 1289–1306 (2006). [CrossRef]

**15. **A.M. Tulino, G. Caire, S. Shamai, and S. Verdú, “Support recovery with sparsely sampled free random matrices,” The IEEE International Symposium on Information Theory (ISIT 2011), Saint-Petersburg, Russia, July, 31–August, 5, (2011).

**16. **Y. Wu, “Shannon theory for compressed sensing,” Ph. D. dissertation, Princeton University, Sep. (2011).

**17. **S. Sotthivirat and J. A. Fessler, “Penalized-likelihood image reconstruction for digital holography,” J. Opt. Soc. Am. A **21**, 737–750 (2004). [CrossRef]

**18. **N. Bertaux, Y. Frauel, P. Rfrgier, and B. Javidi, “Speckle removal using a maximum-likelihood technique with isoline gray-level regularization,” J. Opt. Soc. Am. A **21**, 2283–2291 (2004). [CrossRef]

**19. **E. Allaria, S. Brugioni, S. De Nicola, P. Ferraro, S. Grilli, and R. Meucci, “Digital holography at 10.6 *μ*m,” Opt. Commun. **215**, 257–262 (2003). [CrossRef]

**20. **T. Kreis, *Handbook of Holographic Interferometry: Optical and Digital Methods* (Wiley-VCH, 2004). [CrossRef]

**21. **M. Lustig, J. Santos, J. Lee, D. Donoho, and J. Pauly, “Application of compressed sensing for rapid MR imaging,” In Proc. Work. Struc. Parc. Rep. Adap. Signaux (SPARS), Rennes, France, Nov. (2005).

**22. **M. Mishali and Y. C. Eldar, “From theory to practice: sub-Nyquist sampling of sparse wideband analog signals,” IEEE J. Sel. Top. Signal Process. **4**(2), 375–391 (2010). [CrossRef]

**23. **J. Haupt, W. Bajwa, M. Rabbat, and R. Nowak, “Compressed sensing for networked data,” IEEE Signal Processing Mag. **25**(2), 92–101 (2008). [CrossRef]

**24. **R. Marcia, Z. Harmany, and R. Willett, “Compressive coded aperture imaging,” In Proc. IS&T/SPIE Symp. Elec. Imag.: Comp. Imag., San Jose, CA, (2009).

**25. **A. Majumdar and R.K. Ward, “Sparsity promoting speckle denoising,” International Conference on Image Processing (2009).

**26. **M. M. Marim, M. Atlan, E. Angelini, and J-C Olivo-Marin, “Compressed sensing with off-axis frequency-shifting holography,” Opt. Lett. **35**, 871–873 (2010). [CrossRef] [PubMed]

**27. **M. M. Marim, E. Angelini, J-C Olivo-Marin, and M. Atlan, “Off-axis compressed holographic microscopy in low-light conditions,” Opt. Lett. **36**, 79–81 (2011). [CrossRef] [PubMed]

**28. **K. Choi, R. Horisaki, J. Hahn, S. Lim, D.L. Marks, T.J. Schulz, and D.J. Brady, “Compressive holography of diffuse objects,” Appl. Opt. **49**, H1–H10 (2010). [CrossRef] [PubMed]

**29. **Y. Rivenson, A. Stern, and B. Javidi, “Compressive Fresnel holography,” J. Disp. Technol. **6**(10), 506–509 (2010). [CrossRef]

**30. **R. Horisaki, J. Tanida, A. Stern, and B. Javidi, “Multi-dimensional imaging using compressive Fresnel holography,” Opt. Lett. **37**(11), 2013–2015 (2012). [CrossRef] [PubMed]

**31. **T. Weissman, E. Ordentlich, G. Seroussi, S. Verdú, and M. Weinberger, “Universal discrete denoising: known channel,” IEEE Trans. Inf. Theory **51**(1), 5–28 (2005). [CrossRef]

**32. **S. Rangan, A.K. Fletcher, and V.K. Goyal, “Asymptotic analysis of MAP estimation via the replica method and applications to compressed sensing,” http://www.citebase.org/abstract?id=oai:arXiv.org:0906.3234, (2009).

**33. **E. Candes and T. Tao, “Decoding by linear programming,” IEEE Trans. Inf. Theory **51**(12), 4203–4215 (2005). [CrossRef]

**34. **A. Pelagotti, M. Locatelli, A.G. Geltrude, P. Poggi, R. Meucci, M. Paturzo, L. Miccio, and P. Ferraro, “Reliability of 3D imaging by digital holography at long IR wavelength,” J. Disp. Technol. **6**, 465–471 (2010). [CrossRef]

**35. **P. Ferraro, S. De Nicola, A. Finizio, G. Pierattini, and G. Coppola “Recovering image resolution in reconstructing digital off-axis holograms by Fresnel-transform method,” Appl. Phys. Lett. **84**, 2709–2711 (2004). [CrossRef]

**36. **L. I. Rudin, S. Osher, and E. Fatemi, “Nonlinear total variation based noise removal algorithms,” Physica D **60**, 259–268 (1992). [CrossRef]

**37. **P. Memmolo, C. Distante, M. Paturzo, A. Finizio, P. Ferraro, and B. Javidi, “Automatic focusing in digital holography and its application to stretched holograms,” Opt. Lett. **36**, 1945–1947 (2011). [CrossRef] [PubMed]