Single-pixel imaging which employs active illumination to acquire spatial information is an innovative imaging scheme and has received increasing attentions in recent years. It is applicable to imaging at non-visible wavelengths and imaging under low light conditions. However, single-pixel imaging has once encountered problems of low reconstruction quality and long data-acquisition time. Hadamard single-pixel imaging (HSI) and Fourier single-pixel imaging (FSI) are two representative deterministic model based techniques. Both techniques are able to achieve high-quality and efficient imaging, remarkably improving the applicability of single-pixel imaging scheme. In this paper, we compare the performances of HSI and FSI with theoretical analysis and experiments. The results show that FSI is more efficient than HSI while HSI is more noise-robust than FSI. Our work may provide a guideline for researchers to choose suitable single-pixel imaging technique for their applications.
© 2017 Optical Society of America
The earliest example of single-pixel imaging might be the flying-spot camera patented by Paul Nipkow in 1884. P. Nipkow provided a method for encoding and transmitting image information using a rotating Nipkow disk. Laser confocal scanning microscopy , optical coherence tomography , ultrasonic endoscope , and scanning electron microscopy  are also examples of single-pixel imaging which perform raster scanning in the spatial domain. Contemporary single-pixel imaging, which uses a time-varying structured illumination and an appropriate computer algorithm, originates from ghost imaging [5–17]. Ghost imaging was initially considered as a quantum effect  but later Bennink et al. demonstrated that it can be implemented with a classical source . Computational ghost imaging [7–17] allows one to capture a scene using a single-pixel (or bucket) detector. Objects to be imaged are under spatially and temporally varying illuminations. The illumination patterns are typically generated using a spatial light modulator (SLM). The single-pixel detector is used to collect the corresponding light signal for each illumination pattern. The desired image is computationally reconstructed by correlating the illumination patterns with the detected signals.
Single-pixel imaging techniques [14–35] do not need to use any pixelated detector for light signal detection. This advantage brings single-pixel imaging a potential capability of solving some challenges in conventional imaging. For example, single-pixel imaging scheme allows one to build a low-cost imaging system that can work at non-visible wavelengths. It should be noted that pixelated detectors are commonly expensive or even unavailable at most non-visible wavelengths. Single-pixel imaging may also have the advantage of imaging at low light conditions. This is because, in comparison with pixelated detectors, single-pixel detectors with large active area are easier to fabricate and more sensitive to light.
Inherited from ghost imaging, single-pixel imaging was initially based on a statistical model, which can be evident by the use of random patterns for illumination. The random patterns form an overcomplete non-orthogonal set. Consequently, it requires a great number of measurements (much larger than pixel counts) and long data-acquisition time for recording signals. For instance, Sun et al. used 106 random patterns to reconstruct an image with a resolution of pixels . Even with so many measurements, the quality of images reconstructed by single-pixel imaging is hardly comparable with the quality of images obtained by conventional pixelated-detector-based imaging. Long-data acquisition time and low reconstruction quality limit the applicability of this innovative imaging scheme. Compressive sensing [7,9,14,16–18,20,21] has been adopted to reduce measurements, but it is at the expense of computational time.
The recently proposed deterministic model based techniques [18–35] can well tackle these problems of long data acquisition time and low reconstruction quality. These techniques use deterministic orthogonal basis patterns, instead of non-orthogonal random patterns, for illumination. Hadamard single-pixel imaging (HSI) [18–29] and Fourier single-pixel imaging (FSI) [30–34] are two representative single-pixel imaging techniques that use a deterministic model. HSI uses Hadamard basis patterns for illumination while FSI uses Fourier basis patterns. The use of basis patterns for illumination brings two advantages. The first advantage is perfect reconstruction in principle. We refer perfect reconstruction to the ability that allows images to be accurately recovered and the property that an imaging model itself would not introduce errors. Or in other words, a technique that allows perfect reconstruction is able to produce a reconstruction exactly the same as the ground truth in an ideal case (such as noiseless simulation). Illumination using basis patterns enables perfect reconstruction, because the basis patterns form a complete orthogonal set. Basis patterns illumination allows one to acquire the spatial information of object image in a transformation domain and recover the object image via the corresponding inverse transform. In principle, the image can be reconstructed without noticeable difference from the ground truth, when is fully sampled in the transformation domain. This feature solves the problem of low reconstruction quality in ghost imaging. The second advantage is measurement reduction. Natural images give a sparse representation in some transformation domains, such as Hadamard, Fourier, discrete cosine  or wavelet [36,37] domain, allowing one to reconstruct a sharp image with under-sampled data. This feature solves the problem of long acquisition time. As such, deterministic model based techniques well tackle the problems that are inherited from ghost imaging.
In this paper, we theoretically and experimentally compare these two representative deterministic model based single-pixel imaging techniques–HSI and FSI, in terms of principles, imaging efficiency, noise robustness, and etc. This comparison shows the commons and the differences between HSI and FSI. The comparison also presents the advantages and disadvantages of the both techniques.
2. Comparison of theory
2.1 Principle of HSI and FSI
HSI is based on Hadamard transform [38–40]. HSI acquires the Hadamard spectrum of the object image and reconstructs the object image by applying an inverse Hadamard transform. Hadamard spectrum is composed by a group of Hadamard coefficients. Each coefficient corresponds to a unique Hadamard basis pattern. To obtain a Hadamard coefficient, one can project the corresponding Hadamard basis pattern(s) onto the object and use a single-pixel detector to measure the resultant light intensity. The single-pixel light intensity measurement is mathematically equivalent to the inner product between the Hadamard basis pattern(s) and the object. As such, the Hadamard spectrum can be reconstructed based on the single-pixel measurements. The two-dimensional Hadamard transform of an image is defined as 38]. Hadamard transform is only applicable for input images of size -by-, where , , or is a power of 2.
A Hadamard basis pattern can be obtained by applying an inversed Hadamard transform to a delta function ,Fig. 1 is derived by substituting and into Eq. (5). Thus, it has 5 sign changes each row and 5 sign changes each column.
Differential HSI is an embodiment of HSI, allowing each Hadamard coefficient to be acquired in a manner of differential measurement [19–27]. Differential HSI is conducive to suppression of noise. As illustrated in Fig. 1, to acquire a coefficient , differential HSI takes two measurements. The one measurement is acquired by projecting a Hadamard basis pattern and the other measurement is by its inverse . The coefficient is obtained by using the two corresponding measurements
FSI is based on Fourier transform. FSI acquires the Fourier spectrum the object image and reconstructs the object image by applying an inverse Fourier transform. Fourier spectrum is composed by a group of Fourier coefficients. Each coefficient corresponds to a unique Fourier basis pattern (also known as sinusoidal pattern or fringe pattern). To obtain a Fourier coefficient, one can project the corresponding Fourier basis pattern(s) onto the object and use the single-pixel detector to measure the inner product between Fourier basis patterns and the object. As such, the Fourier spectrum can be reconstructed from the single-pixel measurements. Fourier transform was proposed in the late 1800s by Joseph Fourier and has been widely used in a number of fields. It allows any signal to be decomposed into a set of orthogonal sinusoidal waveforms of different frequencies. For example, images as two-dimensional signals are allowed to be broken down into a combination of sinusoidal intensity patterns. The two-dimensional Fourier transform of an image is defined asEq. (11) and the 3-step phase-shifting formula Eq. (12), respectively. Both embodiments allow each Fourier coefficient to be acquired in a manner of differential measurements. As illustrated by Fig. 1, 4-step FSI and 3-step FSI acquire each Fourier coefficient with 4 and 3 measurements, respectively. Please note that Fourier coefficients are complex-valued. 4-step FSI allows one to acquire each complex-valued Fourier coefficient by projecting four patterns , , and , and using the corresponding four measurements , , , and :Eq. (12), 3-step FSI is also a differential method of measurement, but in an asymmetric form. As the 4-step FSI does, the 3-step FSI has the property of noise suppression, but its performance is not as good as the 4-step FSI. It is because the 4-step FSI is a differential method of measurement in a symmetric manner while the 3-step is in an asymmetric manner. Fully sampling an -pixel image using 3-step FSI takes measurements. In comparison with 4-step FSI, 3-step reduces 25% measurements.
In short, FSI and HSI are single-pixel imaging techniques based on basis scan and theoretically allow perfect reconstruction for any images in noiseless situations.
2.2 Basis patterns generation
The core of single-pixel imaging is to employ active illumination to acquire the spatial information of a target object. Instead of using random patterns, basis-scanning single-pixel imaging techniques use deterministic basis patterns for illumination. Figure 1 shows the comparison between the Hadamard and Fourier basis patterns. The difference can be summarized as follows: 1) Hadamard basis patterns are binary and mosaics look-alike while Fourier basis patterns are grayscale and fringes look-alike; 2) Hadamard basis patterns only have horizontal and vertical features while Fourier basis patterns have horizontal, vertical, and oblique features; 3) Fourier basis patterns are strictly periodical while Hadamard basis patterns are not.
The applicability and the performance of these basis-scanning single-pixel imaging techniques rely on the effectiveness and efficiency of basis patterns generation. Thus, it is necessary to discuss the methods of basis patterns generation for HSI and FSI. Hadamard basis patterns are binary (black-and-white), which makes HSI naturally suitable for single-pixel imaging systems based on a digital micro-mirror device (DMD). As DMD is a binary device, HSI can benefit from the high-speed binary illumination ability given by a DMD. Additionally, binary Hadamard basis patterns would not lead to quantization errors or gamma (nonlinear) distortion. However, to our best knowledge, Hadamard transform does not carry clear physical meaning, which makes Hadamard basis patterns almost impossible to be generated by a physical means. The applicability of HSI relies on the use of SLM. In other words, HSI would likely have difficulties when SLMs are unavailable at certain spectral regions.
On the other hand, Fourier basis patterns are naturally grayscale. It leads to the fact that FSI is not able to take the benefit of a high-speed SLM directly. For instance, DMDs work much slower in the grayscale mode. A state-of-art DMD can display ~20,000 binary patterns per second but can only display ~250 8-bit (256 quantization levels) grayscale patterns per second. Thus, FSI suffers from slower illumination rate and therefore longer data-acquisition time than HSI. In addition, using any digital device to generate Fourier basis patterns would cause quantization errors. When the number of quantization levels is too low, the resulting quantization errors would lead to pronounced image quality degradation. Recently, Zhang et al. proposed binary FSI , a workaround that uses binary Fourier basis patterns for illumination. Binary Fourier basis patterns are generated by upsampling and then dithering the grayscale Fourier basis patterns. The shortcoming of this approach is at the expense of reduced spatial resolution. Although Fourier basis patterns are not perfectly compatible with DMDs, fortunately Fourier transform is a natural operator and has physical meaning, which enables Fourier basis pattern to be generated by some physical means. For example, an ideal thin lens can be used as a Fourier transform engine with which the Fourier transform of an object image can be obtained at the back focal plane of the thin lens. Even without a thin lens, the Fourier transform of an object image can be approximately obtained by the far-field diffraction pattern, which is subject to Fraunhofer diffraction. Thus, one can generate Fourier basis patterns by using the interference of two plane waves, which adds applicability to FSI, especially for the cases that SLMs are expensive or even not available.
In short, FSI is more flexible and variant than HSI in terms of illumination patterns generation while HSI can benefit much more from the high-speed binary DMDs.
2.3 Robustness to noise
Both HSI and FSI are robust to dark noise and read-out noise in principle, because, as evident by Eq. (1) and Eq. (8), Hadamard transform and Fourier transform are global transformation. Global transformation has a property that each point (coefficient) in the transformation domain is a weighted sum of all points in the spatial domain and each point (image pixel) in the spatial domain is also a weighted sum of all points in the transformation domain. In other words, global transformation implies that each pixel in a reconstructed image is contributed by all measurements and such an averaging process allows evening out errors in measurement. Additionally, the average flux per each Hadamard/Fourier pattern is independent of the number of pixels, and each measurement collects on average half of the total flux.
In terms of quantization errors, HSI outperforms FSI. It is because Fourier basis patterns continuously vary in space and magnitude. Thus, quantization errors will be caused when using digital devices [such as DMD or Liquid Crystal on Silicon (LCoS)] to generate Fourier basis patterns. Such errors would degenerate the quality of final reconstruction. On the other hand, Hadamard basis patterns are naturally in a discrete manner. Digital devices are able to generate quantization error-free Hadamard basis patterns.
We refer efficient single-pixel imaging to a technique that allows one to reconstruct a sharp image with a small number of measurements. Additionally, highly efficient single-pixel imaging enables time-lapse imaging. Since the throughput of a single-pixel imaging system is inherently limited by the readout rate of the single-pixel detector, it is of critical importance to improving the efficiency of single-pixel imaging techniques.
The efficiency of a basis-scanning single-pixel imaging technique depends on how well the utilized transformation concentrates the image energy. If a transformation is able to highly concentrate the image energy within a waveband (i.e., a small number of coefficients have large magnitudes), one can simply measure those large-magnitude coefficients and omit the rest to improve efficiency.
For natural images, energy is usually uniformly distributed in the spatial domain. Both Hadamard transform and Fourier transform have the ability to concentrate the image energy near the origin of their transformation domain. Thus, both HSI and FSI are able to reconstruct an imaging under Nyquist conditions by sampling coefficients with large magnitude. As will be quantitatively demonstrated in the following experimental comparison section, for natural images, Fourier transform gives a more condensed representation than Hadamard transform does. In other words, FSI outperforms HSI in terms of energy concentration.
Moreover, the physical meaning of Fourier transform gives it the capability of characterizing the impulse-response of some optical system. Optical transfer function (OTF), defined as the Fourier transform of the point spread function, shows how different spatial frequencies are handled by the system. For most optical systems, the OTF is an equivalent low-pass spatial filter. As a result, the spatial information that an imaging system can collect is low-pass filtered.
It can be seen that the characteristics of natural images and optical imaging system concentrate the image energy at the lower frequencies range of the Fourier domain. As such, it leads to rapid convergence in terms of reconstruction quality for FSI to sample the Fourier spectrum along the increment of spatial frequency.
In some diffraction-limited situations such as microscopy, the achievable spatial resolution is determined by the cut-off spatial frequency given by the diffraction limit. In this case, the optical system acts as a low-pass filter with a finite ability to resolve details. In mathematical terms, a diffracted-limited system sets a spatial cutoff frequency in the Fourier domain. Only the spatial information that falls into the circular low-frequency band with a radius of can be acquired through the system. Thus, the approach that FSI samples the Fourier spectrum along a circular path and stops at the cutoff frequency is the most effective for a diffraction-limited system in principle. If the spatial cut-off frequency of the system is given, FSI allows one to sample the circular low-frequency band only. Even if the spatial cut-off frequency is not given, FSI allows one to sample the Fourier domain along a circular path until the sampled energy is lower than a certain threshold. On the contrast, Hadamard basis patterns are actually step functions whose bandwidth is infinite. The diffraction-limited system applies low-pass filtering to the Hadamard basis patterns, resulting in blur. Consequently, undersampled reconstructions in HSI would be degraded. For HSI, the lower cut-off frequency is, the more remarkable degradation will be.
Lower spatial frequency components are typically of much larger magnitude than higher spatial frequency components, as shown in Fig. 1. This prior knowledge implies a simple but efficient sampling strategy that only low-frequency components are needed to be sampled in the data-acquisition process.
3. Comparison of experiment
3.1 Numerical simulations
We firstly compare the performance of both techniques through numerical simulations using MATLAB. In the presented simulations, we focus on the quality of reconstructed images by using both techniques, especially when the images are undersampled. It should be emphasized that the throughput of single-pixel imaging systems is, in general, lower than conventional imaging systems and undersampling is a straightforward approach to reduce the number of measurements. Undersampling refers to acquire only the low-frequency coefficients and omit the high-frequency ones, given the prior knowledge that most energy of natural images is concentrated in low-frequency bands. Since sampling strategies may change the quality of the reconstructed images, we use three different sampling strategies for HSI and FSI without losing generality. The sampling strategies refer to the path along which coefficients are to be acquired. The sampling strategies in comparison are shown in Fig. 2. We note that the origin for Fourier spectra is located at the center of the pictures while the origin for Hadamard spectra is located at the left-top corner of the pictures. Therefore, Fourier spiral path is equivalent to Hadamard square path; Fourier diamond path is equivalent to Hadamard zig-zag path; Fourier circular path is equivalent to Hadamard circular path. The resolution of all reconstructed images in the presented numerical simulations is pixels.
Three different and characterized input images are used in the comparison, the 1951 USAF test chart pattern, ‘Siemens star’ target pattern, and the Lena image. The 1951 USAF test chart pattern is a binary pattern consisting of groups of three bars with dimensions from big to small. The bars are along vertical and horizontal directions. The ‘Siemens star’ target pattern is also a binary pattern. It provides multiple contrast measurements from a wide range of spatial frequencies. Different from the USAF 1951 test chart pattern, the ‘Siemens star’ target pattern has many oblique features. The Lena image is one of the most widely used natural image in imaging system tests and has multiple gray levels. We use peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), and power ratio to quantitatively evaluate the quality of reconstructed images. Power ratio is a quantity which can evaluate the energy concentration ability, defined as power of the acquired spectrum to that of the complete spectrum ratio. Please note that, for Tables 1–3, the data in bold are the overall best results.
As the results shown in Fig. 3 and Table 1, FSI with the diamond path gives the best reconstruction for the USAF 1951 test chart pattern. With the diamond path, Fourier coefficients on both spatial frequency axes are acquired preferentially. Those Fourier coefficients corresponding to horizontal and vertical fringe patterns highly correlate with the features of the resolution target (that is, horizontal and vertical bars). Thus, FSI with diamond sampling strategy achieves better reconstruction than the others for the same sampling ratio.
As the results shown in Fig. 4 and Table 2, FSI with the circular path gives the best reconstruction for the ‘Simens star’ image. The results by HSI, as they present, are with mosaic artifacts, especially for the oblique features. It is because, Hadamard basis patterns are mosaic look-alike, but lack of oblique features.
As the results shown in Fig. 5 and Table 3, FSI outperforms HSI for the ‘Lena’ image which is a natural image. However, both techniques introduce observable artifacts when sampling ratio is too low. HSI introduces mosaic artifacts while FSI introduces ringing artifacts.
Without loss of generality, we test all images in the USC-SIPI image database . The database consists of 632 images and all the images are categorized into four groups—textures, aerials, miscellaneous, and sequences. Similarly, for every single image, we evaluate reconstruction quality of the six sampling strategies using PSNR, SSIM, and power ratio. The statistical comparison results are derived by counting the overall best for each image. The results are shown in Fig. 6. Based on the comparison results, it is found that FSI has better performance than HSI in terms of reconstruction quality in the situations of undersampling. It is also found that for natural images reconstruction circular path is the best sampling strategy for FSI and zig-zag path is the best sampling strategy for HSI.
Furthermore, we consider the case that the imaging system is diffraction-limited. We assume that the OTF of the system is an ideal low-pass filter whose cut-off frequency is pixel−1, indicated by the dash circles in Fig. 7. The ‘Baboon’ image is used as the ground truth and we reconstruct the image by HSI and FSI under different sampling ratios. HSI employs the zig-zag sampling path while FSI employs the circular sampling path. As OTF is commonly represented in the Fourier space, we give the Fourier spectrum for all reconstructions, even for those by HSI, so as to show how the OTF affects the reconstruction. As the results shown in Fig. 7, the quality of reconstructions by FSI converges after the sampling zone reaches the boundary set by the cut-off frequency. For the results by HSI, although the recovered spatial information fills up the low-pass band, the value of the recovered Fourier coefficients is inaccurate when undersampled. The coefficients are corrected gradually as the sampling ratio increases. As indicated by the curves of PSNR, SSIM, and RMSE, the convergence of HSI is lower than that of FSI.
The simulations above demonstrate that quality of sub-Nyquist sampled images depends on the energy concentration ability of the utilized transformation and the sampling strategy. For natural images, Fourier transform has better energy concentration ability than Hadamard transform, because the correlation between a Fourier basis pattern and a natural image is larger than that between a Hadamard pattern and a natural image. Or in other words, Fourier basis patterns are more similar to the natural images than Hadamard basis patterns. Thus, FSI outperforms HSI in terms of reconstruction quality under sub-Nyquist sampling conditions.
We further compare the both techniques in terms of robustness to noise. Without loss of generality, we use both the ‘Lena’ and the ‘Cameraman’ images for the test. To simulate cases of different noise levels, we add white Gaussian noise to the raw data (that is, measurements ) resulting in different SNRs. The addition of white Gaussian noise is implemented by using the built-in function awgn() of MATLAB. We jointly use PSNR, SSIM, and root mean square error (RMSE) to evaluate the reconstruction quality. The PSNRs, SSIMs and RMSEs are computed with the ground truth as reference. The results are shown in Figs. 8 and 9 and highly consistent. According to the results, HSI is more robust to FSI. It turns out that there’s a tradeoff between energy concentration and robustness against noise.
Furthermore, we examine the effect of quantization error on the quality of reconstructed image in FSI. We quantize the Fourier basis patterns under different levels. For instance, for quantization levels , the Fourier basis patterns are quantized by . The input image used in this simulation is the ‘Pepper’ image. Figure 10 shows the reconstruction for quantization levels 2, 4, 8, 16, …, 512. As the figure shows, when the number of quantization levels is 2, which equivalent to binarize the Fourier basis patterns by thresholding, it would make the reconstruction drenched into periodic artifacts. When the number of quantization levels is 4, the quantization errors result in a grid overlay on the reconstruction. The grid fades away as the number of quantization levels increases and becomes unnoticeable when the number of quantization levels is 64. It should be noted that SLMs commonly have 256 quantization levels
We further compare HSI and FSI with experimental data. The first experiment is single-pixel photography using a commercial digital projector (Acer K750) for spatial light illumination. The experimental set-up is shown in Fig. 11. The projector switches pattern every 0.2 seconds. A photodiode (HAMAMATSU S1227-1010BR) is used as a single-pixel detector. The active area of the photodiode is 1 × 1 cm2. The photodiode is driven by a customized amplifier circuit. We don’t use any lenses in front of the photodiode for light coupling and the photodiode detects the back-scattered light from the scene directly. The resultant electric signals are delivered to a data acquisition board [National Instruments USB-6343 (BNC)]. The digitalized data is finally collected by the computer. The methods in comparison are differential HSI and 4-step FSI.
The results are shown in Fig. 12. The resolution of the reconstructed images is 256 × 256 pixels. As the figure shows, the FSI presents more clear and sharp reconstructions than HSI does in the case of undersampling. The advantage of FSI is relatively observable for the sampling ratio lower than 10%. The results in this experiment coincide with those derived in the numerical simulations.
The second experiment is fast single-pixel imaging. As the experimental set-up shown in Fig. 13, we employ a DLP development kit to achieve high-speed illumination. The DLP development kit is equipped with a 0.7-inch DMD. The DMD has 1024 × 768 micro mirrors, each of which is 13.6 × 13.6 μm2 in size. The light source is a 3-watt white LED. The DMD operates at 2,000 Hz, allowing 2,000 binary patterns projection per second. The patterns generated by the DMD are projected onto the scene through a lenses system. The lenses system is removed from a commercial digital projector (Toshiba T-95). The back-scattered light is detected using a photomultipliers tube (Thorlabs PMM01). The photomultipliers tube has a self-owned collecting lens for better light coupling. The resultant electronic signals are transferred to the computer via a data acquisition board [National Instruments USB-6343 (BNC)]. The object to be imaged is some stationery and a piece of A4 paper printed an enlarged 1951 USAF resolution test pattern. The object is under illumination by basis patterns. The methods in comparison are differential HSI 3-step binary FSI, and 4-step binary FSI. The reason why we use binary FSI in this experiment for comparison is that the original FSI is not able to directly use a high-speed DMD for high-speed imaging. It is because the original FSI uses grayscale patterns for illumination, while even an edge-cutting DMD can only display ~250 8-bit grayscale patterns per second, which is a shortcoming of the original FSI.
The resolution of illumination patterns is 256 × 256 pixels. For binary FSI, the patterns are upsampled using ‘bicubic’ interpolation so that the resolution of the images becomes 512 × 512 pixels, twice of the original. Floyd-Steinberg dithering is then applied to the upsampled Fourier basis patterns. For HSI, the Hadamard basis patterns are upsampled to be 512 × 512 pixels using ‘nearest’ interpolation. The comparison results are presented in Fig. 14.
Based on the comparison results, binary FSI outperforms HSI in terms of reconstruction quality in the case of a small number of measurements. In the case of 1,000 measurements, heavy ringing artifacts present in the results of FSI while HSI gives a mosaic reconstruction. 3-step FSI is the only technique that can reconstruct the horizontal lines on the pencil holder, showing its advantage in extremely undersampled cases. In the case of 4,000 measurements, 3-step binary FSI gives better reconstruction, which is evident by that all five pencils in the holder on the right become distinguishable. In the case of 8,000, the results by both FSI techniques are satisfactory, except that there still ringing artifacts on the background while the result by HSI is of mosaic, especially for the oblique structures such as the pencil in the left pencil holder. HSI outperforms FSI in terms of uniform pattern reconstruction. The background in the reconstruction by HSI is free of artifacts or noises. In the case of 30,000 measurements, the result by HSI looks as good as those by FSI. In the case of 98,304, the result by HSI is even better than those by FSI in terms of noise level. The noise on the background of the results by FSI becomes noticeable, which is due to the quantization errors.
In short, in the case of a small number of measurements, FSI outperforms HSI for FSI has better energy concentration ability than HSI. In the case of a large number of measurements, HSI has better reconstruction quality than binary FSI. It is because binary FSI introduces quantization errors when generates binary Fourier basis patterns using dithering.
The third experiment is microscopy where we use a digital light projector (Texas Instruments LightCrafter Display 4710 evaluation module) along with a tube lens and an objective lens [Olympus 10X objective (NA = 0.4)] for illumination patterns generation. The experiment set-up is shown in Fig. 15. The DMD of the projector consists of 19201080 micro mirrors whose pitch is 5.4 microns. A Si amplified photodetector (Thorlabs PDA-100A) is used as a single-pixel detector that collects the transmitted light through the object. The model of the data acquisition board used in this experiment is National Instruments USB-6363 (BNC). The object to be imaged is a USAF1951 resolution target (Ready Optics #2015A). Please note that to make full use of the area the DMD, we use 4 × 4-pixel binning in this experiment. The resolution of illuminations patterns is 256 × 256 pixels and each pattern uses 1024 × 1024 mirrors for illumination. The illumination patterns switch every 0.2 seconds.
As the results shown, FSI presents clearer and sharper reconstruction than HSI in the case of undersampling, especially when the sampling ratio is under 10%. For instance, the digits and the bars of the 6th group become distinguishable for the results by FSI. For the full-sampled cases, HSI presents as good results as FSI does.
We present a systematic comparison between the HSI and the FSI in principle and experiments. The overall comparison is summarized in Table 4. According to the principle analysis and the experimental results, we conclude that the FSI is more efficient than the HSI as Fourier transform better concentrates image energy than Hadamard transform does. Additionally, the 3-step FSI allows measurement reduction in the case of differential measurement. Thus, for applications where efficiency is concerned, the FSI is the primary selection. We also conclude that the HSI has better noise robustness than the FSI and is perfectly suitable for DMD-based single-pixel imaging systems. Therefore, for applications where image quality or accuracy is concerned, the HSI is the primary selection.
National Natural Science Foundation of China (NSFC) (61475064); National Science Foundation (NSF) DBI 1555986; National Institutes of Health (NIH) R21EB022378 and R03EB022144.
The authors thank Dr. Shiping Li for her help with the experimental equipment preparation, and Qinqiu Fang for linguistic assistance.
References and links
1. R. H. Webb, “Confocal optical microscopy,” Rep. Prog. Phys. 59(3), 427–471 (1996). [CrossRef]
2. D. Huang, E. A. Swanson, C. P. Lin, J. S. Schuman, W. G. Stinson, W. Chang, M. R. Hee, T. Flotte, K. Gregory, C. A. Puliafito, and J. G. Fujimoto, “Optical coherence tomography,” Science 254(5035), 1178–1181 (1991). [CrossRef] [PubMed]
4. C. W. Oatley, W. C. Nixon, and R. F. W. Pease, “Scanning electron microscopy,” Adv. Electron. Electron Phys. 21, 181–247 (1966). [CrossRef]
7. D. Takhar, J. N. Laska, M. B. Wakin, M. F. Duarte, D. Baron, S. Sarvotham, K. F. Kelly, and R. G. Baraniuk, “A new compressive imaging camera architecture using optical-domain compression,” Proc. SPIE 6065, 606509 (2006). [CrossRef]
8. J. H. Shapiro, “Computational ghost imaging,” Phys. Rev. A 78(6), 061802 (2008). [CrossRef]
9. W. L. Chan, K. Charan, D. Takhar, K. F. Kelly, R. G. Baraniuk, and D. M. Mittleman, “A single-pixel terahertz imaging system based on compressed sensing,” Appl. Phys. Lett. 93(12), 121105 (2008). [CrossRef]
10. J. H. Shapiro and B. I. Erkmen, “Ghost imaging: from quantum to classical to computational,” Adv. Opt. Photonics 2(4), 405–450 (2009).
13. B. Sun, S. S. Welsh, M. P. Edgar, J. H. Shapiro, and M. J. Padgett, “Normalized ghost imaging,” Opt. Express 20(15), 16892–16901 (2012). [CrossRef]
14. S. S. Welsh, M. P. Edgar, R. Bowman, P. Jonathan, B. Sun, and M. J. Padgett, “Fast full-color computational imaging with single-pixel detectors,” Opt. Express 21(20), 23068–23074 (2013). [CrossRef] [PubMed]
15. B. Sun, M. P. Edgar, R. Bowman, L. E. Vittert, S. Welsh, A. Bowman, and M. J. Padgett, “3-D Computational imaging with single-pixel detectors,” Science 340(6134), 844–847 (2013). [CrossRef] [PubMed]
16. R. Horisaki, H. Matsui, R. Egami, and J. Tanida, “Single-pixel compressive diffractive imaging,” Appl. Opt. 56(5), 1353–1357 (2017). [CrossRef]
17. R. Horisaki, H. Matsui, and J. Tanida, “Single-pixel compressive diffractive imaging with structured illumination,” Appl. Opt. 56(14), 4085–4089 (2017). [CrossRef]
18. M. F. Duarte, M. A. Davenport, D. Takhar, J. N. Laska, T. Sun, K. F. Kelly, and R. G. Baraniuk, “Single-pixel imaging via compressive sampling,” IEEE Signal Process. Mag. 25(2), 83–91 (2008). [CrossRef]
21. C. M. Watts, D. Shrekenhamer, J. Montoya, G. Lipworth, J. Hunt, T. Sleasman, S. Krishna, D. R. Smith, and W. J. Padilla, “Terahertz compressive imaging with metamaterial spatial light modulators,” Nat. Photonics 8(8), 605–609 (2014). [CrossRef]
22. N. Radwell, K. J. Mitchell, G. M. Gibson, M. P. Edgar, R. Bowman, and M. J. Padgett, “Single-pixel infrared and visible microscope,” Optica 1(5), 285–289 (2014). [CrossRef]
23. M. P. Edgar, G. M. Gibson, R. W. Bowman, B. Sun, N. Radwell, K. J. Mitchell, S. S. Welsh, and M. J. Padgett, “Simultaneous real-time visible and infrared video with single-pixel detectors,” Sci. Rep. 5(1), 10669 (2015). [CrossRef] [PubMed]
24. S. S. Welsh, M. P. Edgar, R. Bowman, B. Sun, and M. J. Padgett, “Near video-rate linear Stokes imaging with single-pixel detectors,” J. Opt. 17(2), 025705 (2015). [CrossRef]
25. M. J. Sun, M. P. Edgar, G. M. Gibson, B. Sun, N. Radwell, R. Lamb, and M. J. Padgett, “Single-pixel three-dimensional imaging with time-based depth resolution,” Nat. Commun. 7, 12010 (2016). [CrossRef] [PubMed]
26. M. J. Sun, M. P. Edgar, D. B. Phillips, G. M. Gibson, and M. J. Padgett, “Improving the signal-to-noise ratio of single-pixel imaging using digital microscanning,” Opt. Express 24(10), 10476–10485 (2016). [CrossRef] [PubMed]
27. N. Huynh, E. Zhang, M. Betcke, S. Arridge, P. Beard, and B. Cox, “Single-pixel optical camera for video rate ultrasonic imaging,” Optica 3(1), 26–29 (2016). [CrossRef]
28. B. Lochocki, A. Gambín, S. Manzanera, E. Irles, E. Tajahuerce, J. Lancis, and P. Artal, “Single pixel camera ophthalmoscope,” Optica 3(10), 1056–1059 (2016). [CrossRef]
29. L. Martínez-León, P. Clemente, Y. Mori, V. Climent, J. Lancis, and E. Tajahuerce, “Single-pixel digital holography with phase-encoded illumination,” Opt. Express 25(5), 4975–4984 (2017). [CrossRef] [PubMed]
32. Z. Zhang, X. Wang, and J. Zhong, “Fast Fourier single-pixel imaging using binary illumination,” arXiv preprint arXiv:1612.02880 (2016).
33. L. Bian, J. Suo, X. Hu, F. Chen, and Q. Dai, “Efficient single pixel imaging in Fourier space,” J. Opt. 18(8), 085704 (2016). [CrossRef]
34. H. Jiang, S. Zhu, H. Zhao, B. Xu, and X. Li, “Adaptive regional single-pixel imaging based on the Fourier slice theorem,” Opt. Express 25(13), 15118–15130 (2017). [CrossRef]
35. B. L. Liu, Z. H. Yang, X. Liu, and L. A. Wu, “Coloured computational imaging with single-pixel detectors based on a 2D discrete cosine transform,” J. Mod. Opt. 64(3), 259–264 (2017). [CrossRef]
36. M. Alemohammad, J. R. Stroud, B. T. Bosworth, and M. A. Foster, “High-speed all-optical Haar wavelet transform for real-time image compression,” Opt. Express 25(9), 9802–9811 (2017). [CrossRef] [PubMed]
37. S. Mallat, A Wavelet Tour of Signal Processing: The Sparse Way (Academic, 2008).
38. W. K. Pratt, J. Kane, and H. C. Andrews, “Hadamard transform image coding,” Proc. IEEE 57(1), 58–68 (1969). [CrossRef]
40. J. Gourlay, P. McOwan, D. G. Vass, I. Underwood, and M. Worboys, “Time-multiplexed optical Hadamard image transforms with ferroelectric-liquid-crystal-over-silicon spatial light modulators,” Opt. Lett. 18(20), 1745–1747 (1993). [CrossRef] [PubMed]