In this paper, we present the design and experimental demonstration of a snapshot imaging spectrometer based on channeled imaging spectrometry (CIS) and channeled imaging polarimetry (CIP). Using a geometric phase microlens array (GPMLA) with multiple focal lengths, the proposed spectrometer selects wavelength components within its designed operating waveband of 450–700 nm. Compared to other snapshot spectral imagers, its key components are especially suitable for roll-to-roll (R2R) rapid fabrication, which gives the spectrometer potential for low-cost mass production. The principles and proof-of-concept experimental system of the sensor are described in detail, followed by lab validation and outdoor measurement results which demonstrate the sensor’s ability to resolve spectral and spatial contents under both experimental and natural illumination conditions.
© 2019 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
An imaging spectrometer samples the irradiance across a two-dimensional (2D) scene at multiple wavelengths. The acquired information forms a three-dimensional (3D) datacube denoted by coordinates x, y and λ. Compared to common broadband imaging, the additional spectral information can be utilized for applications in various domains such as remote sensing, biomedical diagnosis, and astronomical imaging [1–3]. Depending on the approaches of acquiring both spatial and spectral contents, imaging spectrometers can be divided into two categories: scanning imaging spectrometers and snapshot imaging spectrometers [4,5].
Scanning imaging spectrometers obtain the 3D datacube through spatial or spectral scanning in a time-sequential fashion. For instance, a whiskbroom or pushbroom imaging spectrometer records selected spectral components of a pixel or a line at a time and completes the 2D scene through physical scanning [6,7], while an interferometric spectral imager, such as the Infrared hyperspectral imaging polarimeter (IHIP) scans through different wavelengths and captures a 2D image at each individual wavelength [8,9]. Different from spectral imaging scanners, snapshot imaging spectrometers acquire the 3D datacube with a single measurement, which often involves trade-offs between spectral resolution and spatial resolution, spectral resolution and signal-to-noise-ratio (SNR), etc. The acquisition time is only limited by the exposure time of the camera. In the recent years, with new optical materials and components becoming available, various snapshot imaging spectrometer designs have been developed. However, compared to scan-based imaging spectrometry technologies, snapshot imaging spectrometry technologies are still scarce . Some of the notable snapshot imaging spectrometers developed in the past 30 years include: the computed tomography imaging spectrometry (CTIS) technique first invented in 1991/1992, which simultaneously projects the image of the 2D scene onto a spatial plane with different directions and reconstruct the spectral information using computed tomography algorithms [11,12]. The image slicing/mapping spectrometer (ISS/IMS) that was first invented for astronomical applications and recently adapted for hyperspectral fluorescence microscopy [13,14]. The coded aperture snapshot spectral imager (CASSI) which combines coded aperture spectrometry with compressed sensing technique . The image replicating imaging spectrometer (IRIS) which is a generalization of Lyot filter . And the snapshot hyperspectral imaging Fourier transform spectrometer (SHIFT) recently developed by Kudenov et. al. . Other generalized architectures are discussed in the review paper of .
In this paper, we report a snapshot imaging spectrometer design which simultaneously records both spatial and spectral information using a pair of polarization gratings (PG), a geometric phase microlens array (GPMLA) that has multiple focal lengths, and a common focal plane array (FPA) sensor. Compared to the complicated and hard-to-fabricate components in other snapshot spectral imagers, the PGs and GPMLA in the proposed spectrometer have great potential to be rapidly fabricated with roll-to-roll (R2R) processing due to the recent improvement in geometric phase hologram (GPH) technique [18,19]. Section 2 and section 3 discusses the working principles of the proposed device, system models, and radiometric/spatial resolution tradespace. Section 4 overviews the proof-of-concept experimental setup and its alignment test results. Lastly, section 5 demonstrates outdoor measurement results using the experimental setup and compares them to the results acquired from an Ocean Optics USB2000 modular spectrometer.
2. Principle of operation
The Geometric Phase Hologram Imaging (GPHI) spectrometer modulates all incident light onto a spatial carrier frequency, generated using two parallel PGs, and selects wavelength components by using a multi-focus GPMLA. A schematic of the system is depicted in Fig. 1. Light from the object first transmits through fore-optics made of an objective lens, a field stop and a collimating lens, which eliminates the overlapping of spectral sub-images formed by adjacent lenslets. Light then passes through a linear polarizer LP1, before transmitting through a pair of PGs (PG1 and PG2) separated by a distance t. Both PGs have identical spatial frequencies and are used for creating two chromatically sheared beams . Since both beams have orthogonal polarization states, they are analyzed by a second linear polarizer LP2 to enable interference. A quarter wave plate (QWP) is placed after LP2 to convert the linear polarization state into circular polarization, thus ensuring that only the GPMLA’s positive focal position is used. The light is finally focused onto the FPA by a GPMLA. This is fabricated such that each lenslet focuses a different wavelength a fixed distance f0 away from the GPMLA. This creates a spectral dependence on the defocus modulation transfer function (MTF) of each lenslet, which filters the PG’s achromatic carrier frequency. The spatial modulation enables the individual spectral components to be extracted using 2D Fourier processing, similar to .
As per , the intensity measured by the FPA, in response to the shear generated by PG1 and PG2, can be calculated by
For this system, LP1 modulates the incident S0 component into S1 such that S1 = S0 and S2 = 0. Furthermore, the spectral content of S0 is also modulated onto the carrier frequency by the GPMLA’s defocus, as modeled by its modulation transfer function versus wavelength. The spectral resolution of each lenslet depends upon a given lenslet’s aperture size, focal length, back focal distance, and the spatial frequency of the carrier. A schematic, describing the pertinent parameters of each lenslet, is illustrated in Fig. 2.
Two linear systems models were produced based on: (1) geometrical optics; and (2) scalar diffraction theory. We note that, while the geometrical model offers greater error (approximately 10%, as will be discussed shortly), it enables a faster calculation and conceptual understanding of the filtering mechanisms involved with the concept.
As provided in Eq. (1), the shear creates a spatial carrier frequency across the FPA. This is filtered by the lenslet’s MTF response versus wavelength, such that a spectral passband is created via. spatial filtering. The spatial contrast of the carrier was first calculated by geometrical optics in one dimension. The focal length of each wavelength can be calculated as
From Fig. 2, given Δz = f0 - fλ, the width of the geometrical point spread function (PSF) w for an FPA located at plane f0 imaging a wavelength λ can be calculated as22]. Fourier transformation of this yields the MTF as
The full width at half maximum (FWHM) spectral bandwidth of each lenslet is thus
In addition to the 1D geometrical model, we also produced a more rigorous 2D model based on scalar diffraction theory and the transfer function of free space . The defocus wavefront error, across the pupil, is defined as23] for defocus can be calculated as
The PSF was calculated at each wavelength, using the wavefront aberrations defined by Eq. (9) at each value of Δz, corresponding to a given . The MTF was then calculated as the absolute value of the PSF’s Fourier transformation to yield a 3D function, where Δz is implicitly dependent on wavelength. The relative spectral transmission function of the lenslet was calculated as
The geometric 1D model was used to calculate the FWHM spectral bandwidth as depicted in Fig. 3. This quantity scales inversely with respect to the factor Dξ0 and it scales linearly with respect to the design wavelength. While not explicitly presented here, the scalar diffraction model follows a similar trend with an additional weak dependence on the focal length f0 given a fixed lenslet diameter D. This implies that there is a higher-order focal-ratio dependence that does not appear in the geometrical model. Error between the geometrical and scalar diffraction models, as compared to the experimental data, are provided in section 4. From our results, this focal-ratio dependence increases the geometrical calculation of the FWHM by approximately 10%.
Finally, the total intensity of the light, accounting for the spectral distribution and the lenslet’s MTF response and integrated over wavelength, can be expressed asFig. 4, 2-dimensional (2D) Fourier transformation of Eq. (15) yields three channels: C0 at baseband and C1 and its conjugate at a spatial frequency ± ξ0  such that
Computationally, this amounts to applying two fast Fourier transforms and a matrix multiplication to apply the bandpass filter. For a datacube on a 5 megapixel image, this can be achieved in 0.18 seconds in Matlab on a Xeon E5-26XX v2 2.4 GHz CPU.
3. Radiometric and spatial resolution tradespace
A radiometric model was created to assess the spectrometer’s signal to noise ratio (SNR) tradespace as related to the carrier frequency and FWHM spectral bandwidth. This tradeoff is more stringent when compared to a multi-aperture filtered camera, since the out-of-band light remains coincident with the in-band light. Thus, the shot noise present in the C0 channel will be distributed into the C1 channel, reducing the overall SNR. A Monte Carlo simulation was produced in which a spatially and spectrally uniform scene was generated. The scene consisted of 100 spectral bands spanning 400 to 800 nm with a signal consisting of 25 e-/nm. Equation (15) was used to simulate the modulated intensity across a 500 × 500 pixel subimage containing 2 µm2 pixels. All calculations were conducted at λ0 = 550 nm for FWHM spectral bandwidths spanning 5-50 nm in 5 nm increments for three spatial carrier frequencies ξ0 of 30, 50, and 80 cycles/mm. Finally, shot noise was simulated across 100 trials and a spatial filter, based on a Hanning window, was used to extract the channel data. The window was defined as24]. Finally, the SNR was calculated for each case and averaged across all trials, the results of which are depicted in Fig. 5 as dashed lines for each simulated ξ0. As expected, the SNR decreases with decreasing FWHM spectral bandwidth. At a 5 nm FWHM, the SNR spans 58-67 while at 50 nm, it spans 340-473 across the simulated range of ξ0.
For comparison, the same Monte Carlo analysis was also used to calculate the SNR of a dichroic filtered camera assuming the filter had a peak transmission of 70% and the same sinc transmission function τ, per Eq. (14), was used. Furthermore, the same window function in Eq. (19) was used such that the spatial noise bandwidth was identical for both systems; however, the filter was placed around the baseband C0 channel with wh = ξ0/2, α = 0, and ꞵ = 0. Results from this simulation are depicted in Fig. 5 as solid lines. Also as expected, the SNR is higher for the dichroic filter. At a 5 nm FWHM, the SNR spans 370-570 while at 50 nm, it spans 900-1500 across the simulated range of ξ0.
From these results, a multi-aperture filtered camera (MAFC) obtains approximately 7.5 times greater SNR than the GPMLA spectral filtering technique. Additionally, it offers a higher potential spatial resolution. Therefore, the advantages of the GPMLA lie in fabrication and size. Specifically, the MAFC requires refractive lenslets paired with a wide range of dichroic filters, each of which must be fabricated with a different process; in this case, 100 different filters. Note that, while wedge filtering techniques also exist that reduce the number of filters needed, their FWHM spectral bandwidth is usually limited and has a strong-tradeoff against the spectrometer’s total spectral range (e.g., 5 nm FWHM can be achieved over a 50 nm bandwidth, or 30 nm over 300 nm) . Conversely, the GPMLA can be fabricated with a single process that can be made roll-to-roll and both the spatial image formation and spectral filtering optics are fabricated simultaneously, enabling a reduced cost spectral imaging solution. Such devices could be paired with e.g., mobile phone cameras to enable spectral imaging at reduced cost, and all components can be laminated into planar structures and distributed as pre-aligned monolithic modules. A final analysis includes assessing the total number of required FPA pixels needed to obtain a sub-image of a certain size (Nx × Ny pixels) given a margin of s pixels between sub-images and a total number of Nw spectral bands. In accordance with the analysis of , the total number of FPA pixels required is
4. Experimental setup and lab validation
To validate the principles explained in previous sections, a proof-of-concept experimental setup was built on the benchtop, as per Fig. 6. The GPMLA proof of concept used 6 × 7 square lenslets that were designed to focus spectra from 400 to 810 nm in 10 nm increments. Each lenslet had a size of 1 × 1 mm and the GPMLA was mounted on an xy translational stage to allow easier alignment between the lenslets and the camera plane. The distance between the lenslet array and the camera’s photosensitive area was 8.8 mm, which is the nominal value of f0 in the prior models. The camera was an Allied Vision (AVT) GX2750 GigE camera with a 4.54 × 4.54 µm pixel size. The two PGs had a spatial period of Λ = 100 µm and were separated by a distance t = 12.8 mm, yielding a carrier frequency of ξ0 = 29 cycles/mm. Thus, the proof of concept had a maximum spatial resolution of 14.5 cycles/mm after spatial filtering. It should be noted that, with further optimization within a future experimental prototype, the carrier frequency could be reasonably increased to 55 cycles/mm (or more generally, 4 pixels per fringe) for a maximum spatial cutoff frequency of 27.5 cycles/mm. This would require PGs with a spatial period of Λ = 52.7 µm using the same separation t = 12.8 mm or, alternatively, achieving more compactness using a smaller spatial period Λ = 4 µm with t = 1 mm.
For spectral calibration, the center wavelength of each lenslet must be characterized. This was achieved by illuminating an integrating sphere with a monochromator and configuring the system to view the sphere’s exit port. The monochromator was then scanned for wavelengths spanning 400-700 nm in 5 nm increments; although only 470-700 nm were used in our reconstructions due to the lower blue response of our setup. A view of raw data from the monochromator experiment is presented in Figs. 7(a)-7(c), illustrating how the interference fringe’s contrast moves between the lenslets as the wavelength is increased to 470, 550, and 650 nm, respectively.
The monochromator’s measurements were used to quantify the spectral transmission of three lenslets in the array. These were then compared to the predicted spectral transmittances, developed previously, using both the geometrical and scalar diffraction models. A view of the spectral transmittances versus wavelength for the 470 nm, 570 nm, and 650 nm lenslets are illustrated in Fig. 8(a). As expected, the 2D scalar diffraction model offers a closer match to the measured values than the simpler 1D geometric model. To further quantify this, the FWHM spectral bandwidth of each lenslet was calculated by fitting an ideal sinc function to the normalized spectral transmission functions, measured by the monochromator. A plot of the FWHM spectral bandwidth, calculated for each lenslet, as compared to the geometrical and scalar diffraction models’ predictions are presented in Fig. 8(b). RMS error between the experimental results and the diffraction and geometrical models was calculated to be 0.56 nm and 4.29 nm, respectively. For this system, the geometrical model under-estimates the FWHM spectral bandwidth by a factor of 0.86 across the spectral passband. However, its relative simplicity offers rapid first order calculations, while simultaneously offering a conceptual framework for the sensor’s spatial-spectral filtering mechanism.
To verify the device’s calibration, red, green, white, blue and yellow NIST-traceable spectralon tiles were imaged. In the lab, data images of the spectralon tiles were captured by the prototype under the same illumination provided by a xenon lamp. The spectral images were obtained by applying FFT, Fourier domain filtering and inverse FFT to the data images as described earlier. To compare the results from the proof-of-concept setup with corresponding NIST standards, image registration must be applied to spectral sub-images on the spectral images. To calculate image registration coefficients, a 2D target with high spatial frequency content was recorded by the spectrometer and the full image was divided into individual spectral sub-images. Using the spectral sub-image at 520 nm as a primary reference, the image registration coefficients were calculated by applying a spatial image registration algorithm to all the other spectral sub-images . The coefficients were then applied to spectralon tiles’ results.
The reflectance of each colored tile was calculated by normalizing the intensities on its spectral sub-images to the intensities of the white tile. Figure 9 depicts the reflectance curves measured by the prototype along with corresponding NIST standard curves for the same tiles. The measured curves were averaged from a 10 × 10 pixel area on the spectral sub-images. As can be seen, from 470 nm to 740 nm, the measured reflectance curves closely fit the NIST standard curves, indicating that each lenslet was only bringing polarization fringes at its designated wavelength to focus. RMS error, calculated between the measured and standard curves, is provided in Table 1.
5. Outdoor imaging and measurement results
In addition to the lab validation, the prototype was also used to image an outdoor environment to test its ability of resolving spatial and spectral content, of a 2D scene, under typical sunlight illumination. An outdoor scene that contained a blue car, plants, and red brick, as depicted in Fig. 10(a), was measured and processed with the aforementioned procedures. The 28 lenslets on the GPMLA were arranged as illustrated in Fig. 10(b), in which each lenslet is denoted by the wavelength of primary focus. The raw data image, as captured by the FPA, is depicted in Fig. 10(c) and a magnified view of one sub-image is presented in Fig. 10(d). This demonstrates the carrier frequency associated with the scene’s 650 nm light. Finally, Fig. 10(e) depicts the spatially filtered spectral sub-images.
After image registration, the spectra of three locations in the scene, which belong to the (1) car; (2) brick; and (3) plants, as illustrated in Fig. 11(a), were generated by normalizing their spectral intensities to that of the scene’s asphalt. The asphalt’s reflectivity was separately calibrated against a NIST-traceable white spectralon tile under the same illumination conditions. Spectral responses from these three locations were also measured by an Ocean Optics USB2000 modular spectrometer as references. The normalized spectral curves from the two spectrometers are drawn together in Figs. 11(b)-11(d). The RMS error, calculated for the car’s, brick’s, and plant’s reflectivity was calculated to be 9.2%, 6.1%, and 9.2%, respectively, for wavelengths spanning 475-700 nm. These errors are generally higher than the indoor testing, by a factor of 2.5 on average, which is likely due to issues related to the use of 10 × 10 pixel averaging that was performed in the laboratory data as opposed to the 1 × 1 pixel sampling demonstrated here. We also attribute some issues due to the use of off-the-shelf optomechanics, configured using free-space holders, which could be the cause of some artifacts in the data – most notably around 550 and 620 nm. These peaks appear in both the brick and leaf reflectivity and may be indicative of a systematic error in the setup. Future work will focus on developing a higher order model of these errors within the framework of a more robust prototype sensor.
A Geometric Phase Hologram Imaging (GPHI) spectrometer has been presented in this paper, together with theoretical models and experimental validation results. While the 2D scalar diffraction model provides predictions that more closely match the experimental spectral results, the simpler 1D geometric model supports rapid calculations and provides a conceptual framework for the sensor’s filtering mechanism. A proof-of-concept experimental system was built and calibrated in lab. The calibrated system showed good accuracy in measuring the spectral characteristics of NIST-traceable spectralon tiles in a lab environment. To validate the experimental system’s performance with natural illumination, it was used to record an outdoor scene under sunlight. The results were compared to those from an Ocean Optics USB2000 spectrometer, which showed good conformity. Potential application fields of the proposed spectrometer include agricultural sensing, remote sensing, biomedical imaging, food inspection, and quality control. Compared to the existing technologies, the configuration of our system is especially suitable for high speed R2R manufacturing process, which gives it a potential advantage in manufacturing speed and cost.
National Institutes of Health award number 1R21EY022174.
3. L. Weitzel, A. Krabbe, H. Kroker, N. Thatte, L. E. Tacconi-Garman, M. Cameron, and R. Genzel, “3D: The next generation near-infrared imaging spectrometer,” Astron. Astrophys. Suppl. Ser. 119(3), 531–546 (1996). [CrossRef]
4. R. G. Sellar and G. D. Boreman, “Classification of imaging spectrometers for remote sensing applications,” Opt. Eng. 44(1), 013602 (2005). [CrossRef]
5. M. R. Descour, C. E. Volin, E. L. Dereniak, K. J. Thome, A. B. Schumacher, D. W. Wilson, and P. D. Maker, “Demonstration of a high-speed nonscanning imaging spectrometer,” Opt. Lett. 22(16), 1271–1273 (1997). [CrossRef] [PubMed]
6. C. G. Simi, E. M. Winter, M. M. Williams, and D. C. Driscoll, “Compact airborne spectral sensor (COMPASS),” in Algorithms for Multispectral, Hyperspectral, and Ultraspectral Imagery VII SPIE, 4381, pp. 129–137 (2001).
7. M. W. Kudenov, M. E. Lowenstern, J. M. Craven, and C. F. LaCasse, “Field deployable pushbroom hyperspectral imaging polarimeter,” Opt. Eng. 56(10), 103107 (2017). [CrossRef]
8. J. Craven-Jones, M. W. Kudenov, M. G. Stapelbroek, and E. L. Dereniak, “Infrared hyperspectral imaging polarimeter using birefringent prisms,” Appl. Opt. 50(8), 1170–1185 (2011). [CrossRef] [PubMed]
9. Y. Wang, M. W. Kudenov, and J. Craven-Jones, “Phase error in Fourier transform spectrometers employing polarization interferometers,” in Polarization: Measurement, Analysis, and Remote Sensing XI SPIE, 9099, p. 90990K (2014).
12. M. R. Descour, C. E. Volin, E. L. Dereniak, T. M. Gleeson, M. F. Hopkins, D. W. Wilson, and P. D. Maker, “Demonstration of a computed-tomography imaging spectrometer using a computer-generated hologram disperser,” Appl. Opt. 36(16), 3694–3698 (1997). [CrossRef] [PubMed]
13. L. Gao, R. T. Kester, N. Hagen, and T. S. Tkaczyk, “Snapshot Image Mapping Spectrometer (IMS) with high sampling density for hyperspectral microscopy,” Opt. Express 18(14), 14330–14344 (2010). [CrossRef] [PubMed]
17. N. Hagen and M. W. Kudenov, “Review of snapshot spectral imaging technologies,” Opt. Eng. 52(9), 090901 (2013). [CrossRef]
18. G. T. McCollough, C. M. Rankin, and M. L. Weiner, “6.1: Roll-to-Roll manufacturing considerations for flexible, Cholesteric Liquid Crystal (ChLC) Display Media,” SID Symp. Dig. Tech. Pap. 36(1), 64–67 (2005). [CrossRef]
19. H. Sato, K. Miyashita, M. Kimura, and T. Akahane, “Study of liquid crystal alignment formed using slit coater,” Jpn. J. Appl. Phys . 50(1S2), 01BC16 (2011).
20. M. W. Kudenov, M. J. Escuti, E. L. Dereniak, and K. Oka, “White-light channeled imaging polarimeter using broadband polarization gratings,” Appl. Opt. 50(15), 2283–2293 (2011). [CrossRef] [PubMed]
21. M. W. Kudenov, M. E. L. Jungwirth, E. L. Dereniak, and G. R. Gerhart, “White-light Sagnac interferometer for snapshot multispectral imaging,” Appl. Opt. 49(21), 4067–4076 (2010). [CrossRef] [PubMed]
22. J. D. Gaskill, Linear Systems, Fourier Transforms, and Optics (IET, 1978).
23. R. Kingslake and R. R. Shannon, eds., Applied Optics and Optical Engineering. (Academic, 1992, Vol. XI, Chap. 4).
24. Y. Wang, M. Kudenov, A. Kashani, J. Schwiegerling, and M. Escuti, “Snapshot retinal imaging Mueller matrix polarimeter,” in Polarization Science and Remote Sensing VII SPIE, 9613, p. 96130A (2015).
25. T. A. Mitchell and T. W. Stone, “Compact snapshot multispectral imaging system,” United States patent US8027041B1 (September 27, 2011).