Abstract
We present a new folded dual-view oblique plane microscopy (OPM) technique termed dOPM that enables two orthogonal views of the sample to be obtained by translating a pair of tilted mirrors in refocussing space. Using a water immersion 40× 1.15 NA primary objective, deconvolved image volumes of 200 nm beads were measured to have full width at half maxima (FWHM) of 0.35 ± 0.04 µm and 0.39 ± 0.02 µm laterally and 0.81 ± 0.07 µm axially. The measured z-sectioning value was 1.33 ± 0.45 µm using light-sheet FWHM in the frames of the two views of 4.99 ± 0.58 µm and 4.89 ± 0.63 µm. To qualitatively demonstrate that the system can reduce shadow artefacts while providing a more isotropic resolution, a multi-cellular spheroid approximately 100 µm in diameter was imaged.
Published by The Optical Society under the terms of the Creative Commons Attribution 4.0 License. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI.
1. Introduction
Light-sheet fluorescence microscopy (LSFM) [1,2] provides optically sectioned fluorescence imaging with low photobleaching and photoxicity to the sample [3]. LSFM traditionally uses separate objective lenses to provide sheet-like laser illumination for fluorescence excitation and to provide orthogonal fluorescence detection. A key advantage of LSFM is that, as the sample is often suspended in a tube between the two objectives, multiple views can be obtained conveniently through physical rotation of the specimen that can then be fused together in post processing [3]. The immediate benefits of multi-view imaging and fusion are a more uniform image contrast across the specimen when the sample size is comparable or larger than the scattering length, and a reduction in shadowing artefacts caused by refractive index variations or regions within the specimen that absorb excitation light. When combined with deconvolution approaches, multi-view fusion provides a more isotropic and an improved spatial resolution [4–6]. A comprehensive discussion and demonstration of the benefits of multi-view fusion is provided by Swoger et al. [7]. For example, in the case of dual-view inverted selective plane illumination microscopy (diSPIM), an isotropic spatial resolution of 330 nm was achieved using two views and illumination/detection objective lenses with an NA of 0.8 [6]. Shadowing artefacts can also be reduced by angle dithering the illumination sheet [8], digitally-scanned light-sheet illumination [9] or multidirectional illumination [10]. These methods may be combined with multi-view fusion to provide further reduction of shadow artefacts.
Following the development of conventional two-objective LSFM, the method of oblique plane microscopy (OPM) has been developed to enable LSFM using a single microscope objective to illuminate the specimen and collect the resulting fluorescence [11]. This approach was extended through remote axial scanning of the light-sheet and detection planes, which achieved near-video-rate 3D fluorescence imaging using EMCCD camera technology [12] and 2-colour video-rate 3D fluorescence imaging using sCMOS camera technology [13]. The OPM approach has also been demonstrated for stage-scanned imaging of multi-well plates [14]. Remote lateral scanning of the light-sheet and detection planes was achieved using a rotating polygon mirror [15] and galvo mirrors [16,17]. Folding the remote-refocussing system about a small tilted mirror placed in the focal plane of the second microscope objective [18,19] can be used to increase the numerical aperture of the third microscope objective in the remote-refocussing system [20]. The NA of the third microscope objective can also be increased by using a microscope objective with an NA that approaches unity but with a very small working distance and a front element shaped to allow its close approach to the second microscope objective [21,22].
While OPM has fewer constraints in terms of sample preparation and the ability to easily image large arrays of specimens in multiwell plates, it does not have the benefits of multi-view LSFM.
In this paper, we present a novel, folded OPM configuration that enables two separate orthogonal views of the specimen to be achieved. Only a single mechanical actuator is required in order to scan the light-sheet and detection plane through the specimen and to switch between the two orthogonal views. This approach enables the benefits of dual-view SPIM to be obtained when performing OPM.
2. Methods
2.1 Optical setup
The dual-view OPM (dOPM) optical configuration is shown in Fig. 1(a) & (b). For excitation, a multi-wavelength cw laser engine (Omicron LightHUB) is coupled into a polarisation-maintaining single mode fibre (PMF) and the output is collimated by a 10× air objective (O4, RMS10X, Thorlabs). In order to maximise transmission of linearly polarised excitation light through the folded remote refocussing setup, a visible quarter-wave plate QWP1, (AQWP10M-580, Thorlabs) after O4 is used to generate a circularly polarised beam. The beam is then split into two paths by a visible 50/50 beam-splitter cube (BS, CCM1-BS013/M, Thorlabs). The two beams are then routed by silver mirrors (M1, M3 & M4, PFE10-P01, Thorlabs). In the transmission path of the BS, mirror M1 centres the collimated beam on a cylindrical lens (CY1, 50 mm focal length, LJ1695RM50, Thorlabs). The focal plane of the cylindrical lens is matched to the back focal plane of a 4× air objective lens (O5, RMS4X, Thorlabs) to generate a light-sheet in the front focal plane of O2/3. Mirror M2, (MRA03-E02, Thorlabs) then reflects this beam so that it is then at +45° to the optical axis of O2/3 (20×, 0.75 NA, Nikon, MRD00205), see Fig. 1(b). Similarly, in the reflection path of the BS, steering mirrors M3 & M4, a cylindrical lens (CY2, 50 mm focal length, LJ1695RM50, Thorlabs) and a x4 air objective lens (O6, RMS4X, Thorlabs) generate a light-sheet at −45° to the optical axis of O2/3, see Fig. 1(a). The resulting calculated NA of the illumination beam in the sample space is 0.033.
As shown by Fig. 1(a) & (b), the light-sheets formed by O5 and O6 are aligned to have their waists coincide with the remote-refocus space of a remote-refocus system formed by the primary (O1 and TL1) and secondary (O2/3 and TL2) microscopes. In this refocus space, a pair of small dielectric coated mirrored prisms held together on a custom mount are used to generate two oblique light-sheets for OPM imaging with two views 90° apart. The mirrored prisms (M2 & M5, MRA03-E02, Thorlabs) are angled with their normal at ±22.5° to the optical axes of O1 and O2/3 to generate light-sheets tilted by ±45° relative to the optical axis of the remote-refocusing optics. Fig. S1 shows the mechanical design of the mount used to hold the two prisms. When the M2&M5 assembly is positioned so that M2 is in use for imaging View 1, the second illumination beam reflected off M5 is dumped onto the outer casing of O2/3 and vice versa. The folded remote-refocus system is designed for imaging aqueous samples (S in Fig. 1(a)), and the total magnification from S to the remote-refocus space was therefore chosen to be 1.33. The first microscope is based on a Nikon Ti2 Eclipse microscope frame with a 200 mm Nikon tube lens (TL1) and water immersion objective (O1, 40×, Nikon, 1.15 NA, .6 mm WD, MRD77410). The second microscope consists of an air objective O2/3 and a Plössl-style tube lens (TL2, effective focal length 300.8 mm, pair of achromats AC508-1000-A-ML & AC508-400-A-ML, Thorlabs, with achromat spacing of 68 mm optimised in Zemax). A precision #1.5 coverslip (CG15NH1, Thorlabs) is fixed with Blu Tack adhesive directly to the front surface of O2/3 to account for coverslip correction of O2/3. The mount for mirrors M2 & M5 is fixed on a linear actuator (PIMag, V 522.1AA & C-413 Motion Controller), with motion direction shown by the white doubled-ended arrow in Fig. 1(a) & (b). This single linear actuator is used to both switch between View 1 (Fig. 1(a)) and View 2 (Fig. 1(b)) and to sweep the light-sheet and plane imaged across the remote refocus image space and therefore across the sample space, S.
The planes illuminated by the two light-sheets are imaged by the folded remote-refocus setup. In detection, M2&M5 correct for the tilted fluorescence image and perform de-scanning so that the image can be formed on a static camera sensor normal to the optical axis. A second visible quarter wave-plate, QWP2 (AQWP10M-580, Thorlabs) and visible polarising beam splitter (PBS, CCM1 PBS251/M, Thorlabs) allows fluorescence signal from the sample to first transmit through the PBS, be refocused at O2/3 and M2 or M5, reflect vertically from the PBS and be directed horizontally by M6 towards the camera. A pair of emission filters (EM, Semrock, FF03-525/50-25) are used to reject unwanted laser light before fluorescence is imaged by a Plössl-style tube lens, TL3, (effective focal length 375 mm, pair of achromats AC508-750-A-ML & AC508-750-A-ML, Thorlabs) onto a sCMOS camera (ORCA-Fusion, C14440-20UP, Hamamatsu). To achieve the maximum detected fluorescence signal, we orientated the PBS so that it transmits light polarised with its E-field perpendicular to the plane of Fig. 1(a) & (b)). As noted by Zhang et al. [23], the orientation of the PBS results in the excitation beam being polarised perpendicular to the plane of the figure at the sample. It also results in fluorescence emission that is polarised perpendicular to plane of figure in the sample being transmitted by the PBS on its return from the sample as it propagates towards O2/3. The reflected fluorescence light after its double pass through O2/3 and QWP2 is then polarised in the plane of the figure and so is reflected upwards out of the plane of Fig. 1(a) & (b) and is reflected back to into the plane of the figure by 45° fold mirror M6 placed immediately above the PBS.
In Fig. 1(c) & (d) the 3D plots show the geometry of the volumes scanned in the sample space for the two views. The volume swept in View 1 is shown in green and corresponds to an OPM plane that is rotated anti-clockwise about the x-axis. Similarly, the volume swept in View 2 is shown in magenta and corresponds to an OPM plane that is rotated clockwise about the x axis. It can also be seen that the volumes are parallelepipeds, which is due to the remote refocussing scanning method and is discussed in more detail in section 2.6. Figure 1(e) shows the two views superimposed for multi-view fusion. Further detail of the ray paths is shown in Fig. S3.
To determine the overall magnification of the OPM microscope, a resolution test target (RES-1, Newport) was imaged. The magnification was determined to be 50.8, corresponding to a pixel size of 0.128 µm in sample space.
2.2 Computer hardware
A Tesla-Station Pro-XL workstation (7049GP-TRT, SuperMicro) with Nikon Elements Advance Research software (NIS-Elements) was used to control the microscope acquisition. LabVIEW and DCAM were also used to enable image capture when higher frame rates were required.
2.3 Image acquisition and analysis of 200 nm fluorescence beads
The NIS-Elements software controlled a DAQ box (USB-6343, NI) to generate TTL signals to synchronise the camera exposure with the laser illumination. The linear actuator controller was configured to respond to an analog voltage from the DAQ box.
The linear actuator controlling the position of M2 and M5 was set to scan ±106.8 µm along the z axis and about the zero remote refocus positions for each view. When scanning across each view’s volume, the linear actuator was synchronised with the camera in a ‘step and settle’ motion. Following each step, the actuator was configured to settled for 10 ms before each camera image was acquired. The linear actuator position was incremented in steps of 1.22 µm which corresponds to 0.649 µm steps along each view’s z-axis in sample space (see section 2.6 for detail on relation between actuator position and sample plane position) resulting in 329 planes per view.
TetraSpeck Microspheres, 0.2 µm (T7280, Thermofisher) were imaged with the dOPM system when embedded in agarose gel formed by aqueous agarose (1% agarose) in a glass bottomed dish (35 mm diameter, #1.5 thickness glass bottom dish, MatTek). Compared to the stock solution of beads, the final solution was diluted by a factor of 40. Fluorescence was excited by a 488 nm laser and detected across a 525/50 nm (central wavelength/band pass) emission bandpass. The average laser excitation power at the sample was 100 µW.
The camera was configured to run in rolling shutter mode with a full frame (2304 × 2304 pixels, corresponding to a field of view of 295 × 295 µm2 in the sample) and was software triggered. The camera exposure time of 200 ms was synchronised with a flash of the excitation laser, so that the laser was on for the full duration of the camera exposure time. The total acquisition time was approximately 140 seconds. The acquisition speed was limited by software triggering of the camera and the long exposure times compared to the camera readout time of ∼10 ms. Higher speeds are possible with hardware triggering and shorter exposure times, see section 2.5.
To quantify the spatial resolution following de-skewing and with or without deconvolution (see sections 2.6 & 2.7 below respectively), we extracted a sub-volume around each bead centre of mass. We then took orthogonal line profiles through the bead centre of mass and performed a nonlinear least-squares fit to a Gaussian curve with adjustable width, height, offset and central peak position in order to determine the point spread function (PSF) full width at half maxima (FWHM). To assess the optical sectioning performance, we also laterally integrated the sub-volume in the x and y-directions and fitted a Gaussian curve to the resulting profile to obtain the z-sectioning FWHM as described by Wilson [24], see eq. 22 of this reference.
2.4 Image acquisition of 100 nm fluorescence beads
The acquisition was the same as described in detail in following Section (2.5) except lower frame rates of 10 fps and a smaller field of view (1000×1000 pixels, corresponding to 128×128 µm2 in sample space).
TetraSpeck Microspheres, 0.1 µm (T7279, Thermofisher) were imaged with the dOPM system when embedded in agarose gel formed by aqueous agarose (1% agarose) in a glass bottomed dish (35 mm diameter, #1.5 thickness glass bottom dish, MatTek). Compared to the stock solution of beads, the final solution was diluted by a factor of 40.
2.5 Image acquisition of fixed multi-cellular spheroids
For higher-speed imaging of biological samples, image acquisition was performed during a constant velocity scan of the linear actuator. For this, LabVIEW 2019 was used to control the DAQ box (USB-6343, NI) for hardware-timed control of the laser, linear actuator and camera. The linear actuator controller was configured to respond to an analog voltage input signal from the DAQ box. The linear actuator controller was also configured to output TTL pulses every time the linear actuator moved a predefined distance across two predefined regions of its travel range that corresponded to the scanned volumes of View 1 & 2 (as discussed in section 2.1). The two TTL output signals associated with each view were combined by a logical OR gate (SN74HC32N, RS-components) and the resulting signal from this OR gate was used to trigger the camera. Specifically, the linear actuator was configured to output TTL pulses for every 1 µm of travel across two 300 µm regions corresponding to Views 1 & 2. This corresponded to 300 planes (300 TTL trigger pulses) spaced by 0.532 µm along each view’s z axis direction in sample space (see section 2.6 for more detail on relation between actuator position and sample plane position). The analog output waveform from the DAQ box was carefully designed so the linear actuator would linearly ramp across the two 300 µm regions corresponding to View 1 & 2 such that the actuator control box output TTL trigger pulses to produce a frame rate of 90 frames per second (fps). In-between these scan regions, the linear actuator was moved 258 times faster.
A spheroid of 4434 BRAF mutant mouse melanoma cells embedded in Matrigel in one well of a plastic bottomed 96-well plate (PerkinElmer, CellCarrier, #6005550) was imaged with the dOPM system. Actin filaments were fluorescently labelled with Alexa Fluor 488 Phalloidin (Thermo Fisher Scientific, Molecular Probes, #A12379). Fluorescence was excited by a 488 nm laser and detected with a pair of 525/50 nm (centre wavelength/band pass) emission filters.
The camera was controlled by Hamamatsu’s HCImage image acquisition software and was configured to run in rolling shutter mode with a central region of interest of (2000 × 2000 pixels, corresponding to 256 × 256 µm2 in sample space) and to be externally triggered (ORCA-Fusion, synchronous readout trigger mode) at a frame rate of 90 fps. The total acquisition time, including time for the linear actuator to move between scan ranges for Views 1 & 2, for the two volumes totalling 600 planes was 7.06 seconds. The power at the sample plane was 1 mW and this produced an approximately uniform light-sheet across the 550 µm field of view of the objective. The spheroid was approximately 100 µm in diameter, so ∼1/5 of the total power was used to illuminate the spheroid.
2.6 Image deskewing
To scan the two light-sheets in the microscope sample space, a pair of tilted mirrors held on a common mount are positioned in the remote-refocus space to alternately sweep two orthogonal light-sheets. A series of affine transformations describe the corresponding refocussed camera plane position in the sample as it is scanned through one of the two views. Starting in the remote refocus space, the prism mirrors are tilted relative to the x-axis by ±22.5° to rotate the remote refocussed camera plane by ±45° in the sample. As the linear actuator scans one of the mirrors through the remote-refocus space, the camera plane is refocused along the mirror plane’s normal (±22.5° about the z-axis), see Fig. 1(c) & (d). The refocussing is therefore not normal to the refocussed camera plane. Instead the plane follows a sheared path along the y’-axis according to the amount of z’-axis refocus. This leads to the parallelepiped volume for each view as shown in Fig. 1(c) & (d). For a given translation d of the linear actuator in the y direction, the refocus distance in the direction normal to the mirror surface, d’ is given by
where θm=±22.5° is the angle of the mirror normal with respect to the optical axis of the remote refocus system. The amount of refocus along the optical axis of O1, i.e. in the z direction, is given byThe image plane position depends on the mirror tilt and position in remote refocus space according to translation (T), shear (S) and rotation (R) affine transformations. For View 1 the transformation matrices are,
2.7 Reconstruction and multi-view fusion using ImageJ
To process the raw data, the Multi-View Fusion plugin [25] available in ImageJ was used. The plugin was used to implement the affine transformations described in section 2.6 and an automatic bead-based co-registration procedure for the two views, explained in detail in [25], was used. With the two views co-registered, the same plugin was used to implement interpolation procedures and multi-view fusion and multi-view deconvolution procedures as explained in [5,25]. The Multi-View Fusion plugin option to extract an experimentally measured PSF was used to obtain a PSF estimate for each view using the agarose-embedded bead volumes discussed in section 2.3. Deconvolution was performed using the default setting of 10 iterations. For displaying orthoplanes of processed data, the Multi-View Fusion plugin was also used to rotate and reslice processed volumes into the microscope Cartesian coordinate frame (as shown in Fig. 1(a)). Finally, the volumes were exported from the plugin as tiff stacks and the central orthoplanes were extracted.
3. Results
3.1 Calculation of numerical aperture and fluorescence collection efficiency
By calculating the angular overlap of the angular acceptance cones of O1, O2/3 on the first pass and O2/3 on the second pass [13], the theoretical NA of the dOPM system was determined to be 0.58 in the latitudinal direction and 0.93 in the longitudinal direction, see Fig. 2. This method also provides the fraction of fluorescence emitted isotropically into 2π steradians that would reach the detector in the absence of losses due to the PBS other optical components as 0.16.
If the fluorophores in the sample depolarise instantaneously, i.e. have a steady-state fluorescence anisotropy of zero and the fluorescence emission is completely isotropic and unpolarised, then the PBS will transmit 50% of the fluorescence and hence the overall fraction of fluorescence emitted into 2π steradians that reaches the detector is 0.08.
If the fluorophores in the sample have a fixed orientation and do not depolarise, i.e. have a steady state fluorescence anisotropy of 0.4, then the fluorescence emitted is partially polarised [26]. For example, fluorescent proteins have a rotational correlation time that is several-fold longer than that of their fluorescence lifetime, and when free in solution have a steady-state fluorescence anisotropy of ∼0.33 [27]. Therefore, in the low NA case for static fluorophores, then three times the fluorescence signal is polarised perpendicular to the plane of Fig. 1(a) & (b) compared to that which is polarised in the plane of the figure. This assumes that the sample is excited with light polarised perpendicular to plane of figure, as is achieved via the orientation of the PBS shown in Fig. 1(a) & (b). In this scenario, 75% of the fluorescence emitted by the sample reaches the detector in the dOPM setup and hence the overall fraction of fluorescence emitted into 2π steradians that reaches the detector is 0.12. It is important to note that, while the use of the PBS reduces the fluorescence signal reaching the detector, it does not limit the NA of the detection optics.
It can also be seen that the resulting PSF will be tilted in the Z-Y plane by angle ϕ, see Fig. 2(a). The value of ϕ for the configuration used is 18.9°.
The relative dOPM fluorescence collection efficiency between the output of View 1 (image plane after TL3) and the output of microscope 1 (image plane after TL1) was measured using images of 200 nm diameter fluorescent beads (n = 8). All data was acquired with the same wide-field epifluorescence excitation via an epi-fluorescence filter cube inserted behind O1, and the result was 0.067 ± 0.004. The calculated geometric collection efficiency (CE) for O1 for isotropic fluorescence emission into 2π steradians is 0.5. For the whole dOPM system used here the calculated geometric CE is 0.08, including the 50% loss at the PBS. Therefore, the expected relative collection efficiency is 0.08/0.5 = 0.16. However, there are also the losses of the optical components to consider. The transmission of O2 is stated by the manufacturer to be ∼ 0.9 and this component is used in double-pass. There are also four non-antireflection-coated air-glass interfaces presented by the microscope coverglass placed in front of O2, and at normal incidence this has a transmission of 0.964 = 0.85. Together, these losses reduce the expected relative collection efficiency to 0.11. The measured value of 0.067 is lower than this, which we attribute primarily to higher losses at the uncoated coverslip at the non-normal incident angles used in the system and to accumulated small losses from the other optical components.
We also tested the uniformity of the light-sheet illumination for the two independent views using fluorescein in water, and orthogonal cuts through the resulting image volumes are shown in Fig. S4. Other than a slight variation in illumination uniformity along the x direction due to the Gaussian distribution of the static illumination sheet, there is no major variation in illumination intensity across the volumes imaged by the two views.
3.2 Dual-view OPM imaging of beads and characterisation of light-sheet thickness
To quantify the spatial resolution of the dOPM system, a sample of 200 nm fluorescent beads fixed in agarose was imaged. Figure 3(a) shows a montage of maximum intensity projections for each view and the corresponding 2-colour overlay and fusion when resliced into the Cartesian coordinates of the primary microscope objective (as shown in Fig. 1(a)) and viewed from the Y-Z perspective. In (a), the green and magenta outlines are used to indicate the outline of the volume scanned by each view. The red line highlights the overlapping region between the two views, which is where information can be combined to improve spatial resolution and contrast. The yellow square highlights the zoomed-in region shown in Fig. 3(b)-(d), which is a maximum intensity projection of the volume.
To show how dOPM combines the information from the two views, Fig. 3(e)-(k) shows data for an exemplar bead taken from the overlapping area of the two volumes shown by the yellow square in Fig. 3(a). Figure 3(e) shows three central orthogonal cuts taken in the coordinate system of View 1. Figure 3(f) shows the equivalent images for View 2. Figure 3(g) & (h) show the 2-colour overlay and the two-view fusion respectively in the Cartesian coordinate system of the primary objective. Figure 3(i) & (j) show the results of deconvolving View 1 and View 2 alone respectively. Figure 3(k) shows the results of deconvolving View 1 and View 2 together.
Figure 3(l) shows central line profiles through the bead’s fluorescence along each axis of the primary microscope Cartesian coordinates. Along each axis, the line profiles are comparable for View 1 & 2 and the fused volumes. For the single-view deconvolutions, the profiles are comparable in x & y, and narrower for the z and for the z-sectioning profiles. For the dual-view deconvolved profiles, the x & y profiles are marginally narrower compared to Views 1 & 2 and the fused volume. The line profile in the z-direction shows a greater improvement for the deconvolved volume compared to the individual views, fused and single-view deconvolved versions. For the z-sectioning (profile obtained by integrating laterally over x and y), there is a pronounced improvement in the deconvolved volume compared to Views 1 & 2, the fused volume and the single-view deconvolved profiles.
To further quantify and compare the spatial resolution of each view, the fused view and the dual-view deconvolved volumes, the x, y and z bead FWHM for all beads within the central sub-volume indicated by the yellow square in Fig. 3(a) are shown in Fig. S5 as a function of their x, y and z coordinates of the Cartesian coordinates of the primary microscope objective. These results show that the variation in measured PSF size across this region is relatively small and is most pronounced for the z-axis of View 2, where it is seen to increase from ∼1.2 to 1.4 µm when moving from z = -60 µm to z = 60 µm, i.e. by less than 20%.
To provide a comparison between the different views and deconvolved image volumes, Fig. S6 shows orthogonal cuts through the 3D Fourier transform of the 120(x)×120(y)×120(z) µm3 bead volume contained within the yellow square in Fig. 3(a). It can be seen that the single views occupy the smallest region in spatial frequency space, with the deconvolved dual-view image volume occupying the largest.
In order to accurately assess the optical sectioning strength of the system, we also calculated the laterally integrated sectioning FWHM, which we refer to as the z-sectioning parameter. This was performed on 9 beads that were selected manually to be well-separated from their neighbours, as nearby beads can influence the calculation of the z-sectioning parameter. Table 1 shows mean FWHM values for these 9 bead image volumes. The coordinates system used in each row is shown in the left-hand column.
As expected, the resolution obtained for each view in the x-direction is better than that achieved in the y-direction due to the higher NA in the latitudinal direction, see Fig. 2. The bead image FWHM measured in the y-direction is broadened by the tilt ϕ=18.9° of the PSF in the coordinate system of the primary objective due to the asymmetric detection pupil shown in Fig. 2.
For both views, the FWHM in the z direction and z-sectioning is worse than the lateral resolution. Compared to each view, the FWHM values for the fused volume are marginally worse. Consistent with Fig. 3(e)-(k), there is a pronounced improvement for the deconvolved beads compared to the individual views and the fused volume.
The expected bead image FWHM were estimated using the scalar formula for the PSF FWHM for a circular pupil, see column 4 of Table 1. The average of the latitudinal and longitudinal NAs was used for the estimate in the axial (z) direction. The tilt of the PSF (if present) was corrected using the appropriate trigonometry, and the pixel/step size and bead size were included by assuming each effect could be modelled as an independent Gaussian distribution. The theoretical FWHM values are reasonably consistent with the measured values and are discussed in more detail in the Discussion section.
The z-sectioning bead image FWHM values given in Table 1 are provided for two different coordinate systems. Those measured in the z-direction of the primary microscope objective enable comparison between the two views, the fused image and the deconvolved image. The z-sectioning values measured in the Cartesian coordinate systems of View 1 and View 2 correspond to the light sheet FWHM in the detection direction of each view and are 4.99 ± 0.58 µm and 4.89 ± 0.63 µm respectively.
To show that dOPM can reveal features that would not be resolvable from a single view alone, the system was applied to image a sample of 100 nm fluorescent beads fixed in agarose that was denser than the sample imaged for Fig. 3. Pairs of beads were identified from the X’-Y’ perspective of each view that were within the measured axial resolution FWHM values for a single view as reported in Table 1. Figure 4(a) shows X’-Y’ planes from the perspective of View 1 for each view together with fused and deconvolved versions in the same coordinate system. Figure 4(b) shows corresponding line profiles across the pair of beads, which shows that while the two-view fusion marginally improves the ability to resolve the pair of beads by essentially summing the signal from the two views, the two-view deconvolved version makes better use of the lateral resolution information from View 1. A similar trend is shown for a different pair of beads in Fig. 4(c) & (d) from the View 2 perspective but conversely the better lateral resolution information from View 2 is used to resolve the pair of beads in this X-Y’ plane.
3.3 Dual-view OPM imaging fixed spheroids
The dOPM system was applied to image a fixed multi-cellular spheroid of 4434 BRAF mutant mouse melanoma cells embedded in Matrigel where actin is labelled by Alexa Fluor 488 Phalloidin. The spheroid was on the order of 100 µm in diameter. This optically thick, complex biological sample leads to spatial variations in image quality that tend to degrade with optical path length in the sample.
Figure 5(a)-(f) shows central orthogonal cuts through the acquired image volumes taken with respect to the Cartesian coordinate system of the primary microscope objective (see axes in Fig. 1(a)) for View 1, View 2, the 2 colour overlay (where the images have been registered but not fused), the two-view fused volume and the two-view deconvolved volume. The cartoons in Fig. 5(h)-(j) illustrate the perspectives shown.
For View 1, from the central orthogonal X-Y plane shown in Fig. 5(a), the best image contrast is on the right-hand side of the spheroid, whereas for View 2, from the central orthogonal X-Y plane shown in Fig. 5(b), the best image contrast is on the left-hand side of the spheroid (see yellow arrows in Fig. 5(a) & (b)).
For View 1, from the central orthogonal Y-Z plane shown in Fig. 5(a), the best image contrast is on the bottom right of the spheroid, whereas for View 2, from the central orthogonal Z-Y plane shown in Fig. 5(b), the best image contrast is on the bottom left of the spheroid (see yellow arrows in Fig. 5(a) & (b)).
The 2 colour overlay central orthogonal planes shown in Fig. 5(d) and expanded central orthogonal Y-Z plane shown in Fig. 5(f), show that Views 1 and 2 can provide complimentary information, for example, see yellow arrows in Fig. 5(f).
To demonstrate how the two views can be combined to create an improvement spatial contrast across the volume imaged, Fig. 5(d) shows central orthogonal planes from the two-view fused volume that qualitatively are more uniform in image contrast across the central orthogonal planes shown (c.f. Fig. 5(a) & (b)). Similarly, Fig. 5(e) shows central orthogonal planes from the two-view deconvolved volume that, as expected, show qualitatively superior contrast compared to the individual views and the fused view.
To visualise more clearly how the 3D spatial resolution is improved by combining the two views, Fig. 5(f) shows a how a zoomed-in region varies across View 1, View 2, the 2-colour overlay, the fused volume and the deconvolved volume. As shown in the Fig. 5(f), View 1 contributes to the bottom left and top right of the ring-like structures, and View 2 contributes to the top left and bottom right of the ring-like structures.
To illustrate the improvement in information content by combining views, Fig. 5(g) shows line profiles from the same zoomed-in region shown in Fig. 5(f). The dashed yellow line across the zoomed-in region is along the optical axis of View 1 and shows two peaks and a trough in intensity that are contrasted better by View 2 as expected. Conversely, the solid yellow line across the zoomed-in region is along the optical axis of View 2 and shows three peaks and two troughs in intensity that are contrasted better by View 1 as expected.
To provide further comparison between the different views and deconvolved image volumes, Fig. S7 shows orthogonal cuts through the 3D Fourier transform of the 120(x)×120(y)×120(z) µm3 volume containing the spheroid. It can be seen that the single views occupy the smallest region in spatial frequency space, with the deconvolved dual-view image volume providing the largest.
4. Discussion
In section 3.2 we measured the size of images of 200 nm fluorescent beads and compared the results to the values expected from the scalar theory accounting for bead size, camera pixel size and tilt of the PSF where relevant. In the y-direction of the primary microscope objective – which corresponds to the longitudinal NA of the system – the experimental values obtained for View 1 and View 2 match the estimated values to within 9%. In the x-direction of the primary microscope objective – corresponding to the latitudinal NA of the system – the corresponding values agree to within 24%. This poorer agreement is attributed to the higher NA of the system in this direction, which increases the importance of fluorescence anisotropy effects and reduces the validity of the scalar PSF estimate. A more exact theoretical calculation will be carried out in the future. We note that this has been calculated previously for a folded-OPM system [20], but that this analysis did not fully include the effect of the tilted fold mirror.
In this paper, the optical axes of the two views were chosen to be at ±45° to the optical axis of O1. In contrast, the effective angular collection ranges for each view, as defined by the overlap of the collection cones of O1 and O2/3 shown in Fig. 2, are centred on ϕ = ±18.9°. Therefore, while the optical axes of the two views are orthogonal, the axes of the two PSFs intersect at an angle of less than 90°. We note that this is a result of the choices of objective for O1 and O2/3 used here. This difference between the optical axis and the axis of the PSF is due to the inherent geometry of (d)OPM systems where the outer edge of the combined pupil is limited by O1 or O2. For dOPM for a fixed O1 NA, increasing the NA of O2/3 will make this difference more pronounced and the detection PSF becomes closer to being parallel to the optical axis of O1. Nevertheless, there is still benefit from deconvolving two views acquired on either side of the optical axis of O1, as doing so makes the region of support in spatial frequency space more uniformly filled – even if it does not greatly expand the extent of the region of support – due to the complementary angles of the illumination beams for the two views. A full analytical and/or numerical model of these effects combined with those of signal-to-noise through the deconvolution process will be the subject of future work.
The NA and fluorescence collection efficiency of the dOPM implementation reported here are limited by the NA of microscope objective O2/3. In the future, these can be increased without compromising the field of view by instead using e.g. an Olympus 20x/0.8 lens. Increasing the NA of O1, e.g. to a 60x/1.2 water immersion lens or a 60x/1.27 water immersion lens, coupled with the use of a 50x/0.95 lens for O2/3 would further increase the collection efficiency and spatial resolution achieved at the expense of decreased field of view and working distance of O1. The calculated NAs and collection efficiencies for some different potential dOPM microscope objective combinations are summarised in Table 2. We note that the collection efficiency for the 60x/1.2W configuration shown in Table 2 has a collection efficiency of 0.22 in the case of a steady-state anisotropy of zero, which is higher than the collection efficiency for the equivalent previously published OPM configuration employing a 40x/0.6 lens for the third microscope objective [13] despite the fact that half of the signal is lost at the PBS in dOPM.
dOPM has a number of advantages. First, it allows two views of the sample to be obtained whilst requiring only two microscope objectives in the remote-refocussing setup, which reduces cost compared to OPM. Similarly, only one computer-controlled actuator is required to achieve both switching between views and for scanning during acquisition of each view, further reducing cost. The actuator used in this demonstration can perform saw-tooth operation at 25 Hz, and so the dOPM configuration also has the potential to achieve video-rate volumetric imaging. Furthermore, by scanning the illumination and detection plane by scanning the M2 & M5 assembly means that the mass scanned is low compared to that of a microscope objective in the case of OPM [12] and doesn’t require an additional 4-f system to allow a galvo mirror to be placed conjugate to the pupil planes of O1 and O2 as required for SCAPE [15,17] and SOPi [16]. Finally, the folded remote-refocussing geometry allows the numerical aperture of the 3rd microscope objective in the remote-refocussing optics to have the same numerical aperture of the 2nd microscope objective.
5. Conclusion
We have demonstrated a new OPM geometry capable of acquiring two orthogonal views of the sample that can then be fused in post-processing to reduce sample-induced image artefacts. Furthermore, two-view deconvolution can be implemented to obtain a more isotropic PSF and to spatially resolve features not possible with a single view alone. Using a water immersion 40× 1.15 NA primary objective and two views at ±45°, we measured the FWHM of deconvolved image volumes of 200 nm fluorescent beads to be 0.35 ± 0.04 µm, 0.39 ± 0.02 µm and 0.81 ± 0.07 µm in the x, y and z -directions respectively. The laterally integrated z-sectioning value was 1.33 ± 0.45 µm. This was achieved with light-sheet FWHM in the frames of the two views of 4.99 ± 0.58 µm and 4.89 ± 0.63 µm. We also demonstrated the performance of the system for imaging a ∼100 µm diameter spheroid. The fusion and deconvolution of the two views reduced inhomogeneities due to shadow artefacts and provided a more uniform resolution around a ring-shaped feature. A single computer-controlled actuator is employed to both switch between the two views and to scan the light-sheet and detection planes through the sample when acquiring each view. The use of a folded remote-refocussing setup is compact and only uses two high NA microscope objectives but causes some light loss due to the need for the PBS. However, the folded OPM configuration does have the advantage that the NA of the third microscope objective is the same as that of the second objective, as the small tilted fold mirror allows for a greater tilt angle than could be achieved when using identical lenses for the second and third objectives in a non-folded configuration.
Funding
Engineering and Physical Sciences Research Council (EP/T003103/1); the Francis Crick Institute (FC001317, FC001039); Cancer Research UK Programme Foundation Award (C37275/A20146).
Acknowledgements
The Francis Crick Institute receives its core funding from Cancer Research UK (FC001317, FC001039), the UK Medical Research Council (FC001317, FC001039), and the Wellcome Trust (FC001317, FC001039). L.D. and C.B. are funded by the Stand Up to Cancer campaign for Cancer Research UK.
The authors would like to acknowledge the expert help from Martin Kehoe, Simon Johnson and John Murphy in the Optics Workshop of the Photonics Group of Imperial College London who helped design and fabricate the components for the light-sheet microscope system.
Disclosures
CD has filed a patent application on dOPM and has a licensed granted patent on OPM.
Data Availability
The data in this paper is freely available online [28].
See Supplement 1 for supporting content.
References
1. A. H. Voie, D. H. Burns, and F. A. Spelman, “Orthogonal-plane fluorescence optical sectioning: Three-dimensional imaging of macroscopic biological specimens,” J. Microsc. 170(3), 229–236 (1993). [CrossRef]
2. E. Fuchs, J. Jaffe, R. Long, and F. Azam, “Thin laser light sheet microscope for microbial oceanography,” Opt. Express 10(2), 145 (2002). [CrossRef]
3. J. Huisken, J. Swoger, F. Del Bene, J. Wittbrodt, and E. H. K. Stelzer, “Optical sectioning deep inside live embryos by selective plane illumination microscopy,” Science 305(5686), 1007–1009 (2004). [CrossRef]
4. P. J. Verveer, J. Swoger, F. Pampaloni, K. Greger, M. Marcello, and E. H. K. Stelzer, “High-resolution three-dimensional imaging of large specimens with light sheet-based microscopy,” Nat. Methods 4(4), 311–313 (2007). [CrossRef]
5. S. Preibisch, F. Amat, E. Stamataki, M. Sarov, R. H. Singer, E. Myers, and P. Tomancak, “Efficient bayesian-based multiview deconvolution,” Nat. Methods 11(6), 645–648 (2014). [CrossRef]
6. Y. Wu, P. Wawrzusin, J. Senseney, R. S. Fischer, R. Christensen, A. Santella, A. G. York, P. W. Winter, C. M. Waterman, Z. Bao, D. A. Colón-Ramos, M. McAuliffe, and H. Shroff, “Spatially isotropic four-dimensional imaging with dual-view plane illumination microscopy,” Nat. Biotechnol. 31(11), 1032–1038 (2013). [CrossRef]
7. J. Swoger, P. Verveer, K. Greger, J. Huisken, and E. H. K. Stelzer, “Multi-view image fusion improves resolution in three-dimensional microscopy,” Opt. Express 15(13), 8029 (2007). [CrossRef]
8. J. Huisken and D. Y. R. Stainier, “Even fluorescence excitation by multidirectional selective plane illumination microscopy (mSPIM),” Opt. Lett. 32(17), 2608 (2007). [CrossRef]
9. P. J. Keller, A. D. Schmidt, J. Wittbrodt, and E. H. K. Stelzer, “Reconstruction of zebrafish early embryonic development by scanned light sheet microscopy,” Science 322(5904), 1065–1069 (2008). [CrossRef]
10. H. U. Dodt, U. Leischner, A. Schierloh, N. Jährling, C. P. Mauch, K. Deininger, J. M. Deussing, M. Eder, W. Zieglgänsberger, and K. Becker, “Ultramicroscopy: Three-dimensional visualization of neuronal networks in the whole mouse brain,” Nat. Methods 4(4), 331–336 (2007). [CrossRef]
11. C. Dunsby, “Optically sectioned imaging by oblique plane microscopy,” Opt. Express 16(25), 20306 (2008). [CrossRef]
12. S. Kumar, D. Wilding, M. B. Sikkel, A. R. Lyon, K. T. MacLeod, and C. Dunsby, “High-speed 2D and 3D fluorescence microscopy of cardiac myocytes,” Opt. Express 19(15), 13839 (2011). [CrossRef]
13. M. B. Sikkel, S. Kumar, V. Maioli, C. Rowlands, F. Gordon, S. E. Harding, A. R. Lyon, K. T. MacLeod, and C. Dunsby, “High speed sCMOS-based oblique plane microscopy applied to the study of calcium dynamics in cardiac myocytes,” J. Biophotonics 9(3), 311–323 (2016). [CrossRef]
14. V. Maioli, G. Chennell, H. Sparks, T. Lana, S. Kumar, D. Carling, A. Sardini, and C. Dunsby, “Time-lapse 3-D measurements of a glucose biosensor in multicellular spheroids by light sheet fluorescence microscopy in commercial 96-well plates,” Sci. Rep. 6(1), 37777 (2016). [CrossRef]
15. M. B. Bouchard, V. Voleti, C. S. Mendes, C. Lacefield, W. B. Grueber, R. S. Mann, R. M. Bruno, and E. M. C. Hillman, “Swept confocally-aligned planar excitation (SCAPE) microscopy for high-speed volumetric imaging of behaving organisms,” Nat. Photonics 9(2), 113–119 (2015). [CrossRef]
16. M. Kumar, S. Kishore, J. Nasenbeny, D. L. McLean, and Y. Kozorovitskiy, “Integrated one- and two-photon scanned oblique plane illumination (SOPi) microscopy for rapid volumetric imaging,” Opt. Express 26(10), 13027 (2018). [CrossRef]
17. V. Voleti, K. B. Patel, W. Li, C. Perez Campos, S. Bharadwaj, H. Yu, C. Ford, M. J. Casper, R. W. Yan, W. Liang, C. Wen, K. D. Kimura, K. L. Targoff, and E. M. C. Hillman, “Real-time volumetric microscopy of in vivo dynamics and large-scale samples with SCAPE 2.0,” Nat. Methods 16(10), 1054–1062 (2019). [CrossRef]
18. C. Dunsby, “Optical arrangement for oblique plane microscopy,” U.K. patent GB0814039D0 (2008).
19. T. Li, S. Ota, J. Kim, Z. J. Wong, Y. Wang, X. Yin, and X. Zhang, “Axial plane optical microscopy,” Sci. Rep. 4(1), 7253 (2015). [CrossRef]
20. J. Kim, M. Wojcik, Y. Wang, S. Moon, E. A. Zin, N. Marnani, Z. L. Newman, J. G. Flannery, K. Xu, and X. Zhang, “Oblique-plane single-molecule localization microscopy for tissues and small intact animals,” Nat. Methods 16(9), 853–857 (2019). [CrossRef]
21. B. Yang, X. Chen, Y. Wang, S. Feng, V. Pessino, N. Stuurman, N. H. Cho, K. W. Cheng, S. J. Lord, L. Xu, D. Xie, R. D. Mullins, M. D. Leonetti, and B. Huang, “Epi-illumination SPIM for volumetric imaging with high spatial-temporal resolution,” Nat. Methods 16(6), 501–504 (2019). [CrossRef]
22. A. Millett-Sikking and A. York, “AndrewGYork/high_na_single_objective_lightsheet: Work-in-progress (Version 0.0.1),” http://doi.org/10.5281/zenodo.32444 (2019).
23. J. Kim, M. Wojcik, Y. Wang, S. Moon, E. A. Zin, N. Marnani, Z. L. Newman, J. G. Flannery, K. Xu, and X. Zhang, “Oblique-plane single-molecule localization microscopy for tissues and small intact animals,” Nat. Methods 16(9), 853–857 (2019). [CrossRef]
24. T. Wilson, “Resolution and optical sectioning in the confocal microscope,” J. Microsc. 244(2), 113–121 (2011). [CrossRef]
25. S. Preibisch, S. Saalfeld, J. Schindelin, and P. Tomancak, “Software for bead-based registration of selective plane illumination microscopy data,” Nat. Methods 7(6), 418–419 (2010). [CrossRef]
26. J. R. Lakowicz, Principles of Fluorescence Spectroscopy (Springer Science & Business Media, 2007).
27. J. V. Rocheleau, M. Edidin, and D. W. Piston, “Intrasequence GFP in class I MHC molecules, a rigid probe for fluorescence anisotropy measurements of the membrane environment,” Biophys. J. 84(6), 4078–4086 (2003). [CrossRef]
28. H. Sparks, L. Dent, C. Bakal, A. Behrens, G. Salbreux, and C. Dunsby, “Dual-view oblique plane microscopy (dOPM),” http://doi.org/10.5281/zenodo.4242104(2020).