Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Homographically generated light sheets for the microscopy of large specimens

Open Access Open Access

Abstract

We compare the performance of linear and nonlinear methods for aligning the excitation and detection planes throughout volumes of large specimens in digitally scanned light sheet microscopy. An effective nonlinear method involves the registration of four corner extrema of the imaging volume via a projective transform. We show that this improves the light collection efficiency of the commonly used three-point affine registration by an average of 42% over a typical specimen volume. Accurate illumination/detection registration methods are now pertinent to biological research in view of current trends towards imaging large or expanded samples, at depth, with diffraction limited resolution.

Published by The Optical Society under the terms of the Creative Commons Attribution 4.0 License. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI.

Light sheet fluorescence microscopy is fast becoming the method of choice for imaging large volumetric samples. Whilst confocal techniques reject the out-of-focus signal excited by the illumination source through use of a pinhole, light sheet technology is a much more efficient optical sectioning method, since signals are exclusively generated in the plane defined by the thin sheet of illumination light.

As light sheet imaging is a wide-field technique, the temporal resolution is much higher than achievable via confocal scanning, and the photon dosage for generating an equally bright image is 2 orders of magnitude lower. This makes the method ideally suited for the imaging of live biological specimens [1]. Commercial and home-built [2] light sheet systems often use a cylindrical lens to convert a circular Gaussian laser beam into a thin sheet. Alternatively, galvanometric mirrors can be used to produce a light sheet by rapidly dithering a laser beam; this is referred to as digitally scanned light sheet microscopy (DSLM) [3]. Typically, a galvanometric mirror pair is used to sweep an incident laser beam through a scan lens which converts a beam angle to a beam position; within the observation volume, this acts to keep the sweeping beam parallel for a homogenous illumination and background [4]. However, the use of a scan lens can lead to registration errors of the light sheet with respect to the imaging plane, reducing contrast, and increasing background fluorescence. Thus, accurate registration is critical for the technique. In this Letter, we compare the performance of nonlinear and linear methods for registering excitation and imaging planes in a DSLM system. We introduce a novel homographic method and discuss its advantages in practical light sheet microscopy.

Aligning a digitally scanned light sheet to a detection plane requires the generation of control signals Vx, Vz for the scanning mirrors to generate a light sheet in the x, y plane, which is translated in z (geometry as in Fig. 1). In two dimensions, the extrema in x define two edges of the imaging field of view (FOV) and a linear ramp in Vx between these coordinates produces a virtual light sheet. The z-mirror extrema correspond to the top and bottom planes of the image stack. However, using linear ramping from a given starting point, only three of the four x and z extrema can be registered [5]. The fourth point is either discarded or, more typically, amalgamated with the third by an averaging of the available vertices in one of the planes. As illustrated in Fig. 1, this assumption then leads to a poorly registered illumination in the plane where the fourth coordinate was neglected, and greater background fluorescence in 3D imaging.

 figure: Fig. 1.

Fig. 1. (a) Schematic of the light sheet optics using a large NA detection objective. The beam is scanned in x to create a virtual sheet. (b)–(e) For the best image quality, the illumination planes (shown as red when not perfectly registered to the illumination planes) must be registered to the detection planes (green). (c) The linear registration using coordinates (1,2) is sufficient to register one plane. The affine registration (d) is commonly used in DSLM systems and provides reasonable performance by registering three points, [typically (1,2) and the midpoint of (3,4)]. However, the projective registration (e) using four control points (14) provides superior performance due to decreased out-of-focus fluorescence.

Download Full Size | PDF

The stack of illumination planes used in a 3D observation can be better matched to the detection planes by registering four corners of the available excitation 3D-FOV, using a projective transform. Projective transforms can map any quadrilateral onto any other, whereas an affine transformation can only register three points. Higher order corrections could also be used; one example is an n-point correction using b-splines; however, this is computationally expensive. Such elastic transforms require a larger number of correspondences and, therefore, are likely to incur compounded errors.

A calibration experiment provides the control signals (Vxi, Vzi) for i=1 to 4, needed to register the illumination to the four extrema of the imaging volume, (xi, zi). In a projective transform of r=(x,z), we generate the augmented vector r˜=(x,z,1) and then apply a linear transform to obtain r˜=Hr˜. This is followed by descaling to obtain the transformed vector:

r=(r˜1r˜3r˜2r˜3).

A projective transform of a plane can be exactly defined by four projected points, unless any three are collinear. Now the calibration experiment identifies four (noncollinear) extrema of the imaging volume, and it is possible to combine the augmented form of three of these positions to produce the fourth, such that

(x1x2x3z1z2z3111)(λμν)=(x4z41),
where λ,μ and ν are constants. After solving for λ,μ and ν, the matrix A can be constructed:
A=(λx1μx2νx3λz1μz2νz3λμν).

The matrix A maps basis vectors to the specific points chosen for registration:

A(100)Tλ(x1,z1,1)TA(010)Tμ(x2,z2,1)TA(001)Tν(x3,z3,1)TA(111)T(x4,z4,1)T.

Here A acts on the basis column vectors which are written here as transposed row vectors with the superscript T, and the resulting augmented coordinates descale to the registration coordinates via Eq. (1). Since A maps basis vectors to augmented positions, A1 decomposes an augmented position into basis vectors.

Now the calibration experiment provides control signals (Vxi, Vzi) which can be transformed to augmented vectors and treated in the same way. Specifically, a(Vx1,Vz1,1)+b(Vx2,Vz2,1)+c(Vx3,Vz3,1)=(Vx4,Vz4,1) for constants a,b, and c so that

(abc)=(Vx1Vx2Vx3Vz1Vz2Vz3111)1(Vx4Vx41).

The matrix B can be created in the same way as A:

B=(ax1bx2cx3az1bz2cz3abc).

B maps from basis vectors to augmented signals, so that B(111)T=(Vx4,Vz4,1)T. To compute the projective transform of an illumination position r=(x,z) to the required control signal V=(Vx,Vz), we simply need to convert the augmented position to basis vectors using A1r˜, and the basis vectors to control signals using B followed by dehomogenization using Eq. (1). It is useful to use the homography matrix H=BA1, so that V˜=Hr˜, or

(V˜xV˜zk)=(aVx1bVx2cVx3aVz1bVz2cVz3abc)(010z1z2z3111)1(xz1),
where the x range is normalized to run from x1=x3=0 to x2=x4=1, and A1 is heavily simplified by solving for λ,μ and ν. Finally,
(VxVz)=1k(V˜xV˜z)
rescales homogenous voltages to real output voltages. Therefore, non-extrema points can readily be interpolated to create signal trains; for higher-order corrections, point-wise generation would be necessary. All demonstrations of the four-point correction were performed on an [6] inverted Selective Plane Imaging Microscope (iSPIM). A (Coherent Obis 561 nm) laser was used as the beam source. A pair of galvanometric mirrors (Cambridge Technology) was used to produce 2D beam steering via an image relay; this approach is well established in scanning microscopy and is known to introduce ordinarily negligible field curvature. A telecentric scan lens (A1 Scan Lens from Nikon) was used to parallelize the scanning beam; a (10×0.3NA Nikon) water dipping objective was used for excitation and mounted at right angles to a (25×1.1NA) Nikon LWD water immersion objective. The fluorescence collected by the detection objective is then imaged onto a Hamamatsu sCMOS Orca Flash 4. A piezo scanner (Physik Instrumente P-726 PIFOC high-load objective scanner) was used to manually move the detection objective to match the detection focal plane to the excitation plane. The back aperture of the excitation objective was stopped down with an adjustable iris; the work presented in this Letter produced a light sheet of 8 μm with a confocal extension of 180 μm for a laser color of 561 nm.

To accurately measure the deviation solely caused by the scanning system, a camera (Thorlabs DCC1545M) was mounted directly after the scan lens and an attenuated beam was imaged directly onto the sensor. The full range of the scanning unit was studied by incrementing mirror control voltages (Vx, Vz) linearly and imaging the illumination beam in xz for each step, as shown in Fig. 2(a). Each beam profile was fit with a 2D Gaussian to create a map of xz illumination positions corresponding to the constant steps in the scan lens. Figures 2(b) and 2(c) show the residual deviation from the desired positions when using a four-point and three-point registration, respectively. The four-point correction is more faithful to experimental values. The figure verifies that a four-point correction produces a more valid fitting for a beam scanned across a telecentric lens, with a more significant improvement becoming apparent when using a larger region of the scan lens.

 figure: Fig. 2.

Fig. 2. Scan lens characterization: (a) shows the illumination profile in the xz plane for 400 scan positions, with a three-point registration. Each of the beam positions in (a) was localized by fitting a 2D Gaussian. The identified positions, using (b) a three point and (c) a four point, show that the positional discrepancy of the three-point method is largely fixed by the four-point registration; mean average discrepancy values being reduced for the affine versus homographic correction of 0.3673 μm and 0.2494 μm, respectively, with standard deviation values also dropping from 0.1467 μm to 0.1133 μm.

Download Full Size | PDF

In real samples for light sheet microscopy, a mismatch between the detection plane and the illumination plane can reduce image fidelity due to decreased illumination in the imaging plane, as well as excess background fluorescence. Figure 3 shows that the four-point registration largely eliminates this mismatch for real samples, including fluorescent beads, dyes, and a model organism.

 figure: Fig. 3.

Fig. 3. In situ characterization: (a), (b) ratios of intensity maxima of localized fluorescent bead images were compared in 3D observation volumes using three- and four-point corrections. (a) On average, a 42% increase in contrast was obtained for the four-point case, with benefits increasing as the depth increases (b). (c) Corresponding graph for a beam scanned through a dye solution. The four-point correction results in greater light capture efficiency over the three-point correction, which again becomes more significant with depth. Here the brightness of the beam’s image indicated how well it was registered to the imaging plane. (d) Transgenic zebrafish expressing mCherry:beta-actinCAAX. The contrast of features is substantially improved by the four-point registration, and the images afford greater detail and clarity, as shown by inset line profiles.

Download Full Size | PDF

In Figs. 3(a) and 3(b), fluorescent beads (TetraSpeck 100 nm Microspheres) were dispersed in 1.5% agarose at 1:1000 concentration and imaged using a three-point and a four-point registration. Each bead (from a total of 500) was localized in 3D, and its peak fluorescence intensity was compared in the four-point and three-point case, and was found to be, on average, 42% higher across the entire volume (512μm×512μm×100μm) for the four-point registration. For our Gaussian beam of 8 μm width (full-width at half-maximum), this corresponds to correcting a light sheet mis-registration of about 4 μm on average. The experiment from Fig. 2 was repeated in the light sheet microscope using a dye solution for Fig. 3(c). The scanning beam was paused and iterated again through discrete positions in the imaging volume. Each record fluorescent dye image was characterized by a focus measure, obtained by finding the intensity maximum through the focus of the light sheet for each beam position. As expected, the mismatch between the light sheet and image plane increased more quickly with the imaging depth for the three-point correction than in the case of the four-point correction.

The advantages of using a four-point correction, finally, were then demonstrated in fluorescence images from a transgenic zebrafish sample, a model organism ubiquitous in light sheet imaging. The sample shown in Fig. 3(d) expressed an mCherry fluorescent protein construct (Beta-actin: mCherryCAAX) near the cellular membrane and was mounted in 1.2% agarose; imaging took place 4 h post-fertilization. The greater clarity of detail and contrast afforded by the four-point method is evident.

The registration between detection and illumination volumes [7] is becoming a greater challenge, as high-resolution light sheet methods are used to image ever larger and deeper samples [810]. Both increasing chip sizes in cameras [11,12] and imaging with large FOVs [13] create a need for effective registration methods that can avoid errors which would otherwise be introduced by using linear waveforms in light sheet microscopes. In addition, it is especially valuable to have excellent registration when rolling confocal slit scanning cameras are employed [14]: these systems achieve an anisotropic improvement in resolution and contrast, but suffer more severely from misalignment because out-of-focus light is blocked by the detection slit and can lead to dark, rather than merely blurred images.

In conclusion, we have demonstrated that, for iSPIM systems with digitally scanned light sheets, a four-point correction achieved by nonlinear waveform generation affords better correction than a three-point method (affine waveform generation) against errors introduced by beam scanning optics, offering a practical method that is conveniently implemented and requires minimal computational effort. In our iSPIM, the four-point correction was applied optomechanically to control the light sheet position, but a similar approach might be used to ensure well-registered sample positioning in systems where the sample is moved instead of the light sheet. There are other sources of light sheet displacement, such as refraction by texture in the specimen; however, these issues may need to be corrected on a specimen-wise basis, and their correction goes beyond the scope of this Letter.

Software: Examples and implementations of the methods described above are provided in both MATLAB and LabVIEW.

Funding

Engineering and Physical Sciences Research Council (EPSRC) (EP/H018301/1, EP/L015889/1); Wellcome Trust (089703/Z/09/Z, 3-3249/Z/16/Z); UK Medical Research Council (MRC) (MR/K015850/1, MR/K02292X/1); MedImmune; Infinitus (China).

Acknowledgment

C. Russell gratefully acknowledges James Manton for his fruitful discussions on the writing and theory of this publication. C. Russell also acknowledges Dr. Kevin O’Holleran for his support during the conception of the work in this Letter. C. Russell gratefully acknowledges funding from the EPSRC CDT in Integrated Photonic and Electronic Systems. C. Kaminski acknowledges funding from EPSRC, the Wellcome Trust, the UK Medical Research Council, MRC, MedImmune, and Infinitus (China), Ltd.

REFERENCES

1. J. Huisken, J. Swoger, F. D. Bene, J. Wittbrodt, and E. H. K. Stelzer, Science 305, 1007 (2004). [CrossRef]  

2. P. G. Pitrone, J. Schindelin, L. Stuyvenberg, S. Preibisch, M. Weber, K. W. Eliceiri, J. Huisken, and P. Tomancak, Nat. Methods 10, 598 (2013). [CrossRef]  

3. P. J. Keller, A. D. Schmidt, A. Santella, K. Khairy, Z. Bao, J. Wittbrodt, and E. H. K. Stelzer, Nat. Methods 7, 637 (2010). [CrossRef]  

4. B. C. Chen, W. R. Legant, K. Wang, L. Shao, D. E. Milkie, M. W. Davidson, C. Janetopoulos, X. S. Wu, J. A. Hammer, Z. Liu, and B. P. English, Science 346, 1257998 (2014). [CrossRef]  

5. B. Zitová and J. Flusser, Image Vis. Comput. 21, 977 (2003). [CrossRef]  

6. A. K. Chmielewski, A. Kyrsting, P. Mahou, M. T. Wayland, L. Muresan, J. F. Evers, and C. F. Kaminski, Sci. Rep. 5, 9385 (2015). [CrossRef]  

7. L. A. Royer, W. C. Lemon, R. K. Chhetri, Y. Wan, M. Coleman, E. W. Myers, and P. J. Keller, Nat. Biotechnol. 34, 1267 (2016). [CrossRef]  

8. F. Chen, P. W. Tillberg, and E. S. Boyden, Science 347, 543 (2015). [CrossRef]  

9. K. Wang, W. Sun, C. T. Richie, B. K. Harvey, E. Betzig, and N. Ji, Nat. Commun. 6, 7276 (2015). [CrossRef]  

10. T. V. Truong, W. Supatto, D. S. Koos, J. M. Choi, and S. E. Fraser, Nat. Methods 8, 757 (2011). [CrossRef]  

11. G. Zheng, X. Ou, and C. Yang, Biomed. Opt. Express 5, 1 (2014). [CrossRef]  

12. D. J. Brady, M. E. Gehm, R. A. Stack, D. L. Marks, D. S. Kittle, D. R. Golish, E. M. Vera, and S. D. Feller, Nature 486, 386 (2012). [CrossRef]  

13. N. J. Sofroniew, D. Flickinger, J. King, and K. Svoboda, eLife 5, e14472 (2016). [CrossRef]  

14. E. Baumgart and U. Kubitscheck, Opt. Express 20, 21805 (2012). [CrossRef]  

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (3)

Fig. 1.
Fig. 1. (a) Schematic of the light sheet optics using a large NA detection objective. The beam is scanned in x to create a virtual sheet. (b)–(e) For the best image quality, the illumination planes (shown as red when not perfectly registered to the illumination planes) must be registered to the detection planes (green). (c) The linear registration using coordinates (1,2) is sufficient to register one plane. The affine registration (d) is commonly used in DSLM systems and provides reasonable performance by registering three points, [typically (1,2) and the midpoint of (3,4)]. However, the projective registration (e) using four control points (14) provides superior performance due to decreased out-of-focus fluorescence.
Fig. 2.
Fig. 2. Scan lens characterization: (a) shows the illumination profile in the x z plane for 400 scan positions, with a three-point registration. Each of the beam positions in (a) was localized by fitting a 2D Gaussian. The identified positions, using (b) a three point and (c) a four point, show that the positional discrepancy of the three-point method is largely fixed by the four-point registration; mean average discrepancy values being reduced for the affine versus homographic correction of 0.3673 μm and 0.2494 μm, respectively, with standard deviation values also dropping from 0.1467 μm to 0.1133 μm.
Fig. 3.
Fig. 3. In situ characterization: (a), (b) ratios of intensity maxima of localized fluorescent bead images were compared in 3D observation volumes using three- and four-point corrections. (a) On average, a 42% increase in contrast was obtained for the four-point case, with benefits increasing as the depth increases (b). (c) Corresponding graph for a beam scanned through a dye solution. The four-point correction results in greater light capture efficiency over the three-point correction, which again becomes more significant with depth. Here the brightness of the beam’s image indicated how well it was registered to the imaging plane. (d) Transgenic zebrafish expressing mCherry:beta-actinCAAX. The contrast of features is substantially improved by the four-point registration, and the images afford greater detail and clarity, as shown by inset line profiles.

Equations (8)

Equations on this page are rendered with MathJax. Learn more.

r = ( r ˜ 1 r ˜ 3 r ˜ 2 r ˜ 3 ) .
( x 1 x 2 x 3 z 1 z 2 z 3 1 1 1 ) ( λ μ ν ) = ( x 4 z 4 1 ) ,
A = ( λ x 1 μ x 2 ν x 3 λ z 1 μ z 2 ν z 3 λ μ ν ) .
A ( 100 ) T λ ( x 1 , z 1 , 1 ) T A ( 010 ) T μ ( x 2 , z 2 , 1 ) T A ( 001 ) T ν ( x 3 , z 3 , 1 ) T A ( 111 ) T ( x 4 , z 4 , 1 ) T .
( a b c ) = ( V x 1 V x 2 V x 3 V z 1 V z 2 V z 3 1 1 1 ) 1 ( V x 4 V x 4 1 ) .
B = ( a x 1 b x 2 c x 3 a z 1 b z 2 c z 3 a b c ) .
( V ˜ x V ˜ z k ) = ( a V x 1 b V x 2 c V x 3 a V z 1 b V z 2 c V z 3 a b c ) ( 0 1 0 z 1 z 2 z 3 1 1 1 ) 1 ( x z 1 ) ,
( V x V z ) = 1 k ( V ˜ x V ˜ z )
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.