Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Tomographic reconstruction in soft x-ray microscopy using focus-stack back-projection

Open Access Open Access

Abstract

Tomographic reconstruction in soft x-ray microscopy is a powerful technique for obtaining high-resolution 3D images of biological samples. However, the depth of focus of such zone-plate-based microscopes is typically shorter than the thickness of many relevant biological objects, challenging the validity of the projection assumption used in conventional reconstruction algorithms. In order to make full use of the soft x-ray microscopes’ high resolution, the tomographic reconstruction needs to take the depth of focus into account. Here we present a method to achieve high resolution in the full sample when the depth of focus is short compared to the sample thickness. The method relies on the back-projection of focus-stacked image data from x-ray microscopy. We demonstrate the method on theoretical and experimental data.

© 2015 Optical Society of America

Tomography in water-window x-ray microscopes (XRMs) allows for 3-dimensional (3D) imaging of intact cells in their near-native “hydrated” state with nanoscale resolution [15]. The tomographic reconstruction algorithm typically assumes classical projections, i.e., straight line integrals [24]. However, in cellular bio-imaging, the XRM depth of focus (DOF) is often shorter than the sample thickness, challenging the validity of the projection assumption. Here we demonstrate a method that improves the reconstruction when the DOF is short compared with the sample thickness, resulting in a higher resolution in the full sample.

Soft x-ray microscopes operating in the water window exploit the natural contrast between carbon and oxygen in the E=284543eV energy region (λ=4.372.29nm) and rely either on synchrotron sources [3,6,7] or laboratory sources [8]. The imaging is performed with zone plates having a numerical aperture (NAzp) of λ/2ΔrN, where λ is the wavelength, and ΔrN is the outermost zone width [9]. The Rayleigh resolution is 0.61λ/NAzp, and since the DOF is λ/NAzp2, there is a tradeoff between high resolving power and long DOF. The degree of coherence of the imaging is characterized by the coherence parameter m=NAill/NAzp, where NAill is the numerical aperture of the condenser illumination. For m=0, the imaging is fully coherent, for 0<m<1 the imaging is partially coherent, and for m1 the imaging can be considered incoherent.

In a typical XRM tomography system, a tilt series of 2D images Iθ are recorded at tilt angles θ. Assuming Iθ are projection data, the 3D volume R can be reconstructed using, e.g., filtered back-projection (FBP) [10]. Here a ramp- or related filter is applied to each image, producing the filtered dataset I^θ, which is back-projected over the reconstruction volume as

R(x,y,z)=θI^θ(ξ,η),
where (ξ,η)=M(zsinθ+xcosθ,y) defines the mapping from the image coordinates (ξ,η) at tilt angle θ to the coordinates (x,y,z) in the reconstructed volume at magnification M. Although simple, this method has been very successful in producing results of high biological relevance [1,2]. Iterative methods such as ART, SIRT, etc. are also widely used [4,11], notably due to their better capabilities to incorporate regularization conditions and cope with missing data. However, all methods discussed above assume projection data, constraining the experimental parameters to cases where the projection assumption is sufficiently valid. Figure 1 illustrates a situation where the DOF is shorter than the object thickness, weakening the validity of the projection assumption since the whole volume cannot be simultaneously imaged sharply. Many bio-samples studied with XRM tomography are thicker than the DOF of high-resolution zone plates [3,5], and some experiments have therefore settled for a lower-resolution zone plate in order to better fulfill the DOF requirement [4].

 figure: Fig. 1.

Fig. 1. Illustrating the problem of a depth of focus (DOF) smaller than the sample thickness. With high NA-optics, not all features are simultaneously in focus. The sample–zone plate distance determines the amount of defocus Δz in the sample volume.

Download Full Size | PDF

There have been attempts to develop improved reconstruction methods for XRM tomography [12,13], but experimental success has yet to be demonstrated, and the validity of the used forward model is under discussion [14]. The DOF problem is also present in optical microscopy, where techniques such as wavelet-based image fusion [15] and deconvolution microscopy [16] are employed to obtain an overall sharper image and a 3D image, respectively. However, these methods have not been explored for tomography.

In tomographic electron microscopy of thin objects, there are methods to correct for object planes extending outside the DOF when tilting [17]. For thick objects, “Defocus-gradient corrected back-projection” (DGCBP) [18] may greatly improve the quality of the reconstructed data.

In DGCBP the images Iθ in the tomographic data set are deconvolved with a defocus-dependent PSF hΔz before they are filtered and back-projected as in FBP according to

R(x,y,z)=θIθ(ξ,η)1hΔz(ξ,η)^,
where Δz=zcosθ+xsinθ defines the defocus position in the reconstruction volume, and 1 denotes deconvolution.

In the present paper, we demonstrate FSBP—focus-stack back-projection. Figure 2 illustrates the method. This novel reconstruction method for XRM tomography makes use of an experimentally acquired focus stack Iθ,1,Iθ,2Iθ,S at S defocus positions Δz1,Δz2,ΔzS for each tilt angle. As in the previously discussed methods the images are first appropriately filtered, producing the filtered dataset I^θ,s, for all tilt angles and defocus positions. By forming a linear combination of all back-projections of the images in the filtered dataset, where each back-projection is subject to a weighting function ws operating in the defocus direction, the reconstruction is performed as

R(x,y,z)=θsI^θ,s(ξ,η)×ws(Δz).
The voxel dependent weighting factors ws(Δz) are chosen so that the total weight assigned to each voxel in the reconstruction volume equals 1. One natural choice of weighting factors is a set of asymmetric triangle functions:
ws(Δz)={(ΔzΔzs1)/(ΔzsΔzs1),Δzs1<ΔzΔzs(ΔzΔzs+1)/(ΔzsΔzs+1),Δzs<ΔzΔzs+10,else,
with Δz0= and ΔzS+1=+.

 figure: Fig. 2.

Fig. 2. Focus-stack back-projection (FSBP) with the focus stacks at 3 defocus positions for each tilt angle in the tomographic data set. Each image in the focus stack is filtered, back-projected, and weighted with a longitudinal window function, forming a windowed back-projection. The windowed back-projections are fused for every tilt angle, before proceeding with a sum over all angles as in the filtered back-projection algorithm (FBP).

Download Full Size | PDF

We will not give a rigorous proof of the proper operation of the FSBP method, but a qualitative argument can be made as follows: With sufficient sampling in the defocus direction, every feature will be sharply imaged in at least one image in the focus stack for every tilt angle. During reconstruction, those images will all act on the sub-volume where the feature is located, thus achieving a sharp local reconstruction. Although this does not provide formal criteria defining the range of validity of the method, the simulations and experiments presented below indicate that the method works well for the typical high-resolution imaging task.

In Fig. 3, we compare the effectiveness of the FBP, DGCBP, and FSBP reconstruction methods at different microscope parameters. The comparison is performed for the water-and-carbon phantom of Fig. 3, where the carbon content is 10% for the shell and 50% for the 50–200 nm spheres. For a 20-nm zone plate (NAzp=0.06), simulations were made with condenser illumination NAill=0.02 (Figs. 3(a), 3(c), and 3(e)) and NAill=0.06 (Figs. 3(b), 3(d), and 3(f)). For a 40-nm zone plate (NAzp=0.03), simulations were made with condenser illumination NAill=0.02 (Figs. 3(g)3(i)), corresponding to the experimental parameters of Fig. 4.

 figure: Fig. 3.

Fig. 3. Comparison of reconstruction methods on simulated tomographic data sets with different microscope parameters at λ=2.4nm. The zone plate has outermost zone width 20 nm in (a)–(f) and 40 nm in (g)–(i). The condenser illumination has NA=0.02 in (a), (c), (e) and (g)–(i) and 0.06 in (b), (d) and (f). The different combination of microscope parameters of each column yields the values 0.33, 1.00, and 0.67, respectively, for the coherence parameter m=NAill/NAzp. The reconstructions in (a), (b), and (g) are performed with FBP, (c), (d), and (h) are performed with DGCBP and (e), (f), and (i) are performed with FSBP. The insets in each sub-figure show a magnified view of the region in the white rectangle at two noise levels. For a fair comparison between the methods, the simulated recordings are made at the same total dose delivered to the sample: 7×107ph/μm2/proj. angle (dotted line), 7×109ph/μm2proj. angle (solid line).

Download Full Size | PDF

 figure: Fig. 4.

Fig. 4. One slice from the reconstruction of the diatom frustules (a). Insets (b) and (c) show magnified views of a frustule rib at 3–5 μm from the rotation axis from data reconstructed with FBP and FSBP, respectively. Tangential blur in the FBP data is removed in the FSBP-data, here visible at the raphe (red arrows) and pore structures (green arrows).

Download Full Size | PDF

Simulations start with generating a tomographic data set using the 3D wave propagation method of Ref. [14]. This data set is at λ=2.4nm, in 1° steps over 0°–179°, with the focus stack at three defocus positions 3, 0, +3μm. To include the effect of photon noise, Poisson distributed noise is added to each simulated image. For a fair comparison, the FSBP method divides its photons among the images in one focus stack, i.e., all methods use the same total dose. All three methods are compared at two condenser settings and two levels of photon flux incident on the sample, 7×107ph/μm2/proj. and 7×109ph/μm2/proj., and assuming a zone plate efficiency of 5%.

We first compare the algorithms for the 20-nm zone-plate case, Figs. 3(a)3(f). In the classical FBP reconstruction, there are artifacts that increase with distance from the rotation center. At distances >3μm, the tangential resolution is severely lowered by elongation artifacts, and the line profiles exhibit phase shifts at NAill=0.02 [Fig. 3(a)] and contrast reversal at NAill=0.06 [Fig. 3(b)].

The DGCBP reconstruction algorithm improves contrast at NAill=0.02 [Fig. 3(c)], but still suffers from the same artifacts as FBP in the tangential direction. At NAill=0.06 [Fig. 3(d)] the contrast enhancement is lost.

Our FSBP reconstruction algorithm produces a significant improvement in reconstruction, even at lower signal conditions, albeit only for the NAill=0.02data [Fig. 3(e)]. For the NAill=0.06data [Fig. 3(f)], the contrast is severely degraded, but the method does not exhibit the contrast reversal of FBP at the same parameters.

For low m-values (NAill/NAzp=0.02/0.06), the FSBP clearly produces superior reconstructions. This is probably due to the somewhat longer DOF and higher contrast that the partial coherence leads to. For higher m-values (NAill/NAzp=0.06/0.06), the difference between the methods is less. We note that increasing the range and sampling density in the focus stacks did not improve FSBP’s reconstructions noticeably for the case. These observations support claims that partially coherent illumination may be desirable for high-resolution XRM tomography [2,3] despite the fact that the m=1 case is often cited as the preferred [6,7].

As expected, FBP produces a better reconstruction for the 40 nm zone-plate data [Fig. 3(g)] due to the longer DOF, albeit at low contrast. The artifacts in DGCBP were not mitigated, however [Fig. 3(h)]. FSBP again greatly improves the quality of the reconstruction [Fig. 3(i)], but not as much as in the more coherent NAill/NAzp=0.02/0.06 case.

To confirm our theoretical findings, we collected a full tomographic data set including a focus stack at each tilt angle at the HZB Transmission X-ray Microscope in Berlin [3]. The object is a pair of overlapping diatom frustules occupying an area of 13μm×8μm perpendicular to the rotation axis. The silica-rich frustules contain both larger structures, such as valves and ribs, and smaller structures, such as pores. The spatial scales are typical for wet bio-samples, while the contrast is larger than bio-samples normally exhibit.

The frustule-pair was imaged at 510 eV (λ=2.4nm) with a 40-nm zone plate. The resulting numerical aperture of the zone plate is NAzp=0.03, and the DOF is 2.7 μm. The numerical aperture of the condenser is NAill=0.02, yielding the coherence parameter m=NAill/NAzp=0.67. The zone plate and condenser parameters thus match the theoretical used in Figs. 3(g)3(i). Images were acquired at tilt-angles 55°+55° in 1° steps with 1-second exposures. All images were background corrected with a measured flatfield intensity image, and aligned to the rotation axis. Reconstructions were performed using FBP with the Δz=0μm image, and using FSBP with the Δz=3μm, 0 μm, +3μm images at each tilt angle, and with Δz=0μm defined as the plane containing the tilt axis. A slice of the reconstructed volume perpendicular to the rotation axis is shown in Fig. 4(a), and Figs. 4(b)4(c) shows a magnified view of a frustule rib at distance 3–5 μm from the rotation center reconstructed with FBP and FSBP, respectively.

The tangential blur of FBP that is observed in the simulations [Fig. 3(a)] is also present in the experiments [cf. arrows in Fig. 4(b)]. As in the simulations, the artifacts seem to be eliminated with the FSBP algorithm, thereby increasing the resolution in the reconstructed data. However, artifacts are still present because of the missing wedge of 70° in the experimental tomographic data set. Furthermore, image alignment was performed as carefully as possible, but streaks in the reconstructed data indicate that it was not perfect. Still, FSBP offers a significant improvement in reconstruction quality on the features considered.

To conclude, we have demonstrated that our FSBP algorithm utilizing focus stacks improves the resolution and quality in XRM tomographic reconstructions for the partially coherent imaging case. The algorithm is demonstrated on theoretical as well as experimental data. Furthermore, it appears as the increased partial coherence that comes from using higher-resolution zone plates can be a desired property in XRM tomography, when taken properly into account in the reconstruction algorithm. Consequently, FSBP unlocks the higher resolution power available to XRMs for 3D bio-imaging. The method comes at no cost as regards dose but increases the number of images that needs to be acquired. However, our results show that this increase may well be worth the effort considering the gain in resolution over the full volume.

We thank U. Vogt of KTH and P. Guttmann, K. Henzler, S. Rehbein, and G. Schneider of HZB for valuable discussions and/or beamline support. We thank HZB for the allocation of synchrotron radiation beam time. This work was financially supported by the Swedish Research Council Röntgen Ångström program.

References

1. C. A. Larabell and M. A. Le Gros, Mol. Biol. Cell 15, 957 (2004). [CrossRef]  

2. J. L. Carrascosa, F. J. Chichon, E. Pereiro, M. J. Rodriguez, J. J. Fernandez, M. Esteban, S. Heim, P. Guttmann, and G. Schneider, J. Struct. Biol. 168, 234 (2009). [CrossRef]  

3. G. Schneider, P. Guttmann, S. Heim, S. Rehbein, F. Mueller, K. Nagashima, J. Heymann, W. Müller, and J. McNally, Nat. Methods 7, 985 (2010). [CrossRef]  

4. F. J. Chichon, M. J. Rodriguez, E. Pereiro, M. Chiappi, B. Perdiguero, P. Guttmann, S. Werner, S. Rehbein, G. Schneider, M. Esteban, and J. L. Carrascosa, J. Struct. Biol. 177, 202 (2012). [CrossRef]  

5. R. Carzaniga, M. C. Domart, L. M. Collinson, and E. Duke, Protoplasma 251, 449 (2014). [CrossRef]  

6. M. A. Le Gros, G. McDermott, B. P. Cinquin, E. A. Smith, M. Do, W. Chao, P. P. Naulleau, and C. Larabell, J. Synchrotron Radiat. 21, 1370 (2014). [CrossRef]  

7. E. Pereiro, J. Nicolas, S. Ferrer, and M. R. Howells, J. Synchrotron Radiat. 16, 505 (2009). [CrossRef]  

8. H. M. Hertz, O. von Hofsten, M. Bertilson, U. Vogt, A. Holmberg, J. Reinspach, D. Martz, M. Selin, A. E. Christakou, J. Jerlstrom-Hultqvist, and S. Svard, J. Struct. Biol. 177, 267 (2012). [CrossRef]  

9. D. Attwood, Soft X-Rays and Extreme Ultraviolet Radiation: Principles and Applications (Cambridge University, 2007).

10. A. C. Kak and M. Slaney, Principles of Computerized Tomographic Imaging (IEEE, 1988).

11. M. Bertilson, O. von Hofsten, U. Vogt, A. Holmberg, A. E. Christakou, and H. M. Hertz, Opt. Lett. 36, 2728 (2011). [CrossRef]  

12. J. Oton, C. O. Sorzano, E. Pereiro, J. Cuenca-Alba, R. Navarro, J. M. Carazo, and R. Marabini, J. Struct. Biol. 178, 29 (2012). [CrossRef]  

13. J. Klukowska, G. T. Herman, J. Oton, R. Marabini, and J. M. Carazo, Inverse Problems 30, 125015 (2014). [CrossRef]  

14. M. Selin, E. Fogelqvist, A. Holmberg, P. Guttmann, U. Vogt, and H. M. Hertz, Opt. Express 22, 30756 (2014). [CrossRef]  

15. A. G. Valdecasas, D. Marshall, J. M. Becerra, and J. J. Terrero, Micron 32, 559 (2001). [CrossRef]  

16. J. G. McNally, T. Karpova, J. Cooper, and J. A. Conchello, Methods 19, 373 (1999). [CrossRef]  

17. H. Winkler and K. A. Taylor, J. Struct. Biol. 143, 24 (2003). [CrossRef]  

18. G. J. Jensen and R. D. Kornberg, Ultramicroscopy 84, 57 (2000). [CrossRef]  

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (4)

Fig. 1.
Fig. 1. Illustrating the problem of a depth of focus (DOF) smaller than the sample thickness. With high NA-optics, not all features are simultaneously in focus. The sample–zone plate distance determines the amount of defocus Δ z in the sample volume.
Fig. 2.
Fig. 2. Focus-stack back-projection (FSBP) with the focus stacks at 3 defocus positions for each tilt angle in the tomographic data set. Each image in the focus stack is filtered, back-projected, and weighted with a longitudinal window function, forming a windowed back-projection. The windowed back-projections are fused for every tilt angle, before proceeding with a sum over all angles as in the filtered back-projection algorithm (FBP).
Fig. 3.
Fig. 3. Comparison of reconstruction methods on simulated tomographic data sets with different microscope parameters at λ = 2.4 nm . The zone plate has outermost zone width 20 nm in (a)–(f) and 40 nm in (g)–(i). The condenser illumination has NA = 0.02 in (a), (c), (e) and (g)–(i) and 0.06 in (b), (d) and (f). The different combination of microscope parameters of each column yields the values 0.33, 1.00, and 0.67, respectively, for the coherence parameter m = NA ill / N A z p . The reconstructions in (a), (b), and (g) are performed with FBP, (c), (d), and (h) are performed with DGCBP and (e), (f), and (i) are performed with FSBP. The insets in each sub-figure show a magnified view of the region in the white rectangle at two noise levels. For a fair comparison between the methods, the simulated recordings are made at the same total dose delivered to the sample: 7 × 10 7 ph / μm 2 / proj. angle (dotted line), 7 × 10 9 ph / μm 2 proj. angle (solid line).
Fig. 4.
Fig. 4. One slice from the reconstruction of the diatom frustules (a). Insets (b) and (c) show magnified views of a frustule rib at 3–5 μm from the rotation axis from data reconstructed with FBP and FSBP, respectively. Tangential blur in the FBP data is removed in the FSBP-data, here visible at the raphe (red arrows) and pore structures (green arrows).

Equations (4)

Equations on this page are rendered with MathJax. Learn more.

R ( x , y , z ) = θ I ^ θ ( ξ , η ) ,
R ( x , y , z ) = θ I θ ( ξ , η ) 1 h Δ z ( ξ , η ) ^ ,
R ( x , y , z ) = θ s I ^ θ , s ( ξ , η ) × w s ( Δ z ) .
w s ( Δ z ) = { ( Δ z Δ z s 1 ) / ( Δ z s Δ z s 1 ) , Δ z s 1 < Δ z Δ z s ( Δ z Δ z s + 1 ) / ( Δ z s Δ z s + 1 ) , Δ z s < Δ z Δ z s + 1 0 , else ,
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.