Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Virtual single-pixel imaging-based deconvolution method for spatial resolution improvement in wide-field fluorescence microscopy

Open Access Open Access

Abstract

Deconvolution technique has been widely used in fluorescence microscopy to restore fine structures of biological samples. However, conventional deconvolution methods usually achieve little contrast enhancement in dense structures that have the intervals close to the Rayleigh criterion. Herein, we developed a novel deconvolution method, termed virtual single-pixel imaging (v-SPI). Differing from existing deconvolution methods, v-SPI aims to retrieve the less blurred image directly, not the sample distribution which cannot be actually obtained. And the result can be retrieved simply by solving a linear matrix in spatial domain. In addition, the proposed method has no requirement of calibrating parameters of microscope system. Simulation and experimental results demonstrated that the proposed v-SPI method can enhance the contrast of dense structures significantly and acquire a 24% increase in resolution.

© 2020 Optical Society of America under the terms of the OSA Open Access Publishing Agreement

1. Introduction

The light diffraction limits the spatial resolution of optical microscopy and thus renders distinguishing subcellular structures at length-scales smaller than the Rayleigh criterion [14]. Various super-resolution (SR) microscopies have been developed to improve spatial resolution. These SR methods narrow the shape of the point spread function (PSF) mainly through changing the microscope design. Although these SR approaches, such as confocal [5], stimulated emission depletion (STED) [6] and structure illumination microscopy (SIM) [7], can effectively break the diffraction limitation, they however should build technical microscope setups, which require careful calibration and stable maintenance. Otherwise, artifacts will be generated in the reconstructed images.

Theoretically, the blurred fluorescence image can be taken as the convolution result of samples and microscope PSF [810]. It thus is possible to retrieve images numerically with fine details and enhanced contrast. Comparatively, numeral processing method (so-called deconvolution method) is more flexible, and can be applied to the simplest microscope system or taken as the post-processing tool for other SR methods [1113]. Because it is useful in many contexts, various deconvolution algorithms have been proposed [1419], such as the Wiener filtering, the Gold algorithm, the Tihkonov regularization method and the Richardson-Lucy (RL) method, etc. Most of the existing deconvolution methods estimate the sample distribution over multiple iterations of creating a blurred image with system PSF and comparing it to the original. It not only requires precise calibration of system PSF, but also has the difficulty in deciding when to end the iteration procedure as the ‘real’ sample distribution actually cannot be obtained. Moreover, existing deconvolution methods mainly increase the image contrast for sparse structures (the minimum distance between two objects is higher than the Rayleigh criterion) but shows little contrast enhancement to the area of denser structures [20]. With more rigorous resolution definition (relating to the minimum distance that two objects can be distinguished from one another), this structure-dependence performance of existing deconvolution methods just makes the structures shrink but with little spatial resolution improvement.

To this end, a novel deconvolution method termed virtual single-pixel imaging (v-SPI) is presented in this work. After combining an introduced equivalence relationship of integral value and SPI algorithm, it retrieves results by simply solving a linear matrix in spatial domain. Besides, we also altered our estimation objective from the sample distribution to the less blurred sample distribution (blurred with a smaller PSF) which is possible to be obtained in practice. It is verified by the simulation and experimental results that, with all these efforts, the proposed v-SPI method can improve the spatial resolution effectively by enhancing the contrast of dense structures and without calibrating system parameters.

2. Principle

In v-SPI method, the blurred fluorescence image is post-modulated with digital patterns. We first deduced an equivalence relationship, i.e., the integral value of the post-modulated image is equal to that of the dot production result of sample distribution and convoluted pattern (with system PSF). The reverse problem of deconvolution was then converted into solving a linear matrix with SPI algorithm. In the linear matrix, convoluted patterns and the corresponding integral values are known, the sample distribution is desired.

2.1 Equivalence relationship of the integral value

The schematic diagram of equivalence relationship of the integral values is shown in Fig. 1. From the diffraction theory, the blurred fluorescence image I can be defined as the convolution result of sample density S and microscope PSF h, as follows:

$$I({x,y} )= \int\!\!\!\int {S({x^{\prime},y^{\prime}} )} \,h({x - x^{\prime},y - y^{\prime}} )dx^{\prime}dy^{\prime}$$
where, x and y indicate the coordinates in both directions on the image plane, and x’ and y’ the coordinates in both directions on the specimen plane. For simplicity, the theoretical model for imaging formation is described here in two-dimensional space.

 figure: Fig. 1.

Fig. 1. Schematic diagram of the system set-up and the equivalence relationship between integral values.

Download Full Size | PDF

We then post-modulate it with digital patterns Pi:

$${M_i}({x,y} )= I({x,y} ){P_i}({x,y} ),\;\quad i = 1, \cdots ,m$$
where Mi is the modulated image with respect to the ith digital pattern Pi, and m denotes the number of digital patterns. The integral value of the modulated image Mi may be calculated as:
$${b_i} = \int\!\!\!\int {{M_i}({x,y} )} \,dxdy = \int\!\!\!\int {\left[ {\int\!\!\!\int {S({x^{\prime},y^{\prime}} )h({x - x^{\prime},y - y^{\prime}} )} \,dx^{\prime}dy^{\prime}} \right]} \;{P_i}({x,y} )dxdy$$

By exchanging the order of the two integrals [2123] in Eq. (3), we rewrite this expression as:

$${b_i} = \int\!\!\!\int {\left[ {\int\!\!\!\int {{P_i}({x,y} )h({x - x^{\prime},y - y^{\prime}} )dxdy} } \right]} \;S({x^{\prime},y^{\prime}} )dx^{\prime}dy^{\prime}$$

We may now define the convoluted patterns ${P^{\prime}_i}$ as

$${P^{\prime}_i}({x^{\prime},y^{\prime}} )= \int\!\!\!\int {{P_i}({x,y} )} {\kern 1pt} {\kern 1pt} h({x^{\prime} - x,y^{\prime} - y} )dxdy$$

By substituting Eq. (5) into Eq. (4), we acquire the following expression

$${b_i} = \int\!\!\!\int {{{P^{\prime}}_i}({x^{\prime},y^{\prime}} )} \;S({x^{\prime},y^{\prime}} )dx^{\prime}dy^{\prime}$$

From Eqs. (3)–(6), we can draw the equivalence relationship of integral value, i.e., the integral value of modulated image Mi is equal to that of the dot production result of sample distribution S and convoluted pattern ${P^{\prime}_i}$, which can be simply expressed as

$$\int {({S \ast h} )} \bullet {P_i} = \int {S \bullet ({{P_i} \ast h} )}$$
where ${\ast} $ represents convolution operation and ${\bullet}$ denotes dot product operation.

2.2 Principle of v-SPI

Based on the equivalence relationship, the integral value of the modulated image Mi is calculated, it can be taken as that of the dot product of sample distribution S and convoluted pattern ${P^{\prime}_i}$. Since the convoluted pattern ${P^{\prime}_i}$ is determined with digital pattern Pi and the PSF h. We thus can retrieve the desired sample density S by solving the following equation:

$$AX = b$$
where $A \in {R^{m \times n}}$ indicates the modulation matrix (m convoluted patterns ${P^{\prime}_i}$ and each pattern consists of n pixels), $X \in {R^{n \times 1}}$ denotes the reshaped result of the desired sample density S (aligned as a vector), and $b \in {R^{m \times 1}}$ is a vector that consists of m integral values. The schematic diagram of v-SPI method is shown in Fig. 2.

 figure: Fig. 2.

Fig. 2. Schematic diagram of v-SPI.

Download Full Size | PDF

By referring to the SPI technique [24,25], we find that the Eq. (8) is similar to the measurement formation in SPI technique. From Eqs. (3) and (5), we can determine the integral values and convoluted patterns with the blurred fluorescence image I, digital patterns Pi and PSF h. Thus, the desired sample distribution S can be reconstructed using the SPI algorithm. In addition, a set of specific digital patterns is applied here, in which each pixel will be sequentially set to a value of 1, and the rest of the pixels are set to zero. That means the number of digital patterns is equal to the pixel number of the blurred fluorescence image. With the specific digital patterns, this reconstruction involves solving a huge matrix equation (16384*16384 matrix for reconstructing 128*128 image with 16384 patterns). By referring to the comparison of different SPI algorithms in [24] and taking the computer memory limit into account, a linear iterative algorithm (Alternating Projection, AP) is selected in this paper to retrieve the desired sample distribution S.

2.3 Practical usage of v-SPI

Although we provided an ideal numerical retrieving strategy with Eq. (8), however the ‘real’ sample distribution S cannot be actually obtained, like in existing deconvolution methods. Usually, retrieved results are just less blurred images than the originals. Based on this fact, we changed the estimating goal of v-SPI from retrieving the sample distribution to the less blurred distribution.

As the 2D system PSF can be accurately described with Gaussian model [26], we then can regard the system PSF h (2D Gaussian approximations) as the convolution result of two smaller Gaussian PSFs (h1 and h2), which have smaller half full-width at half-maximum (FWHM) than that of system PSF h. By substituting it to Eq. (7), we can acquire:

$$\int {[{S \ast ({{h_1} \ast {h_2}} )} ]\bullet {P_i}} = \int {[{({S \ast {h_1}} )\ast {h_2}} ]\bullet {P_i}} = \int {S^{\prime} \bullet ({{P_i} \ast {h_2}} )}$$
where $S^{\prime} = S \ast {h_1}$ denotes the less blurred distribution.

It is demonstrated from Eq. (9) that the less blurred deconvolution result S’ can be retrieved by v-SPI with the smaller PSF h2. Compared with the unreachable objective (retrieving sample distribution) of existing deconvolution methods, our changed estimation objective in v-SPI is possible to be achieved and thus can yield more reliable results. As any smaller PSF h2 can be applied in v-SPI to retrieve the less blurred distribution S’, the proposed usage of v-SPI actually eliminates the requirement of accurate PSF calibration, which is necessary for existing deconvolution methods.

3. Simulation results

The performance of v-SPI was first evaluated using the numerically simulated image of a thin spoke-like sample placed at the objective focal plane (with numerical aperture NA=1.45) [ Fig. 3(a)]. In the numerical simulation, the sample was uniformly illuminated and the wavelength of fluorescent light is 510nm (λem=510nm). The image pixel size was set to 30 nm. At first, noise was not introduced in the blurred image to evaluate the performance under the ideal condition. With these simulation settings, a 2D Gaussian PSF model h is utilized to blur the thin spoke-like sample and the blurred result is shown in Fig. 3(b).

 figure: Fig. 3.

Fig. 3. Reconstructed results with different model sizes. (a) The simulated fluorescence sample. (b) The blurred image. (c)-(i) Reconstructed results of v-SPI with Gaussian PSF models in different sizes (${\sigma ^{\prime}_2}$ = 0.9, 1.2, …, 3.0), respectively. The scale bars represent a distance of 2 µm.

Download Full Size | PDF

Although any smaller PSF h2 can be used in v-SPI method to retrieve results, they however may lead different results of the reconstruction and we need to seek the most suitable PSF in practice. In this paper, the 2D PSF is described with Gaussian model. And the comprehensive standard deviation (CSD,$\sigma ^{\prime} = {\sigma \mathord{\left/ {\vphantom {\sigma d}} \right.} d}$,$\sigma$ is the standard deviation of Gaussian model and d is the pixel size) is defined to determine the size of PSF. In this simulation, the CSD of nominal system PSF is 2.97 ($\sigma ^{\prime} = 2.97$). The v-SPI results [Figs. 3(c)–3(i)] were reconstructed using Gaussian PSF model h2 in different sizes (${\sigma ^{\prime}_2}$=0.9, 1.2…, 3.0), respectively. By comparing the v-SPI results [Figs. 3(c)–3(i)], it can be found that the dense strips in the central zone gradually become visible with increased ${\sigma ^{\prime}_2}$. However, the oversized PSFs (${\sigma ^{\prime}_2}$>1.5) may have little contribution to the resolution improvement and cause artifacts in the reconstructed results. Therefore, the smaller 2D PSF h2 with CSD of 1.5 (${\sigma ^{\prime}_2} = 1.5$) was used in v-SPI to retrieve results in this simulation. It should be noted that the suitable CSD of the PSF h2 (${\sigma ^{\prime}_2}$) may vary with respect to the changed CSD of system PSF ($\sigma ^{\prime}$). The selected CSD (${\sigma ^{\prime}_2} = 1.5$) only can be used for the case simulated here.

Then, three different deconvolution methods, including Regularized inverse filtering (RIF) method, Richardson-Lucy (RL) deconvolution method and RL with total-variation regularization (RL-TV) method, are adopted for performance comparison. As seen in Figs. 4(c)–4(f), it exhibits the retrieved images of v-SPI, RIF, RL and RL-TV, respectively. The result of v-SPI was obtained by using MATLAB (R2015b) on a computer equipped with 8 CPU (Intel Xeon E5-1620 v4 @3.5 GHz). Results of other three deconvolution methods are computed with a free software package (DeconvolutionLab2) [8]. Parameters of used deconvolution methods are set as follows: regularization parameter λRIF=0.01, iterative number NRL=100, regularization parameter λRL-TV = 1E-12 and iterative number NRL-TV = 20. The simulated 2D system PSF is used by three comparative methods (RIF, RL and RL-TV).

 figure: Fig. 4.

Fig. 4. Comparison of simulation results. (a) The fluorescence density of the spoke-like sample. (b) The blurred fluorescence image. (c)-(f) Deconvolution results of v-SPI, RIF, RL and RL-TV, respectively. (g) Contrast curves. The scale bars represent a distance of 2 µm.

Download Full Size | PDF

To estimate the ability of contrast enhancement, we calculated the contrast C(p) from the blurred image and results of four numerical processing methods (v-SPI, RIF, RL and RL-TV) as a function of the period (in wavelength, λem=500nm):

$$C(p )= {{[{\max ({{f_p}} )- \min ({{f_p}} )} ]} \mathord{\left/ {\vphantom {{[{\max ({{f_p}} )- \min ({{f_p}} )} ]} {({{f_{\max }} - {f_{\min }}} )}}} \right.} {({{f_{\max }} - {f_{\min }}} )}}$$
where fp represents the intensities corresponding to the period p, fmax and fmin are maximum and minimum intensity of the whole image.

The calculated contrast curves of the blurred image and results of four deconvolution methods are shown in Fig. 4(g). The black dot dash line denotes the contrast about 0.1, i.e., the contrast is still ‘eye-visible’ [20]. This figure illustrates the fact that, there still exist areas in the blurred fluorescence image with small contrast but ‘eye-invisible’ when the periods are smaller than the Rayleigh criterion (0.61λem/NA 0.42λem).

As shown in Fig. 4(g), the RIF method and the RL-TV method mainly increase the contrast for sparse structures (periods bigger than the Rayleigh criterion), while the RL method can work for the more dense structures (0.37λem, slightly smaller than the Rayleigh criterion). In comparison, the uniform and significant contrast enhancement can be seen in the result of v-SPI even when the periods smaller than Rayleigh criterion (till to 0.3λem). It means that, by greatly enhancing the contrast of the areas which originally have weak contrast but ‘eye-invisible’, v-SPI method acquired the resolution improvement of 0.12λem. Comparing the radius of yellow circles in Figs. 4(b)–4(f), we can intuitively see the resolution improvement of v-SPI than the blurred image and results of other three deconvolution methods.

To assess the noise sensitivity of the proposed method, the simulation fluorescence image [ Fig. 5(a)] was contaminated by Poisson noise and then processed by using v-SPI, RIF, RL and RL-TV respectively, as shown in Figs. 5(b)–5(e). The signal to noise ratio (SNR) was calculated as follows to quantitatively assess the noise sensitivity [27],

$$SNR = 10 \ast \log \left( {\frac{{{{({{{\bar{I}}_{signal}}} )}^2}}}{{{{({{{\bar{I}}_{noise}}} )}^2}}}} \right)$$
where, ${\bar{I}_{signal}}$ and ${\bar{I}_{noise}}$ are the mean values of signal and noise components, respectively. As shown in Fig. 5, tiny Poisson noise in the blurred fluorescence image nearly have no influence on the results of RIF, RL and RL-TV, but cause obvious noise in the v-SPI result (SNR was reduced from 36 dB to 19 dB). It is verified that, the v-SPI method is more sensitive to noise than other three deconvolution methods.

 figure: Fig. 5.

Fig. 5. Assessment of noise sensitivity. (a) The blurred fluorescence image which was contaminated by Poisson noise. (b-e) Results of v-SPI, RIF, RL and RL-TV, respectively.

Download Full Size | PDF

4. Experimental results

After numerical study, the proposed v-SPI method was then tested with experimental images obtained using a wide-field microscope (Nikon Ti-2A) in epi-illumination mode. A commercial sample (Fluocells prepared slide#1, Invitrogen) with stained BPAE cells was used, in which F-actin was stained using green-fluorescent Alexa Fluor 488 phalloidin. The F-actin in the fixed BPAE cells was uniformly illuminated through a high-numerical aperture objective (NA = 1.45, ×100, Plan Apo λ, Nikon) at an excitation wavelength of 488 nm. Emitted fluorescent light was filtered using a band-pass filter (ZET488/640m, Chroma, λem = 510 nm). The fluorescence light was then imaged by a Scientific CMOS camera (ORCA-Flash 4.0, HAMAMATSU) with pixel size of 65 nm (after magnification). In this experiment, the v-SPI results were reconstructed with the Gaussian PSF models h2 which has the CSD of 1.1 (${\sigma ^{\prime}_2} = 1.1$).

In comparison, the fine structure of F-actin which is difficult to distinguish in the captured wide-field image [Fig. 6(a)], was retrieved in the v-SPI image [Fig. 6(b)]. It implies the obvious resolution enhancement of v-SPI method. As shown in the intensity profiles [Fig. 6(g)], two close F-actin which have a distance of 167 nm between each other, can be distinguished in the v-SPI image. And the distance is 47 nm shorter than the Rayleigh criterion (0.42 λem, 215nm). In order to verify the factuality of v-SPI result, the sample was also imaged with an established SR technique [11] (multifocal structured illumination microscopy, MSIM), as shown in Fig. 6(f). From the retrieved images and the intensity profiles, we can see similar structures of F-actin both in v-SPI result and MISM image. By comparing the retrieved images of four deconvolution methods (v-SPI, RIF, RL and RL-TV) and the intensity profiles, we can clearly see that much larger enhancement in image contrast can be obtained by v-SPI method.

 figure: Fig. 6.

Fig. 6. Experimental results for F-actin in a fixed cell. (a) Wide-field fluorescence image. (b-e) Four deconvolution results (v-SPI, RIF, RL and RL-TV), respectively. (f) MSIM image. (g) Intensity profiles. Scale bars (in magnified views): 0.5 µm.

Download Full Size | PDF

To verify the applicability of v-SPI in imaging live cells, we also performed dynamic imaging of mitochondria in living COS-7 cells, as shown in Fig. 7 and Visualization 1. The sample was stained with commercial MitoTracker (MitoTraker Green FM probe, Thermo Fisher Scientific). The mitochondrial dynamics was recorded using a wide-field microscope. In this experiment, the sample was uniformly illuminated through a TIRF objective lens (NA = 1.49, ×60, ApoTIRF, Nikon) at an excitation wavelength of 488 nm. The wide-field images were captured with 1.5-fold interpolation (using the microscope). During the image acquisition process, the exposure time was set to 500 ms, to improve the SNR of the captured images. From the captured wide-field image of mitochondria [Figs. 7(a) and 7(c)], we find the difficulty in observing the clear structure and dynamic movements of mitochondrial cristae in living cells. However, after processed with v-SPI method, the complicated structures of mitochondria in the living cells become visible [see Figs. 6(b)–6(c), Visualization 1] due to contrast enhancement and improved spatial resolution. By using v-SPI method, we could even identify the fusion process of cristae in a single mitochondrion [Fig. 6(b)].

 figure: Fig. 7.

Fig. 7. Experimental results for mitochondria in living cell.(a) Blurred fluorescence image. (b) v-SPI result. (c) Image sequence in the magnified view. Scale bars: 250 nm.

Download Full Size | PDF

5. Discussions

Although the excellent performance of proposed v-SPI method has been demonstrated with simulation and experimental results, many considerations also need to be taken into account in practice. At first, the v-SPI method belongs to a 2D deconvolution method, thin-layer sample imaging is required to avoid the influence of defocus signals. However, we still can image thick sample by combining v-SPI method with optical-sectioning techniques, such as confocal, SIM and SD method [28].

When a suitable PSF h2 is used in v-SPI method, we can obtain the reconstructed results with better contrast enhancement and less artifacts. Actually, as the wide-field images may be captured with various microscope systems, the suitable CSD of the PSF h2 (${\sigma ^{\prime}_2}$) should be determined according to the CSD of system PSF ($\sigma ^{\prime}$). Here, to facilitate the application of v-SPI method in practice, we provide some empirical values (${\sigma ^{\prime}_2}$) which can be selected based on the CSD of nominal system PSF ($\sigma ^{\prime}$) and shown as following:

$$\left\{ {\begin{array}{c} {{{\sigma^{\prime}}_2} = 0.85 \sim 1.2\quad \quad 0.85 \le \sigma^{\prime} < 1.5}\\ {{{\sigma^{\prime}}_2} = 1.2 \sim 1.5\quad \;\,\,\quad 1.5 \le \sigma^{\prime}\;\,\quad \;\;\;\,} \end{array}} \right.$$

In view of the Nyquist criterion, the pixel size d should be less than the half FWHM of system PSF (d ≤ FWHM/2). And considering the relationship between FWHM and standard deviation of system PSF (FWHM=2.355σ), small CSDs ($\sigma ^{\prime} < 0.85$) thus do not listed in Eq. (12). For a microscope system with too large CSD (like in the simulation,$\sigma ^{\prime} = 2.97$), the selected CSD of PSF h2 should be less than 1.5 (${\sigma ^{\prime}_2}$≤ 1.5) to avoid artifacts.

Finally, the boundary effect should be noted in application of the proposed v-SPI method. The fluorophores that are outside the fluorophore density x and close to the borders also contribute to the intensity of captured wide-field image I. However, the influence of these fluorophores is neglected in the reconstruction procedure, which will cause artifacts in the edge areas of the reconstructed image. In order to address the boundary effect, we can simply cut the false edge areas out from the reconstructed image. Usually, the width of removed edge areas can be set as the FWHM of system PSF.

6. Conclusions

In this paper, a novel deconvolution method is proposed to improve the spatial resolution, which does not require calibration of system parameters. From simulation and experimental results, it is revealed that an increase in resolution of 24% (0.12/0.5) is achieved by v-SPI method. Furthermore, it may be applied as a post-processing approach for other diffraction-limited or super-resolution techniques (such as confocal, two-photon, and STED methods) to further improve spatial resolution.

Funding

National Key Research and Development Program of China (2017YFA0700500); National Natural Science Foundation of China (61975131, 61875131, 61775144, 61620106016, 61525503); Key Project of Department of Education of Guangdong Province (2016KCXTD007); Natural Science Foundation of Guangdong Province (2018A030313362); Shenzhen Basic Research Project (JCYJ20170412105003520, JCYJ20170818141701667, JCYJ20170818144012025).

Disclosures

The authors declare no conflicts of interest.

References

1. S. J. Sahl, S. W. Hell, and S. Jakobs, “Fluorescence nanoscopy in cell biology,” Nat. Rev. Mol. Cell Biol. 18(11), 685–701 (2017). [CrossRef]  

2. J. B. Grimm, A. K. Muthusamy, Y. Liang, T. A. Brown, and W. C. Lemon, “A general method to fine-tune fluorophores for live-cell and in-vivo imaging,” Nat. Methods 14(10), 987–994 (2017). [CrossRef]  

3. H. Zhu, J. L. Fan, J. J. Du, and X. J. Peng, “Fluorescent probes for sensing and imaging within specific cellular organelles,” Acc. Chem. Res. 49(10), 2115–2126 (2016). [CrossRef]  

4. S. W. Hell, “Far-field optical nanoscopy,” Science 316(5828), 1153–1158 (2007). [CrossRef]  

5. S. Colin, “Super-resolution in confocal imaging,” Optik 80(2), 53–54 (1988).

6. T. A. Klar, S. Jakobs, M. Dyba, A. Egner, and S. W. Hell, “Fluorescence microscopy with diffraction resolution barrier broken by simulated emission,” Proc. Natl. Acad. Sci. U. S. A. 97(15), 8206–8210 (2000). [CrossRef]  

7. M. G. L. Gustafsson, “Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy,” J. Microsc. 198(2), 82–87 (2000). [CrossRef]  

8. S. Daniel, D. Lauréne, S. Ferréol, F. Soulez, D. Fortun, G. Schmit, A. Seitz, R. Guiet, C. Vonesch, and M. Unser, “DeconvolutionLab2: An open source software for deconvolution microscopy,” Methods 115, 28–41 (2017). [CrossRef]  

9. J. B. Sibarita, “Deconvolution microscopy,” Adv. Biochem. Eng./Biotechnol. 95, 201–243 (2005). [CrossRef]  

10. J. Z. Li, L. Florian, and B. Thierry, “PURE-LET Image Deconvolution,” IEEE T. Image Process. 27(1), 92–105 (2018). [CrossRef]  

11. A. G. York, S. H. Parekh, D. DalleNogare, R. S. Fischer, K. Temprine, M. Mione, A. B. Chitnis, C. A. Combs, and H. Shroff, “Resolution doubling in live, multicellular organisms via multifocal structured illumination microscopy,” Nat. Methods 9(7), 749–754 (2012). [CrossRef]  

12. V. Perez, B-C. Chang, and E. H. K. Steltzer, “Optimal 2D-SIM reconstruction by two filtering steps with Richardson Lucy deconvolution,” Sci. Rep. 6(1), 37149 (2016). [CrossRef]  

13. Y. Zhang, S. Lang, H. Wang, J Liao, and Y. Gong, “Super-resolution algorithm based on Richardson–Lucy deconvolution for three-dimensional structured illumination microscopy,” J. Opt. Soc. Am. 36(2), 173–178 (2019). [CrossRef]  

14. M. Wang, S. D. Zhou, and W. Yan, “Blurred image restoration using knife-edge function and optimal window Wiener filtering,” PLoS One 13(1), e0191833 (2018). [CrossRef]  

15. R. Gold, An Iterative Unfolding Method for Response Matrices (Argonne National Lab, 1964).

16. A. Tikhonov, “Solution of incorrectly formulated problems and the regularization method,” Soviet Mathematics Dokl. 5, 1035–1038 (1963).

17. W. H. Richardson, “Bayesian-based iterative method of image restoration,” J. Opt. Soc. Am. 62(1), 55–59 (1972). [CrossRef]  

18. L. B. Lucy, “An iterative technique for the rectification of observed distribution,” Astron. J. 79, 745–754 (1974). [CrossRef]  

19. K. Sami, T. Giorgio, C. Marco, D. Takahiro, D. Alberto, and V. Giuseppe, “Fourier ring correlation simplifies image restoration in fluorescence microscopy,” Nat. Commun. 10(1), 3103 (2019). [CrossRef]  

20. E. Mudry, K. Belkebir, J. Girard, J. Savatier, E. L. Moal, C. Nicoletti, M. Allain, and A. Sentenac, “Structured illumination microscopy using unknown speckle patterns,” Nat. Photonics 6(5), 312–315 (2012). [CrossRef]  

21. J. Liu, W. Min, J. A. Conchello, X. S. Xie, and J. W. Lichtman, “Super-resolution laser scanning microscopy through spatiotemporal modulation,” Nano Lett. 9(11), 3883–3889 (2009). [CrossRef]  

22. R. W. Lu, B. Q. Wang, Q. X. Zhang, and X. C. Yao, “Super-resolution laser microscopy through virtually structured detection,” Biomed. Opt. Express 4(9), 1673–1682 (2013). [CrossRef]  

23. C. F. Kuang, Y. Ma, R. J. Zhou, G. A. Zheng, Y. Fang, Y. K. Xu, X. Liu, and T. C. S. Peter, “Virtual k-space modulation optical microscopy,” Phys. Rev. Lett. 117(2), 028102 (2016). [CrossRef]  

24. B. Sun, M. P. Edgar, R. Bowman, L. E. Vittert, S. Welsh, A. Bowman, and M. J. Padgett, “3D computational imaging with single-pixel detectors,” Science 340(6134), 844–847 (2013). [CrossRef]  

25. L. H. Bian, J. L. Suo, Q. G. Dai, and F. Chen, “Experimental comparison of single-pixel imaging algorithms,” J. Opt. Soc. Am. A 35(1), 78–87 (2018). [CrossRef]  

26. Bo Zhang, J. Zerubia, and J.-C. Olivo-Marin, “Gaussian approximations of fluorescence microscope point-spread function models,” Appl. Opt. 46(10), 1819–1829 (2007). [CrossRef]  

27. D. Sage, H. Kirshner, T. Pengo, N. Stuurman, J. Min, S. Manley, and M. Unser, “Quantitative evaluation of software packages for single-molecule localization microscopy,” Nat. Methods 12(8), 717–724 (2015). [CrossRef]  

28. W. Zhang, B. Yu, D. Y. Lin, H. H. Yu, S. W. Li, and J. L. Qu, “Optimized approach for optical sectioning enhancement in multifocal structured illumination microscopy,” Opt. Express 28(8), 10919–10927 (2020). [CrossRef]  

Supplementary Material (1)

NameDescription
Visualization 1       comparison of mitochondria in living cell

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (7)

Fig. 1.
Fig. 1. Schematic diagram of the system set-up and the equivalence relationship between integral values.
Fig. 2.
Fig. 2. Schematic diagram of v-SPI.
Fig. 3.
Fig. 3. Reconstructed results with different model sizes. (a) The simulated fluorescence sample. (b) The blurred image. (c)-(i) Reconstructed results of v-SPI with Gaussian PSF models in different sizes ( ${\sigma ^{\prime}_2}$  = 0.9, 1.2, …, 3.0), respectively. The scale bars represent a distance of 2 µm.
Fig. 4.
Fig. 4. Comparison of simulation results. (a) The fluorescence density of the spoke-like sample. (b) The blurred fluorescence image. (c)-(f) Deconvolution results of v-SPI, RIF, RL and RL-TV, respectively. (g) Contrast curves. The scale bars represent a distance of 2 µm.
Fig. 5.
Fig. 5. Assessment of noise sensitivity. (a) The blurred fluorescence image which was contaminated by Poisson noise. (b-e) Results of v-SPI, RIF, RL and RL-TV, respectively.
Fig. 6.
Fig. 6. Experimental results for F-actin in a fixed cell. (a) Wide-field fluorescence image. (b-e) Four deconvolution results (v-SPI, RIF, RL and RL-TV), respectively. (f) MSIM image. (g) Intensity profiles. Scale bars (in magnified views): 0.5 µm.
Fig. 7.
Fig. 7. Experimental results for mitochondria in living cell.(a) Blurred fluorescence image. (b) v-SPI result. (c) Image sequence in the magnified view. Scale bars: 250 nm.

Equations (12)

Equations on this page are rendered with MathJax. Learn more.

I ( x , y ) = S ( x , y ) h ( x x , y y ) d x d y
M i ( x , y ) = I ( x , y ) P i ( x , y ) , i = 1 , , m
b i = M i ( x , y ) d x d y = [ S ( x , y ) h ( x x , y y ) d x d y ] P i ( x , y ) d x d y
b i = [ P i ( x , y ) h ( x x , y y ) d x d y ] S ( x , y ) d x d y
P i ( x , y ) = P i ( x , y ) h ( x x , y y ) d x d y
b i = P i ( x , y ) S ( x , y ) d x d y
( S h ) P i = S ( P i h )
A X = b
[ S ( h 1 h 2 ) ] P i = [ ( S h 1 ) h 2 ] P i = S ( P i h 2 )
C ( p ) = [ max ( f p ) min ( f p ) ] / [ max ( f p ) min ( f p ) ] ( f max f min ) ( f max f min )
S N R = 10 log ( ( I ¯ s i g n a l ) 2 ( I ¯ n o i s e ) 2 )
{ σ 2 = 0.85 1.2 0.85 σ < 1.5 σ 2 = 1.2 1.5 1.5 σ
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.