Abstract

Spatial resolution of conventional far-field fluorescence microscopy is limited by diffraction of light. Single-molecule localization microscopy (SMLM), such as (direct) stochastic optical reconstruction microscopy (dSTORM/STORM), and (fluorescence) photoactivation localization microscopy (fPALM/PALM), can break this barrier by localizing single emitters and reconstructing super-resolution image with much higher precision. Nevertheless, a SMLM measurement needs to record a large number of image frames and takes considerable recording time. In this process, sample drift becomes a critical problem and cannot be neglected. In this Letter, we present a sub-nanometer precision, low-cost sample drift correction method based on minimizing normalized root-mean-square error (NRMSE) between bright field images. Two optical configurations are suggested for recording bright field and fluorescence images simultaneously or alternately. The method was demonstrated on simulated data, and better than 0.3 nm drift correction precision was achieved. It was also applied on dSTORM imaging of F-actins of 3T3 cell, and the quality of reconstructed super-resolution image was improved observably. This method does not require special hardware, extra labelling or markers, and no precision decline due to photobleaching. It can be applied as an add-on for SMLM setups and achieves sub-nanometer precision drift correction for post-measurement or real time drift compensation.

© 2014 Optical Society of America

Full Article  |  PDF Article
OSA Recommended Articles
Using fixed fiduciary markers for stage drift correction

Sang Hak Lee, Murat Baday, Marco Tjioe, Paul D. Simonson, Ruobing Zhang, En Cai, and Paul R. Selvin
Opt. Express 20(11) 12177-12183 (2012)

Sample drift correction in 3D fluorescence photoactivation localization microscopy

Michael J. Mlodzianoski, John M. Schreiner, Steven P. Callahan, Katarina Smolková, Andrea Dlasková, Jitka Šantorová, Petr Ježek, and Joerg Bewersdorf
Opt. Express 19(16) 15009-15019 (2011)

Localization events-based sample drift correction for localization microscopy with redundant cross-correlation algorithm

Yina Wang, Joerg Schnitzbauer, Zhe Hu, Xueming Li, Yifan Cheng, Zhen-Li Huang, and Bo Huang
Opt. Express 22(13) 15982-15991 (2014)

References

  • View by:
  • |
  • |
  • |

  1. E. Abbe, Archiv fuer Mikroskopische Anatomie und Entwicklungsmechanik 9, 413 (1873).
    [Crossref]
  2. S. T. Hess, T. P. K. Girirajan, and M. D. Mason, Biophys. J. 91, 4258 (2006).
    [Crossref]
  3. M. F. Juette, T. J. Gould, M. D. Lessard, M. J. Mlodzianoski, B. S. Nagpure, B. T. Bennett, S. T. Hess, and J. Bewersdorf, Nat. Methods 5, 527 (2008).
    [Crossref]
  4. E. Betzig, G. H. Patterson, R. Sougrat, O. W. Lindwasser, S. Olenych, J. S. Bonifacino, M. W. Davidson, J. Lippincott-Schwartz, and H. F. Hess, Science 313, 1642 (2006).
    [Crossref]
  5. M. J. Rust, M. Bates, and X. Zhuang, Nat. Methods 3, 793 (2006).
    [Crossref]
  6. A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
    [Crossref]
  7. S. H. Lee, M. Baday, M. Tjioe, P. D. Simonson, R. Zhang, E. Cai, and P. R. Selvin, Opt. Express 20, 12177 (2012).
    [Crossref]
  8. M. J. Mlodzianoski, J. M. Schreiner, S. P. Callahan, K. Smolková, A. Dlasková, J. Šantorová, P. Ježek, and J. Bewersdorf, Opt. Express 19, 15009 (2011).
    [Crossref]
  9. L. Nugent-Glandorf and T. T. Perkins, Opt. Lett. 29, 2611 (2004).
    [Crossref]
  10. A. R. Carter, G. M. King, T. A. Ulrich, W. Halsey, D. Alchenberger, and T. T. Perkins, Appl. Opt. 46, 421 (2007).
    [Crossref]
  11. C. Geisler, T. Hotz, A. Schönle, S. W. Hell, A. Munk, and A. Egner, Opt. Express 20, 7274 (2012).
    [Crossref]
  12. A. R. Wade and F. W. Fitzke, Opt. Express 3, 190 (1998).
    [Crossref]
  13. J. R. Fienup, Appl. Opt. 36, 8352 (1997).
    [Crossref]
  14. M. Guizar-Sicairos, S. T. Thurman, and J. R. Fienup, Opt. Lett. 33, 156 (2008).
    [Crossref]
  15. Y. Wang, J. Schnitzbauer, Z. Hu, X. Li, Y. Cheng, Z.-L. Huang, and B. Huang, Opt. Express 22, 15982 (2014).
    [Crossref]
  16. R. G. Lyons, Understanding Digital Signal Processing, 3rd ed. (Prentice Hall, 2010).
  17. K. Levenberg, Quart. Appl. Math. 2, 164 (1944).
  18. D. W. Marquardt, SIAM J. Appl. Math. 11, 431 (1963).
    [Crossref]
  19. Y. M. Blanter and M. Büttiker, Phys. Rep. 336, 1 (2000).
    [Crossref]

2014 (1)

2012 (2)

2011 (1)

2008 (2)

M. F. Juette, T. J. Gould, M. D. Lessard, M. J. Mlodzianoski, B. S. Nagpure, B. T. Bennett, S. T. Hess, and J. Bewersdorf, Nat. Methods 5, 527 (2008).
[Crossref]

M. Guizar-Sicairos, S. T. Thurman, and J. R. Fienup, Opt. Lett. 33, 156 (2008).
[Crossref]

2007 (2)

A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
[Crossref]

A. R. Carter, G. M. King, T. A. Ulrich, W. Halsey, D. Alchenberger, and T. T. Perkins, Appl. Opt. 46, 421 (2007).
[Crossref]

2006 (3)

E. Betzig, G. H. Patterson, R. Sougrat, O. W. Lindwasser, S. Olenych, J. S. Bonifacino, M. W. Davidson, J. Lippincott-Schwartz, and H. F. Hess, Science 313, 1642 (2006).
[Crossref]

M. J. Rust, M. Bates, and X. Zhuang, Nat. Methods 3, 793 (2006).
[Crossref]

S. T. Hess, T. P. K. Girirajan, and M. D. Mason, Biophys. J. 91, 4258 (2006).
[Crossref]

2004 (1)

2000 (1)

Y. M. Blanter and M. Büttiker, Phys. Rep. 336, 1 (2000).
[Crossref]

1998 (1)

1997 (1)

1963 (1)

D. W. Marquardt, SIAM J. Appl. Math. 11, 431 (1963).
[Crossref]

1944 (1)

K. Levenberg, Quart. Appl. Math. 2, 164 (1944).

1873 (1)

E. Abbe, Archiv fuer Mikroskopische Anatomie und Entwicklungsmechanik 9, 413 (1873).
[Crossref]

Abbe, E.

E. Abbe, Archiv fuer Mikroskopische Anatomie und Entwicklungsmechanik 9, 413 (1873).
[Crossref]

Alchenberger, D.

Andresen, M.

A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
[Crossref]

Baday, M.

Bates, M.

M. J. Rust, M. Bates, and X. Zhuang, Nat. Methods 3, 793 (2006).
[Crossref]

Bennett, B. T.

M. F. Juette, T. J. Gould, M. D. Lessard, M. J. Mlodzianoski, B. S. Nagpure, B. T. Bennett, S. T. Hess, and J. Bewersdorf, Nat. Methods 5, 527 (2008).
[Crossref]

Betzig, E.

E. Betzig, G. H. Patterson, R. Sougrat, O. W. Lindwasser, S. Olenych, J. S. Bonifacino, M. W. Davidson, J. Lippincott-Schwartz, and H. F. Hess, Science 313, 1642 (2006).
[Crossref]

Bewersdorf, J.

M. J. Mlodzianoski, J. M. Schreiner, S. P. Callahan, K. Smolková, A. Dlasková, J. Šantorová, P. Ježek, and J. Bewersdorf, Opt. Express 19, 15009 (2011).
[Crossref]

M. F. Juette, T. J. Gould, M. D. Lessard, M. J. Mlodzianoski, B. S. Nagpure, B. T. Bennett, S. T. Hess, and J. Bewersdorf, Nat. Methods 5, 527 (2008).
[Crossref]

Blanter, Y. M.

Y. M. Blanter and M. Büttiker, Phys. Rep. 336, 1 (2000).
[Crossref]

Bock, H.

A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
[Crossref]

Bonifacino, J. S.

E. Betzig, G. H. Patterson, R. Sougrat, O. W. Lindwasser, S. Olenych, J. S. Bonifacino, M. W. Davidson, J. Lippincott-Schwartz, and H. F. Hess, Science 313, 1642 (2006).
[Crossref]

Büttiker, M.

Y. M. Blanter and M. Büttiker, Phys. Rep. 336, 1 (2000).
[Crossref]

Cai, E.

Callahan, S. P.

Carter, A. R.

Cheng, Y.

Davidson, M. W.

E. Betzig, G. H. Patterson, R. Sougrat, O. W. Lindwasser, S. Olenych, J. S. Bonifacino, M. W. Davidson, J. Lippincott-Schwartz, and H. F. Hess, Science 313, 1642 (2006).
[Crossref]

Dlasková, A.

Eggeling, C.

A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
[Crossref]

Egner, A.

C. Geisler, T. Hotz, A. Schönle, S. W. Hell, A. Munk, and A. Egner, Opt. Express 20, 7274 (2012).
[Crossref]

A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
[Crossref]

Fienup, J. R.

Fitzke, F. W.

Geisler, C.

C. Geisler, T. Hotz, A. Schönle, S. W. Hell, A. Munk, and A. Egner, Opt. Express 20, 7274 (2012).
[Crossref]

A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
[Crossref]

Girirajan, T. P. K.

S. T. Hess, T. P. K. Girirajan, and M. D. Mason, Biophys. J. 91, 4258 (2006).
[Crossref]

Gould, T. J.

M. F. Juette, T. J. Gould, M. D. Lessard, M. J. Mlodzianoski, B. S. Nagpure, B. T. Bennett, S. T. Hess, and J. Bewersdorf, Nat. Methods 5, 527 (2008).
[Crossref]

Guizar-Sicairos, M.

Halsey, W.

Hell, S. W.

C. Geisler, T. Hotz, A. Schönle, S. W. Hell, A. Munk, and A. Egner, Opt. Express 20, 7274 (2012).
[Crossref]

A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
[Crossref]

Hess, H. F.

E. Betzig, G. H. Patterson, R. Sougrat, O. W. Lindwasser, S. Olenych, J. S. Bonifacino, M. W. Davidson, J. Lippincott-Schwartz, and H. F. Hess, Science 313, 1642 (2006).
[Crossref]

Hess, S. T.

M. F. Juette, T. J. Gould, M. D. Lessard, M. J. Mlodzianoski, B. S. Nagpure, B. T. Bennett, S. T. Hess, and J. Bewersdorf, Nat. Methods 5, 527 (2008).
[Crossref]

S. T. Hess, T. P. K. Girirajan, and M. D. Mason, Biophys. J. 91, 4258 (2006).
[Crossref]

Hotz, T.

Hu, Z.

Huang, B.

Huang, Z.-L.

Jakobs, S.

A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
[Crossref]

Ježek, P.

Juette, M. F.

M. F. Juette, T. J. Gould, M. D. Lessard, M. J. Mlodzianoski, B. S. Nagpure, B. T. Bennett, S. T. Hess, and J. Bewersdorf, Nat. Methods 5, 527 (2008).
[Crossref]

King, G. M.

Lee, S. H.

Lessard, M. D.

M. F. Juette, T. J. Gould, M. D. Lessard, M. J. Mlodzianoski, B. S. Nagpure, B. T. Bennett, S. T. Hess, and J. Bewersdorf, Nat. Methods 5, 527 (2008).
[Crossref]

Levenberg, K.

K. Levenberg, Quart. Appl. Math. 2, 164 (1944).

Li, X.

Lindwasser, O. W.

E. Betzig, G. H. Patterson, R. Sougrat, O. W. Lindwasser, S. Olenych, J. S. Bonifacino, M. W. Davidson, J. Lippincott-Schwartz, and H. F. Hess, Science 313, 1642 (2006).
[Crossref]

Lippincott-Schwartz, J.

E. Betzig, G. H. Patterson, R. Sougrat, O. W. Lindwasser, S. Olenych, J. S. Bonifacino, M. W. Davidson, J. Lippincott-Schwartz, and H. F. Hess, Science 313, 1642 (2006).
[Crossref]

Lyons, R. G.

R. G. Lyons, Understanding Digital Signal Processing, 3rd ed. (Prentice Hall, 2010).

Marquardt, D. W.

D. W. Marquardt, SIAM J. Appl. Math. 11, 431 (1963).
[Crossref]

Mason, M. D.

S. T. Hess, T. P. K. Girirajan, and M. D. Mason, Biophys. J. 91, 4258 (2006).
[Crossref]

Medda, R.

A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
[Crossref]

Mlodzianoski, M. J.

M. J. Mlodzianoski, J. M. Schreiner, S. P. Callahan, K. Smolková, A. Dlasková, J. Šantorová, P. Ježek, and J. Bewersdorf, Opt. Express 19, 15009 (2011).
[Crossref]

M. F. Juette, T. J. Gould, M. D. Lessard, M. J. Mlodzianoski, B. S. Nagpure, B. T. Bennett, S. T. Hess, and J. Bewersdorf, Nat. Methods 5, 527 (2008).
[Crossref]

Munk, A.

Nagpure, B. S.

M. F. Juette, T. J. Gould, M. D. Lessard, M. J. Mlodzianoski, B. S. Nagpure, B. T. Bennett, S. T. Hess, and J. Bewersdorf, Nat. Methods 5, 527 (2008).
[Crossref]

Nugent-Glandorf, L.

Olenych, S.

E. Betzig, G. H. Patterson, R. Sougrat, O. W. Lindwasser, S. Olenych, J. S. Bonifacino, M. W. Davidson, J. Lippincott-Schwartz, and H. F. Hess, Science 313, 1642 (2006).
[Crossref]

Patterson, G. H.

E. Betzig, G. H. Patterson, R. Sougrat, O. W. Lindwasser, S. Olenych, J. S. Bonifacino, M. W. Davidson, J. Lippincott-Schwartz, and H. F. Hess, Science 313, 1642 (2006).
[Crossref]

Perkins, T. T.

Rust, M. J.

M. J. Rust, M. Bates, and X. Zhuang, Nat. Methods 3, 793 (2006).
[Crossref]

Šantorová, J.

Schnitzbauer, J.

Schönle, A.

C. Geisler, T. Hotz, A. Schönle, S. W. Hell, A. Munk, and A. Egner, Opt. Express 20, 7274 (2012).
[Crossref]

A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
[Crossref]

Schreiner, J. M.

Selvin, P. R.

Simonson, P. D.

Smolková, K.

Sougrat, R.

E. Betzig, G. H. Patterson, R. Sougrat, O. W. Lindwasser, S. Olenych, J. S. Bonifacino, M. W. Davidson, J. Lippincott-Schwartz, and H. F. Hess, Science 313, 1642 (2006).
[Crossref]

Stiel, A. C.

A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
[Crossref]

Thurman, S. T.

Tjioe, M.

Ulrich, T. A.

von Middendorff, C.

A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
[Crossref]

Wade, A. R.

Wang, Y.

Wenzel, D.

A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
[Crossref]

Zhang, R.

Zhuang, X.

M. J. Rust, M. Bates, and X. Zhuang, Nat. Methods 3, 793 (2006).
[Crossref]

Appl. Opt. (2)

Archiv fuer Mikroskopische Anatomie und Entwicklungsmechanik (1)

E. Abbe, Archiv fuer Mikroskopische Anatomie und Entwicklungsmechanik 9, 413 (1873).
[Crossref]

Biophys. J. (2)

S. T. Hess, T. P. K. Girirajan, and M. D. Mason, Biophys. J. 91, 4258 (2006).
[Crossref]

A. Egner, C. Geisler, C. von Middendorff, H. Bock, D. Wenzel, R. Medda, M. Andresen, A. C. Stiel, S. Jakobs, C. Eggeling, A. Schönle, and S. W. Hell, Biophys. J. 93, 3285 (2007).
[Crossref]

Nat. Methods (2)

M. F. Juette, T. J. Gould, M. D. Lessard, M. J. Mlodzianoski, B. S. Nagpure, B. T. Bennett, S. T. Hess, and J. Bewersdorf, Nat. Methods 5, 527 (2008).
[Crossref]

M. J. Rust, M. Bates, and X. Zhuang, Nat. Methods 3, 793 (2006).
[Crossref]

Opt. Express (5)

Opt. Lett. (2)

Phys. Rep. (1)

Y. M. Blanter and M. Büttiker, Phys. Rep. 336, 1 (2000).
[Crossref]

Quart. Appl. Math. (1)

K. Levenberg, Quart. Appl. Math. 2, 164 (1944).

Science (1)

E. Betzig, G. H. Patterson, R. Sougrat, O. W. Lindwasser, S. Olenych, J. S. Bonifacino, M. W. Davidson, J. Lippincott-Schwartz, and H. F. Hess, Science 313, 1642 (2006).
[Crossref]

SIAM J. Appl. Math. (1)

D. W. Marquardt, SIAM J. Appl. Math. 11, 431 (1963).
[Crossref]

Other (1)

R. G. Lyons, Understanding Digital Signal Processing, 3rd ed. (Prentice Hall, 2010).

Cited By

OSA participates in Crossref's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (4)

Fig. 1.
Fig. 1.

Schema of optical setups for super-resolution imaging with drift correction. (a) Laser and LED illuminations are switched alternately, fluorescence and bright field images are recorded with the same EMCCD camera; (b) laser and LED illuminations are switched simultaneously, and fluorescence and bright field images are recorded with an EMCCD and a CCD camera separately. DM denotes dichroic beamsplitter and M denotes mirror.

Fig. 2.
Fig. 2.

Anti-drift for artificially drifted bright field image sequence for 4000 frames on two directions, respectively: (a), (d) sample drift traces; (b), (e) anti-drift error and its histogram and precision (c), (f).

Fig. 3.
Fig. 3.

Means and standard deviations (SD) of drift correction errors for 20 simulated image sequences (4000 frames) with different drift step lengths. The precisions of drift corrections are better than 0.3 nm in all cases for both x and y directions.

Fig. 4.
Fig. 4.

dSTORM imaging of F-actins of the 3T3 cell. Scale bar is 2 μm. (a) Super-resolution image without drift correction. (b) Super-resolution image with drift correction. (c) Bright field image. (d) Sample drifts of x and y directions, respectively. (e) The profiles of selective region (yellow window) projected on a base line (yellow line) in original and drift-corrected super-resolution images.

Equations (3)

Equations on this page are rendered with MathJax. Learn more.

α,d=argminα,dx,y|αgd(x,y)f(x,y)|2x,y|f(x,y)|2,
Δx,Δy=argmaxΔx,Δy|Rf,g(Δx,Δy)|2,
gd(x,y)=F1{G(u,v)exp[i2π(uΔxM+vΔyN)]},

Metrics