Abstract

We present a new, robust and automated method for registering sequences of images acquired from scanning ophthalmoscopes. The method uses a multi-scale B-spline representation of the deformation field to map images to each other and an hierarchical optimization method. We applied the method to video sequences acquired from different parts of the retina. In all cases, the registration was successful, even in the presence of large distortions from microsaccades, and the resulting deformation fields describe the fixational motion of the eye. The registration reveals examples of dynamic photoreceptor behaviour in the sequences.

© 2011 Optical Society of America

PDF Article

References

  • View by:
  • |
  • |
  • |

  1. M. Stetter, R. A. Sendtner, and G. T. Timberlake, "A novel method for measuring saccade profiles using the scanning laser ophthalmoscope," Vision Res. 36, 1987-1994 (1996).
    [CrossRef]
  2. A. Can, C. V. Stewart, B. Roysam, and H. L. Tannenbaum, "A Feature-Based, Robust, Hierarchical Algorithm for Registering Pairs of Images of the Curved Human Retina," IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 347-364 (2002).
    [CrossRef]
  3. S. Martinez-Conde, S. L. Macknik, and D. H. Hube, "The role of fixational eye movements in visual perception," Nat. Rev. Neurosci. 5, 229-240 (2004).
    [CrossRef]
  4. J. B. Mulligan, "Recovery of motion parameters from distortions in scanned images," Proceedings of the NASA Image Registration Workshop (IRW97), NASA Goddard Space Flight Center, MD, 1997.
  5. S. B. Stevenson, and A. Roorda, "Correcting for miniature eye movements in high resolution scanning laser ophthalmoscopy," in Ophthalmic Technologies XV, edited by Fabrice Manns, Per Soderberg, Arthur Ho, Proc. of SPIE Vol. 5688A, pp. 145-151 (2005).
  6. C. R. Vogel, D. W. Arathorn, A. Roorda, and A. Parker, "Retinal motion estimation in adaptive optics scanning laser ophthalmoscopy," Opt. Express 14(2), 487-497 (2006).
    [CrossRef]
  7. D. W. Arathorn, Q. Yang, C. R. Vogel, Y. Zhang, P. Tiruveedhula, and A. Roorda, "Retinally stabilized conetargeted stimulus delivery," Opt. Express 15(21), 13731-13744 (2007).
    [CrossRef]
  8. H. Li, J. Lu, G. Shi, and Y. Zhang, "Tracking features in retinal images of adaptive optics confocal scanning laser ophthalmoscope using KLT-SIFT algorithm," Biomed. Opt. Express 1, 31-40 (2010).
    [CrossRef]
  9. V. Nourrit, J. M. Bueno, B. Vohnsen, and P. Artal, "Nonlinear registration for scanned retinal images: application to ocular polarimetry," Appl. Opt. 47(29), 5341-5347 (2008).
    [CrossRef]
  10. V. Noblet, C. Heinrich, F. Heitz, and J.-P. Armspach, "3-D deformable image registration: a topology preservation scheme based on hierarchical deformation models and interval analysis optimization," IEEE Trans. Image Process. 14, 553-566 (2005).
  11. J. Kybic, and M. Unser, "Fast parametric elastic image registration," IEEE Trans. Image Process. 12, 1427-1442 (2003).
    [CrossRef]
  12. H. Lester, and S. R. Arridge, "A survey of hierarchical non-linear medical image registration," Pattern Recognit. 32(1), 129-149 (1999).
    [CrossRef]
  13. V. Chvátal, Linear programming, (Freeman, 1983).
  14. R. S. Jonnal, J. Rha, Y. Zhang, B. Cense, W. Gao, and D. T. Miller, "In vivo functional imaging of human cone photoreceptors," Opt. Express 15(24), 16141-16160 (2007).
    [CrossRef]

2010 (1)

2008 (1)

2007 (2)

2006 (1)

2005 (1)

V. Noblet, C. Heinrich, F. Heitz, and J.-P. Armspach, "3-D deformable image registration: a topology preservation scheme based on hierarchical deformation models and interval analysis optimization," IEEE Trans. Image Process. 14, 553-566 (2005).

2004 (1)

S. Martinez-Conde, S. L. Macknik, and D. H. Hube, "The role of fixational eye movements in visual perception," Nat. Rev. Neurosci. 5, 229-240 (2004).
[CrossRef]

2003 (1)

J. Kybic, and M. Unser, "Fast parametric elastic image registration," IEEE Trans. Image Process. 12, 1427-1442 (2003).
[CrossRef]

2002 (1)

A. Can, C. V. Stewart, B. Roysam, and H. L. Tannenbaum, "A Feature-Based, Robust, Hierarchical Algorithm for Registering Pairs of Images of the Curved Human Retina," IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 347-364 (2002).
[CrossRef]

1999 (1)

H. Lester, and S. R. Arridge, "A survey of hierarchical non-linear medical image registration," Pattern Recognit. 32(1), 129-149 (1999).
[CrossRef]

1996 (1)

M. Stetter, R. A. Sendtner, and G. T. Timberlake, "A novel method for measuring saccade profiles using the scanning laser ophthalmoscope," Vision Res. 36, 1987-1994 (1996).
[CrossRef]

Arathorn, D. W.

Armspach, J.-P.

V. Noblet, C. Heinrich, F. Heitz, and J.-P. Armspach, "3-D deformable image registration: a topology preservation scheme based on hierarchical deformation models and interval analysis optimization," IEEE Trans. Image Process. 14, 553-566 (2005).

Arridge, S. R.

H. Lester, and S. R. Arridge, "A survey of hierarchical non-linear medical image registration," Pattern Recognit. 32(1), 129-149 (1999).
[CrossRef]

Artal, P.

Bueno, J. M.

Can, A.

A. Can, C. V. Stewart, B. Roysam, and H. L. Tannenbaum, "A Feature-Based, Robust, Hierarchical Algorithm for Registering Pairs of Images of the Curved Human Retina," IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 347-364 (2002).
[CrossRef]

Cense, B.

Gao, W.

Heinrich, C.

V. Noblet, C. Heinrich, F. Heitz, and J.-P. Armspach, "3-D deformable image registration: a topology preservation scheme based on hierarchical deformation models and interval analysis optimization," IEEE Trans. Image Process. 14, 553-566 (2005).

Heitz, F.

V. Noblet, C. Heinrich, F. Heitz, and J.-P. Armspach, "3-D deformable image registration: a topology preservation scheme based on hierarchical deformation models and interval analysis optimization," IEEE Trans. Image Process. 14, 553-566 (2005).

Hube, D. H.

S. Martinez-Conde, S. L. Macknik, and D. H. Hube, "The role of fixational eye movements in visual perception," Nat. Rev. Neurosci. 5, 229-240 (2004).
[CrossRef]

Jonnal, R. S.

Kybic, J.

J. Kybic, and M. Unser, "Fast parametric elastic image registration," IEEE Trans. Image Process. 12, 1427-1442 (2003).
[CrossRef]

Lester, H.

H. Lester, and S. R. Arridge, "A survey of hierarchical non-linear medical image registration," Pattern Recognit. 32(1), 129-149 (1999).
[CrossRef]

Li, H.

Lu, J.

Macknik, S. L.

S. Martinez-Conde, S. L. Macknik, and D. H. Hube, "The role of fixational eye movements in visual perception," Nat. Rev. Neurosci. 5, 229-240 (2004).
[CrossRef]

Martinez-Conde, S.

S. Martinez-Conde, S. L. Macknik, and D. H. Hube, "The role of fixational eye movements in visual perception," Nat. Rev. Neurosci. 5, 229-240 (2004).
[CrossRef]

Miller, D. T.

Noblet, V.

V. Noblet, C. Heinrich, F. Heitz, and J.-P. Armspach, "3-D deformable image registration: a topology preservation scheme based on hierarchical deformation models and interval analysis optimization," IEEE Trans. Image Process. 14, 553-566 (2005).

Nourrit, V.

Parker, A.

Rha, J.

Roorda, A.

Roysam, B.

A. Can, C. V. Stewart, B. Roysam, and H. L. Tannenbaum, "A Feature-Based, Robust, Hierarchical Algorithm for Registering Pairs of Images of the Curved Human Retina," IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 347-364 (2002).
[CrossRef]

Sendtner, R. A.

M. Stetter, R. A. Sendtner, and G. T. Timberlake, "A novel method for measuring saccade profiles using the scanning laser ophthalmoscope," Vision Res. 36, 1987-1994 (1996).
[CrossRef]

Shi, G.

Stetter, M.

M. Stetter, R. A. Sendtner, and G. T. Timberlake, "A novel method for measuring saccade profiles using the scanning laser ophthalmoscope," Vision Res. 36, 1987-1994 (1996).
[CrossRef]

Stewart, C. V.

A. Can, C. V. Stewart, B. Roysam, and H. L. Tannenbaum, "A Feature-Based, Robust, Hierarchical Algorithm for Registering Pairs of Images of the Curved Human Retina," IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 347-364 (2002).
[CrossRef]

Tannenbaum, H. L.

A. Can, C. V. Stewart, B. Roysam, and H. L. Tannenbaum, "A Feature-Based, Robust, Hierarchical Algorithm for Registering Pairs of Images of the Curved Human Retina," IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 347-364 (2002).
[CrossRef]

Timberlake, G. T.

M. Stetter, R. A. Sendtner, and G. T. Timberlake, "A novel method for measuring saccade profiles using the scanning laser ophthalmoscope," Vision Res. 36, 1987-1994 (1996).
[CrossRef]

Tiruveedhula, P.

Unser, M.

J. Kybic, and M. Unser, "Fast parametric elastic image registration," IEEE Trans. Image Process. 12, 1427-1442 (2003).
[CrossRef]

Vogel, C. R.

Vohnsen, B.

Yang, Q.

Zhang, Y.

Appl. Opt. (1)

Biomed. Opt. Express (1)

IEEE Trans. Image Process. (2)

V. Noblet, C. Heinrich, F. Heitz, and J.-P. Armspach, "3-D deformable image registration: a topology preservation scheme based on hierarchical deformation models and interval analysis optimization," IEEE Trans. Image Process. 14, 553-566 (2005).

J. Kybic, and M. Unser, "Fast parametric elastic image registration," IEEE Trans. Image Process. 12, 1427-1442 (2003).
[CrossRef]

IEEE Trans. Pattern Anal. Mach. Intell. (1)

A. Can, C. V. Stewart, B. Roysam, and H. L. Tannenbaum, "A Feature-Based, Robust, Hierarchical Algorithm for Registering Pairs of Images of the Curved Human Retina," IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 347-364 (2002).
[CrossRef]

Nat. Rev. Neurosci. (1)

S. Martinez-Conde, S. L. Macknik, and D. H. Hube, "The role of fixational eye movements in visual perception," Nat. Rev. Neurosci. 5, 229-240 (2004).
[CrossRef]

Opt. Express (3)

Pattern Recognit. (1)

H. Lester, and S. R. Arridge, "A survey of hierarchical non-linear medical image registration," Pattern Recognit. 32(1), 129-149 (1999).
[CrossRef]

Vision Res. (1)

M. Stetter, R. A. Sendtner, and G. T. Timberlake, "A novel method for measuring saccade profiles using the scanning laser ophthalmoscope," Vision Res. 36, 1987-1994 (1996).
[CrossRef]

Other (3)

V. Chvátal, Linear programming, (Freeman, 1983).

J. B. Mulligan, "Recovery of motion parameters from distortions in scanned images," Proceedings of the NASA Image Registration Workshop (IRW97), NASA Goddard Space Flight Center, MD, 1997.

S. B. Stevenson, and A. Roorda, "Correcting for miniature eye movements in high resolution scanning laser ophthalmoscopy," in Ophthalmic Technologies XV, edited by Fabrice Manns, Per Soderberg, Arthur Ho, Proc. of SPIE Vol. 5688A, pp. 145-151 (2005).

Supplementary Material (7)

» Media 1: AVI (654 KB)     
» Media 2: AVI (619 KB)     
» Media 3: AVI (654 KB)     
» Media 4: AVI (631 KB)     
» Media 5: AVI (654 KB)     
» Media 6: AVI (625 KB)     
» Media 7: AVI (47 KB)     

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Metrics