Abstract

A Wiener filter-based deconvolution algorithm is developed to restore vibration-degraded video imagery from an intensified CCD camera. The method is based on the use of azimuth and elevation angular optical line-of-sight data recorded from external sensors to estimate a two-dimensional vibration-blur impulse response on a per frame basis. Flight conditions are reproduced in the laboratory by use of prerecorded in-flight vibration data. The performance of the algorithm varies from frame to frame, following the time-varying characteristics of the vibration-blur impulse response. However, real-time display of the restored video minimizes these effects because of eye integration, and near-full restoration of the original uncorrupted imagery is observed for both high-light- and low-light-level conditions with minimal amplification of noise.

© 1999 Optical Society of America

PDF Article

References

  • View by:
  • |
  • |
  • |

  1. J. M. Hilkert, M. Bowen, J. Wang, “Specifications for image stabilization systems,” in Tactical Infrared Systems, J. W. Tuttle, ed., Proc. SPIE1498, 24–38 (1991).
  2. C. J. Cooper, “Sensor line of sight stabilization,” in Tactical Infrared Systems, J. W. Tuttle, ed., Proc. SPIE1498, 39–51 (1991).
  3. M. K. Masten, “Electromechanical systems for optical target tracking sensors,” in Multitarget-Multisensor Tracking: Advanced Applications, Y. Bar-Shalom, ed. (YBS, Storrs, Conn., 1990), pp. 321–360.
  4. G. C. Holst, Electro-Optical Imaging System Performance (SPIE, Bellingham, Wash., 1995), pp. 110–118.
  5. D. Wulich, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations,” Opt. Eng. 26, 529–533 (1987).
    [CrossRef]
  6. O. Hadar, M. Robbins, Y. Novogrozky, D. Kaplan, “Image motion restoration from a sequence of images,” Opt. Eng. 35, 2898–2904 (1996).
    [CrossRef]
  7. O. Hadar, Z. Adar, A. Cotter, N. S. Kopeika, “Restoration of images degraded by extreme mechanical vibrations,” Opt. Laser Technol. 29, 171–177 (1997).
    [CrossRef]
  8. O. Hadar, M. Fisher, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations. Part III: Numerical calculation of modulation transfer function,” Opt. Eng. 31, 581–589 (1992).
    [CrossRef]
  9. O. Hadar, I. Dror, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations. Part IV: Real-time numerical calculation of optical transfer functions and experimental verification,” Opt. Eng. 33, 566–578 (1994).
    [CrossRef]
  10. A. Stern, N. S. Kopeika, “Analytical method to calculate optical transfer functions for image motion and vibrations using moments,” J. Opt. Soc. Am. A 14, 388–396 (1997).
    [CrossRef]
  11. N. S. Kopeika, A System Engineering Approach to Imaging (SPIE, Bellingham, Wash., 1998), Chaps. 14 and 18.
  12. Y. Yitzhaky, N. S. Kopeika, “Identification of blur parameters from motion blurred images,” CVGIP. Graph. Models Image Process.” 59, 310–320 (1997).
    [CrossRef]
  13. Y. Yitzhaky, I. Mor, A. Lantzman, N. S. Kopeika, “Direct method for restoration of motion-blurred images,” J. Opt. Soc. Am. A 15, 1512–1519 (1998).
    [CrossRef]
  14. A. Stern, N. S. Kopeika, “General restoration filter for vibrated-image restoration,” Appl. Opt. 37, 7596–7603 (1998).
    [CrossRef]
  15. C. W. Therrien, Discrete Random Signals and Statistical Signal Processing (Prentice-Hall, Englewood Cliffs, N.J., 1992), pp. 587–588.
  16. L. Levi, “Motion blurring with decaying detector response,” Appl. Opt. 10, 38–41 (1971).
    [CrossRef] [PubMed]
  17. S. C. Som, “Analysis of the effect of linear smear on photographic images,” J. Opt. Soc. Am. 61, 859–864 (1971).
    [CrossRef]
  18. A. A. Sawchuk, “Space-variant image motion degradation and restoration,” Proc. IEEE 60, 854–861 (1972).
    [CrossRef]
  19. A. V. Oppenheim, R. W. Shafer, Discrete-Time Signal Processing (Prentice-Hall, Englewood Cliffs, N.J., 1989), pp. 407–415.
  20. G. C. Holst, CCD Arrays, Cameras, and Displays (SPIE, Bellingham, Wash., 1996), pp. 269–270.
  21. For example, A. K. Jain, Fundamentals of Digital Image Processing, 2nd ed. (Addison-Wesley, Reading, Mass., 1987), pp. 275–289.
  22. A. M. Tekalp, Digital Video Processing (Prentice-Hall PTR, Upper Saddle River, N.J., 1995), pp. 95–116.
  23. For example, P. Gillett, Calculus and Analytic Geometry (Heath, Lexington, Mass., 1981), pp. 555–561.
  24. S. T. Hammett, P. J. Bex, “Motion sharpening: evidence for the addition of high spatial frequencies to the effective neural image,” Vision Res. 36, 2729–2733 (1996).
    [CrossRef] [PubMed]
  25. G. C. Holst, “Infrared imaging system testing,” in Electro-Optical Systems Design, Analysis, and Testing, Vol. 4 of The Infrared and Electro-Optical Systems Handbook, M. C. Dudzik, ed. (SPIE, Bellingham, Wash., 1993), pp. 235–241.

1998

1997

A. Stern, N. S. Kopeika, “Analytical method to calculate optical transfer functions for image motion and vibrations using moments,” J. Opt. Soc. Am. A 14, 388–396 (1997).
[CrossRef]

O. Hadar, Z. Adar, A. Cotter, N. S. Kopeika, “Restoration of images degraded by extreme mechanical vibrations,” Opt. Laser Technol. 29, 171–177 (1997).
[CrossRef]

Y. Yitzhaky, N. S. Kopeika, “Identification of blur parameters from motion blurred images,” CVGIP. Graph. Models Image Process.” 59, 310–320 (1997).
[CrossRef]

1996

S. T. Hammett, P. J. Bex, “Motion sharpening: evidence for the addition of high spatial frequencies to the effective neural image,” Vision Res. 36, 2729–2733 (1996).
[CrossRef] [PubMed]

O. Hadar, M. Robbins, Y. Novogrozky, D. Kaplan, “Image motion restoration from a sequence of images,” Opt. Eng. 35, 2898–2904 (1996).
[CrossRef]

1994

O. Hadar, I. Dror, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations. Part IV: Real-time numerical calculation of optical transfer functions and experimental verification,” Opt. Eng. 33, 566–578 (1994).
[CrossRef]

1992

O. Hadar, M. Fisher, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations. Part III: Numerical calculation of modulation transfer function,” Opt. Eng. 31, 581–589 (1992).
[CrossRef]

1987

D. Wulich, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations,” Opt. Eng. 26, 529–533 (1987).
[CrossRef]

1972

A. A. Sawchuk, “Space-variant image motion degradation and restoration,” Proc. IEEE 60, 854–861 (1972).
[CrossRef]

1971

Adar, Z.

O. Hadar, Z. Adar, A. Cotter, N. S. Kopeika, “Restoration of images degraded by extreme mechanical vibrations,” Opt. Laser Technol. 29, 171–177 (1997).
[CrossRef]

Bex, P. J.

S. T. Hammett, P. J. Bex, “Motion sharpening: evidence for the addition of high spatial frequencies to the effective neural image,” Vision Res. 36, 2729–2733 (1996).
[CrossRef] [PubMed]

Bowen, M.

J. M. Hilkert, M. Bowen, J. Wang, “Specifications for image stabilization systems,” in Tactical Infrared Systems, J. W. Tuttle, ed., Proc. SPIE1498, 24–38 (1991).

Cooper, C. J.

C. J. Cooper, “Sensor line of sight stabilization,” in Tactical Infrared Systems, J. W. Tuttle, ed., Proc. SPIE1498, 39–51 (1991).

Cotter, A.

O. Hadar, Z. Adar, A. Cotter, N. S. Kopeika, “Restoration of images degraded by extreme mechanical vibrations,” Opt. Laser Technol. 29, 171–177 (1997).
[CrossRef]

Dror, I.

O. Hadar, I. Dror, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations. Part IV: Real-time numerical calculation of optical transfer functions and experimental verification,” Opt. Eng. 33, 566–578 (1994).
[CrossRef]

Fisher, M.

O. Hadar, M. Fisher, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations. Part III: Numerical calculation of modulation transfer function,” Opt. Eng. 31, 581–589 (1992).
[CrossRef]

Gillett, P.

For example, P. Gillett, Calculus and Analytic Geometry (Heath, Lexington, Mass., 1981), pp. 555–561.

Hadar, O.

O. Hadar, Z. Adar, A. Cotter, N. S. Kopeika, “Restoration of images degraded by extreme mechanical vibrations,” Opt. Laser Technol. 29, 171–177 (1997).
[CrossRef]

O. Hadar, M. Robbins, Y. Novogrozky, D. Kaplan, “Image motion restoration from a sequence of images,” Opt. Eng. 35, 2898–2904 (1996).
[CrossRef]

O. Hadar, I. Dror, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations. Part IV: Real-time numerical calculation of optical transfer functions and experimental verification,” Opt. Eng. 33, 566–578 (1994).
[CrossRef]

O. Hadar, M. Fisher, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations. Part III: Numerical calculation of modulation transfer function,” Opt. Eng. 31, 581–589 (1992).
[CrossRef]

Hammett, S. T.

S. T. Hammett, P. J. Bex, “Motion sharpening: evidence for the addition of high spatial frequencies to the effective neural image,” Vision Res. 36, 2729–2733 (1996).
[CrossRef] [PubMed]

Hilkert, J. M.

J. M. Hilkert, M. Bowen, J. Wang, “Specifications for image stabilization systems,” in Tactical Infrared Systems, J. W. Tuttle, ed., Proc. SPIE1498, 24–38 (1991).

Holst, G. C.

G. C. Holst, “Infrared imaging system testing,” in Electro-Optical Systems Design, Analysis, and Testing, Vol. 4 of The Infrared and Electro-Optical Systems Handbook, M. C. Dudzik, ed. (SPIE, Bellingham, Wash., 1993), pp. 235–241.

G. C. Holst, Electro-Optical Imaging System Performance (SPIE, Bellingham, Wash., 1995), pp. 110–118.

G. C. Holst, CCD Arrays, Cameras, and Displays (SPIE, Bellingham, Wash., 1996), pp. 269–270.

Jain, A. K.

For example, A. K. Jain, Fundamentals of Digital Image Processing, 2nd ed. (Addison-Wesley, Reading, Mass., 1987), pp. 275–289.

Kaplan, D.

O. Hadar, M. Robbins, Y. Novogrozky, D. Kaplan, “Image motion restoration from a sequence of images,” Opt. Eng. 35, 2898–2904 (1996).
[CrossRef]

Kopeika, N. S.

Y. Yitzhaky, I. Mor, A. Lantzman, N. S. Kopeika, “Direct method for restoration of motion-blurred images,” J. Opt. Soc. Am. A 15, 1512–1519 (1998).
[CrossRef]

A. Stern, N. S. Kopeika, “General restoration filter for vibrated-image restoration,” Appl. Opt. 37, 7596–7603 (1998).
[CrossRef]

Y. Yitzhaky, N. S. Kopeika, “Identification of blur parameters from motion blurred images,” CVGIP. Graph. Models Image Process.” 59, 310–320 (1997).
[CrossRef]

O. Hadar, Z. Adar, A. Cotter, N. S. Kopeika, “Restoration of images degraded by extreme mechanical vibrations,” Opt. Laser Technol. 29, 171–177 (1997).
[CrossRef]

A. Stern, N. S. Kopeika, “Analytical method to calculate optical transfer functions for image motion and vibrations using moments,” J. Opt. Soc. Am. A 14, 388–396 (1997).
[CrossRef]

O. Hadar, I. Dror, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations. Part IV: Real-time numerical calculation of optical transfer functions and experimental verification,” Opt. Eng. 33, 566–578 (1994).
[CrossRef]

O. Hadar, M. Fisher, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations. Part III: Numerical calculation of modulation transfer function,” Opt. Eng. 31, 581–589 (1992).
[CrossRef]

D. Wulich, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations,” Opt. Eng. 26, 529–533 (1987).
[CrossRef]

N. S. Kopeika, A System Engineering Approach to Imaging (SPIE, Bellingham, Wash., 1998), Chaps. 14 and 18.

Lantzman, A.

Levi, L.

Masten, M. K.

M. K. Masten, “Electromechanical systems for optical target tracking sensors,” in Multitarget-Multisensor Tracking: Advanced Applications, Y. Bar-Shalom, ed. (YBS, Storrs, Conn., 1990), pp. 321–360.

Mor, I.

Novogrozky, Y.

O. Hadar, M. Robbins, Y. Novogrozky, D. Kaplan, “Image motion restoration from a sequence of images,” Opt. Eng. 35, 2898–2904 (1996).
[CrossRef]

Oppenheim, A. V.

A. V. Oppenheim, R. W. Shafer, Discrete-Time Signal Processing (Prentice-Hall, Englewood Cliffs, N.J., 1989), pp. 407–415.

Robbins, M.

O. Hadar, M. Robbins, Y. Novogrozky, D. Kaplan, “Image motion restoration from a sequence of images,” Opt. Eng. 35, 2898–2904 (1996).
[CrossRef]

Sawchuk, A. A.

A. A. Sawchuk, “Space-variant image motion degradation and restoration,” Proc. IEEE 60, 854–861 (1972).
[CrossRef]

Shafer, R. W.

A. V. Oppenheim, R. W. Shafer, Discrete-Time Signal Processing (Prentice-Hall, Englewood Cliffs, N.J., 1989), pp. 407–415.

Som, S. C.

Stern, A.

Tekalp, A. M.

A. M. Tekalp, Digital Video Processing (Prentice-Hall PTR, Upper Saddle River, N.J., 1995), pp. 95–116.

Therrien, C. W.

C. W. Therrien, Discrete Random Signals and Statistical Signal Processing (Prentice-Hall, Englewood Cliffs, N.J., 1992), pp. 587–588.

Wang, J.

J. M. Hilkert, M. Bowen, J. Wang, “Specifications for image stabilization systems,” in Tactical Infrared Systems, J. W. Tuttle, ed., Proc. SPIE1498, 24–38 (1991).

Wulich, D.

D. Wulich, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations,” Opt. Eng. 26, 529–533 (1987).
[CrossRef]

Yitzhaky, Y.

Y. Yitzhaky, I. Mor, A. Lantzman, N. S. Kopeika, “Direct method for restoration of motion-blurred images,” J. Opt. Soc. Am. A 15, 1512–1519 (1998).
[CrossRef]

Y. Yitzhaky, N. S. Kopeika, “Identification of blur parameters from motion blurred images,” CVGIP. Graph. Models Image Process.” 59, 310–320 (1997).
[CrossRef]

Appl. Opt.

CVGIP. Graph. Models Image Process.

Y. Yitzhaky, N. S. Kopeika, “Identification of blur parameters from motion blurred images,” CVGIP. Graph. Models Image Process.” 59, 310–320 (1997).
[CrossRef]

J. Opt. Soc. Am.

J. Opt. Soc. Am. A

Opt. Eng.

D. Wulich, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations,” Opt. Eng. 26, 529–533 (1987).
[CrossRef]

O. Hadar, M. Robbins, Y. Novogrozky, D. Kaplan, “Image motion restoration from a sequence of images,” Opt. Eng. 35, 2898–2904 (1996).
[CrossRef]

O. Hadar, M. Fisher, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations. Part III: Numerical calculation of modulation transfer function,” Opt. Eng. 31, 581–589 (1992).
[CrossRef]

O. Hadar, I. Dror, N. S. Kopeika, “Image resolution limits resulting from mechanical vibrations. Part IV: Real-time numerical calculation of optical transfer functions and experimental verification,” Opt. Eng. 33, 566–578 (1994).
[CrossRef]

Opt. Laser Technol.

O. Hadar, Z. Adar, A. Cotter, N. S. Kopeika, “Restoration of images degraded by extreme mechanical vibrations,” Opt. Laser Technol. 29, 171–177 (1997).
[CrossRef]

Proc. IEEE

A. A. Sawchuk, “Space-variant image motion degradation and restoration,” Proc. IEEE 60, 854–861 (1972).
[CrossRef]

Vision Res.

S. T. Hammett, P. J. Bex, “Motion sharpening: evidence for the addition of high spatial frequencies to the effective neural image,” Vision Res. 36, 2729–2733 (1996).
[CrossRef] [PubMed]

Other

G. C. Holst, “Infrared imaging system testing,” in Electro-Optical Systems Design, Analysis, and Testing, Vol. 4 of The Infrared and Electro-Optical Systems Handbook, M. C. Dudzik, ed. (SPIE, Bellingham, Wash., 1993), pp. 235–241.

C. W. Therrien, Discrete Random Signals and Statistical Signal Processing (Prentice-Hall, Englewood Cliffs, N.J., 1992), pp. 587–588.

N. S. Kopeika, A System Engineering Approach to Imaging (SPIE, Bellingham, Wash., 1998), Chaps. 14 and 18.

A. V. Oppenheim, R. W. Shafer, Discrete-Time Signal Processing (Prentice-Hall, Englewood Cliffs, N.J., 1989), pp. 407–415.

G. C. Holst, CCD Arrays, Cameras, and Displays (SPIE, Bellingham, Wash., 1996), pp. 269–270.

For example, A. K. Jain, Fundamentals of Digital Image Processing, 2nd ed. (Addison-Wesley, Reading, Mass., 1987), pp. 275–289.

A. M. Tekalp, Digital Video Processing (Prentice-Hall PTR, Upper Saddle River, N.J., 1995), pp. 95–116.

For example, P. Gillett, Calculus and Analytic Geometry (Heath, Lexington, Mass., 1981), pp. 555–561.

J. M. Hilkert, M. Bowen, J. Wang, “Specifications for image stabilization systems,” in Tactical Infrared Systems, J. W. Tuttle, ed., Proc. SPIE1498, 24–38 (1991).

C. J. Cooper, “Sensor line of sight stabilization,” in Tactical Infrared Systems, J. W. Tuttle, ed., Proc. SPIE1498, 39–51 (1991).

M. K. Masten, “Electromechanical systems for optical target tracking sensors,” in Multitarget-Multisensor Tracking: Advanced Applications, Y. Bar-Shalom, ed. (YBS, Storrs, Conn., 1990), pp. 321–360.

G. C. Holst, Electro-Optical Imaging System Performance (SPIE, Bellingham, Wash., 1995), pp. 110–118.

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Metrics