Abstract

It is shown that one can make use of local instabilities in turbulent video frames to enhance image resolution beyond the limit defined by the image sampling rate. We outline the processing algorithm, present its experimental verification on simulated and real-life videos, and discuss its potentials and limitations.

© 2007 Optical Society of America

Full Article  |  PDF Article

References

  • View by:
  • |
  • |
  • |

  1. M. C. Roggermann and B. Welsh, Imaging Through Turbulence (CRC Press, 1996).
  2. S. Gepshtein, A. Shtainman, B. Fishbain, and L. Yaroslavsky, in The 2004 European Signal Processing Conference (EUSIPCO-2004), J.Platt, ed. (2004), pp. 477-480.
  3. L. Yaroslavsky, B. Fishbain, I. Ideses, D. Slasky, and Z. Hadas, in Proceedings of ICO Topical Meeting on Optoinformatics/Information Photonics (ITMO, 2006), pp. 138-140.
  4. B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, A. Shtern, and O. Ben-Zvi, Proc. SPIE 6496, 64960C (2007).
    [Crossref]
  5. B. Fishbain, I. A. Ideses, Sh. Gepstein, and L. P. Yaroslavsky, in Proceedings of The 11th Meeting on Optical Engineering and Science in Israel, Tel-Aviv, March 26-27, 2007.
  6. B. Fishbain, L. P. Yaroslavsky, and I. A. Ideses, in Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing (VIIP, 2007), pp. 213-218.
  7. Z. Zalevsky, Sh. Rozental, and M. Meller, Opt. Lett. 32, 1072 (2007).
    [Crossref] [PubMed]
  8. T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, in Proceedings of the 8th European Conference on Computer Vision, T.Pajdla and J.Matas, eds., Vol. 4 of Springer Lecture Notes in Computer Science (Springer-Verlag, 2004), pp. 25-36.
  9. L. J. Barron, D. J. Fleet, and S. S. Beachemin, Inf. Sci. (N.Y.) 12, 43 (1994).
  10. L. Yaroslavsky, Digital Holography and Digital Image Processing (Kluwer Scientific, 2004).
  11. I. Ideses, L. Yaroslavsky, B. Fishbain, and R. Vistuch, Proc. SPIE 6490, 64901C (2007).
    [Crossref]
  12. F. Crete, T. Dolmiere, P. Ladret, and M. Nicolas, Proc. SPIE 6492, 64920I (2007).
    [Crossref]

2007 (5)

B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, A. Shtern, and O. Ben-Zvi, Proc. SPIE 6496, 64960C (2007).
[Crossref]

B. Fishbain, I. A. Ideses, Sh. Gepstein, and L. P. Yaroslavsky, in Proceedings of The 11th Meeting on Optical Engineering and Science in Israel, Tel-Aviv, March 26-27, 2007.

Z. Zalevsky, Sh. Rozental, and M. Meller, Opt. Lett. 32, 1072 (2007).
[Crossref] [PubMed]

I. Ideses, L. Yaroslavsky, B. Fishbain, and R. Vistuch, Proc. SPIE 6490, 64901C (2007).
[Crossref]

F. Crete, T. Dolmiere, P. Ladret, and M. Nicolas, Proc. SPIE 6492, 64920I (2007).
[Crossref]

2006 (1)

L. Yaroslavsky, B. Fishbain, I. Ideses, D. Slasky, and Z. Hadas, in Proceedings of ICO Topical Meeting on Optoinformatics/Information Photonics (ITMO, 2006), pp. 138-140.

2004 (3)

L. Yaroslavsky, Digital Holography and Digital Image Processing (Kluwer Scientific, 2004).

S. Gepshtein, A. Shtainman, B. Fishbain, and L. Yaroslavsky, in The 2004 European Signal Processing Conference (EUSIPCO-2004), J.Platt, ed. (2004), pp. 477-480.

T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, in Proceedings of the 8th European Conference on Computer Vision, T.Pajdla and J.Matas, eds., Vol. 4 of Springer Lecture Notes in Computer Science (Springer-Verlag, 2004), pp. 25-36.

1996 (1)

M. C. Roggermann and B. Welsh, Imaging Through Turbulence (CRC Press, 1996).

1994 (1)

L. J. Barron, D. J. Fleet, and S. S. Beachemin, Inf. Sci. (N.Y.) 12, 43 (1994).

Barron, L. J.

L. J. Barron, D. J. Fleet, and S. S. Beachemin, Inf. Sci. (N.Y.) 12, 43 (1994).

Beachemin, S. S.

L. J. Barron, D. J. Fleet, and S. S. Beachemin, Inf. Sci. (N.Y.) 12, 43 (1994).

Ben-Zvi, O.

B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, A. Shtern, and O. Ben-Zvi, Proc. SPIE 6496, 64960C (2007).
[Crossref]

Brox, T.

T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, in Proceedings of the 8th European Conference on Computer Vision, T.Pajdla and J.Matas, eds., Vol. 4 of Springer Lecture Notes in Computer Science (Springer-Verlag, 2004), pp. 25-36.

Bruhn, A.

T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, in Proceedings of the 8th European Conference on Computer Vision, T.Pajdla and J.Matas, eds., Vol. 4 of Springer Lecture Notes in Computer Science (Springer-Verlag, 2004), pp. 25-36.

Crete, F.

F. Crete, T. Dolmiere, P. Ladret, and M. Nicolas, Proc. SPIE 6492, 64920I (2007).
[Crossref]

Dolmiere, T.

F. Crete, T. Dolmiere, P. Ladret, and M. Nicolas, Proc. SPIE 6492, 64920I (2007).
[Crossref]

Fishbain, B.

I. Ideses, L. Yaroslavsky, B. Fishbain, and R. Vistuch, Proc. SPIE 6490, 64901C (2007).
[Crossref]

B. Fishbain, I. A. Ideses, Sh. Gepstein, and L. P. Yaroslavsky, in Proceedings of The 11th Meeting on Optical Engineering and Science in Israel, Tel-Aviv, March 26-27, 2007.

B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, A. Shtern, and O. Ben-Zvi, Proc. SPIE 6496, 64960C (2007).
[Crossref]

L. Yaroslavsky, B. Fishbain, I. Ideses, D. Slasky, and Z. Hadas, in Proceedings of ICO Topical Meeting on Optoinformatics/Information Photonics (ITMO, 2006), pp. 138-140.

S. Gepshtein, A. Shtainman, B. Fishbain, and L. Yaroslavsky, in The 2004 European Signal Processing Conference (EUSIPCO-2004), J.Platt, ed. (2004), pp. 477-480.

B. Fishbain, L. P. Yaroslavsky, and I. A. Ideses, in Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing (VIIP, 2007), pp. 213-218.

Fleet, D. J.

L. J. Barron, D. J. Fleet, and S. S. Beachemin, Inf. Sci. (N.Y.) 12, 43 (1994).

Gepshtein, S.

S. Gepshtein, A. Shtainman, B. Fishbain, and L. Yaroslavsky, in The 2004 European Signal Processing Conference (EUSIPCO-2004), J.Platt, ed. (2004), pp. 477-480.

Gepstein, Sh.

B. Fishbain, I. A. Ideses, Sh. Gepstein, and L. P. Yaroslavsky, in Proceedings of The 11th Meeting on Optical Engineering and Science in Israel, Tel-Aviv, March 26-27, 2007.

Hadas, Z.

L. Yaroslavsky, B. Fishbain, I. Ideses, D. Slasky, and Z. Hadas, in Proceedings of ICO Topical Meeting on Optoinformatics/Information Photonics (ITMO, 2006), pp. 138-140.

Ideses, I.

I. Ideses, L. Yaroslavsky, B. Fishbain, and R. Vistuch, Proc. SPIE 6490, 64901C (2007).
[Crossref]

L. Yaroslavsky, B. Fishbain, I. Ideses, D. Slasky, and Z. Hadas, in Proceedings of ICO Topical Meeting on Optoinformatics/Information Photonics (ITMO, 2006), pp. 138-140.

Ideses, I. A.

B. Fishbain, I. A. Ideses, Sh. Gepstein, and L. P. Yaroslavsky, in Proceedings of The 11th Meeting on Optical Engineering and Science in Israel, Tel-Aviv, March 26-27, 2007.

B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, A. Shtern, and O. Ben-Zvi, Proc. SPIE 6496, 64960C (2007).
[Crossref]

B. Fishbain, L. P. Yaroslavsky, and I. A. Ideses, in Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing (VIIP, 2007), pp. 213-218.

Ladret, P.

F. Crete, T. Dolmiere, P. Ladret, and M. Nicolas, Proc. SPIE 6492, 64920I (2007).
[Crossref]

Meller, M.

Nicolas, M.

F. Crete, T. Dolmiere, P. Ladret, and M. Nicolas, Proc. SPIE 6492, 64920I (2007).
[Crossref]

Papenberg, N.

T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, in Proceedings of the 8th European Conference on Computer Vision, T.Pajdla and J.Matas, eds., Vol. 4 of Springer Lecture Notes in Computer Science (Springer-Verlag, 2004), pp. 25-36.

Roggermann, M. C.

M. C. Roggermann and B. Welsh, Imaging Through Turbulence (CRC Press, 1996).

Rozental, Sh.

Shtainman, A.

S. Gepshtein, A. Shtainman, B. Fishbain, and L. Yaroslavsky, in The 2004 European Signal Processing Conference (EUSIPCO-2004), J.Platt, ed. (2004), pp. 477-480.

Shtern, A.

B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, A. Shtern, and O. Ben-Zvi, Proc. SPIE 6496, 64960C (2007).
[Crossref]

Slasky, D.

L. Yaroslavsky, B. Fishbain, I. Ideses, D. Slasky, and Z. Hadas, in Proceedings of ICO Topical Meeting on Optoinformatics/Information Photonics (ITMO, 2006), pp. 138-140.

Vistuch, R.

I. Ideses, L. Yaroslavsky, B. Fishbain, and R. Vistuch, Proc. SPIE 6490, 64901C (2007).
[Crossref]

Weickert, J.

T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, in Proceedings of the 8th European Conference on Computer Vision, T.Pajdla and J.Matas, eds., Vol. 4 of Springer Lecture Notes in Computer Science (Springer-Verlag, 2004), pp. 25-36.

Welsh, B.

M. C. Roggermann and B. Welsh, Imaging Through Turbulence (CRC Press, 1996).

Yaroslavsky, L.

I. Ideses, L. Yaroslavsky, B. Fishbain, and R. Vistuch, Proc. SPIE 6490, 64901C (2007).
[Crossref]

L. Yaroslavsky, B. Fishbain, I. Ideses, D. Slasky, and Z. Hadas, in Proceedings of ICO Topical Meeting on Optoinformatics/Information Photonics (ITMO, 2006), pp. 138-140.

S. Gepshtein, A. Shtainman, B. Fishbain, and L. Yaroslavsky, in The 2004 European Signal Processing Conference (EUSIPCO-2004), J.Platt, ed. (2004), pp. 477-480.

L. Yaroslavsky, Digital Holography and Digital Image Processing (Kluwer Scientific, 2004).

Yaroslavsky, L. P.

B. Fishbain, I. A. Ideses, Sh. Gepstein, and L. P. Yaroslavsky, in Proceedings of The 11th Meeting on Optical Engineering and Science in Israel, Tel-Aviv, March 26-27, 2007.

B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, A. Shtern, and O. Ben-Zvi, Proc. SPIE 6496, 64960C (2007).
[Crossref]

B. Fishbain, L. P. Yaroslavsky, and I. A. Ideses, in Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing (VIIP, 2007), pp. 213-218.

Zalevsky, Z.

Inf. Sci. (N.Y.) (1)

L. J. Barron, D. J. Fleet, and S. S. Beachemin, Inf. Sci. (N.Y.) 12, 43 (1994).

Opt. Lett. (1)

Proc. SPIE (3)

B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, A. Shtern, and O. Ben-Zvi, Proc. SPIE 6496, 64960C (2007).
[Crossref]

I. Ideses, L. Yaroslavsky, B. Fishbain, and R. Vistuch, Proc. SPIE 6490, 64901C (2007).
[Crossref]

F. Crete, T. Dolmiere, P. Ladret, and M. Nicolas, Proc. SPIE 6492, 64920I (2007).
[Crossref]

Other (7)

B. Fishbain, I. A. Ideses, Sh. Gepstein, and L. P. Yaroslavsky, in Proceedings of The 11th Meeting on Optical Engineering and Science in Israel, Tel-Aviv, March 26-27, 2007.

B. Fishbain, L. P. Yaroslavsky, and I. A. Ideses, in Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing (VIIP, 2007), pp. 213-218.

M. C. Roggermann and B. Welsh, Imaging Through Turbulence (CRC Press, 1996).

S. Gepshtein, A. Shtainman, B. Fishbain, and L. Yaroslavsky, in The 2004 European Signal Processing Conference (EUSIPCO-2004), J.Platt, ed. (2004), pp. 477-480.

L. Yaroslavsky, B. Fishbain, I. Ideses, D. Slasky, and Z. Hadas, in Proceedings of ICO Topical Meeting on Optoinformatics/Information Photonics (ITMO, 2006), pp. 138-140.

T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, in Proceedings of the 8th European Conference on Computer Vision, T.Pajdla and J.Matas, eds., Vol. 4 of Springer Lecture Notes in Computer Science (Springer-Verlag, 2004), pp. 25-36.

L. Yaroslavsky, Digital Holography and Digital Image Processing (Kluwer Scientific, 2004).

Cited By

OSA participates in Crossref's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (2)

Fig. 1
Fig. 1

Illustrative simulation results of the resolution enhancement of turbulent video frames: (a) initial high resolution frame, (b) example of a low-resolution frame obtained by a camera with a fill factor 0.05, (c) resolution-enhanced frame obtained by the described fusion process with 50 iterations of the reinterpolation from 15 low resolution frames distorted by simulated random local displacements with a standard deviation of 0.5 interpixel distance.

Fig. 2
Fig. 2

Illustration of resolution enhancement of real-life video frames (a) a 256 × 256 pixel fragment of the stabilized frame; (b) same fragment after resolution enhancement; (c) difference between images (a) and (b) that show edges enhanced in image (b); (d) image (b) after reinterpolation and aperture correction.

Metrics