Abstract

Color videos acquired with a single CCD through turbulent media can be enhanced in their resolution beyond the limit defined by the image sampling rate. We provide a mathematical justification for this claim, present an efficient superresolution algorithm and its experimental verification on a real-life video, and finally, discuss its potentials and limitations.

© 2009 Optical Society of America

Full Article  |  PDF Article

References

  • View by:
  • |
  • |
  • |

  1. L. P. Yaroslavsky, B. Fishbain, G. Shabat, and I. Ideses, Opt. Lett. 32, 3038 (2007).
    [CrossRef] [PubMed]
  2. B. Fishbain, L. P. Yaroslavsky, and I. Ideses, Adv. Opt. Technol. 2008, 546808 (2008).
  3. Z. Zalevsky, Sh. Rozental, and M. Meller, Opt. Lett. 32, 1072 (2007).
    [CrossRef] [PubMed]
  4. O. Hadar and G. D. Boreman, Opt. Eng. 38, 782 (1999).
    [CrossRef]
  5. L. P. Yaroslavsky, G. Shabat, B. Fishbain, and I. A. Ideses, Proc. SPIE 6812, 681205 (2008).
    [CrossRef]
  6. W. Wharton and D. Howorth, Principles of Television Reception (Pitman, 1971), p. 161.
  7. M. Irani and S. Peleg, CVGIP Graph. Models Image Process. 53, 231 (1991).
    [CrossRef]
  8. B. Fishbain, L. P. Yaroslavsky, and I. A. Ideses, J. Real-Time Image Process. 2, 11 (2007).
    [CrossRef]
  9. E. Hamilton, JPEG File Interchange Format Version 1.02, September 1992.
  10. L. P. Yaroslavsky and H. J. Caulfield, Appl. Opt. 33, 2157 (1994).
    [CrossRef] [PubMed]
  11. B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, and F. Roffet-Crété, Proc. SPIE 6808, 68080X (2008).
    [CrossRef]

2008

L. P. Yaroslavsky, G. Shabat, B. Fishbain, and I. A. Ideses, Proc. SPIE 6812, 681205 (2008).
[CrossRef]

B. Fishbain, L. P. Yaroslavsky, and I. Ideses, Adv. Opt. Technol. 2008, 546808 (2008).

B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, and F. Roffet-Crété, Proc. SPIE 6808, 68080X (2008).
[CrossRef]

2007

1999

O. Hadar and G. D. Boreman, Opt. Eng. 38, 782 (1999).
[CrossRef]

1994

1991

M. Irani and S. Peleg, CVGIP Graph. Models Image Process. 53, 231 (1991).
[CrossRef]

Boreman, G. D.

O. Hadar and G. D. Boreman, Opt. Eng. 38, 782 (1999).
[CrossRef]

Caulfield, H. J.

Fishbain, B.

L. P. Yaroslavsky, G. Shabat, B. Fishbain, and I. A. Ideses, Proc. SPIE 6812, 681205 (2008).
[CrossRef]

B. Fishbain, L. P. Yaroslavsky, and I. Ideses, Adv. Opt. Technol. 2008, 546808 (2008).

B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, and F. Roffet-Crété, Proc. SPIE 6808, 68080X (2008).
[CrossRef]

B. Fishbain, L. P. Yaroslavsky, and I. A. Ideses, J. Real-Time Image Process. 2, 11 (2007).
[CrossRef]

L. P. Yaroslavsky, B. Fishbain, G. Shabat, and I. Ideses, Opt. Lett. 32, 3038 (2007).
[CrossRef] [PubMed]

Hadar, O.

O. Hadar and G. D. Boreman, Opt. Eng. 38, 782 (1999).
[CrossRef]

Hamilton, E.

E. Hamilton, JPEG File Interchange Format Version 1.02, September 1992.

Howorth, D.

W. Wharton and D. Howorth, Principles of Television Reception (Pitman, 1971), p. 161.

Ideses, I.

B. Fishbain, L. P. Yaroslavsky, and I. Ideses, Adv. Opt. Technol. 2008, 546808 (2008).

L. P. Yaroslavsky, B. Fishbain, G. Shabat, and I. Ideses, Opt. Lett. 32, 3038 (2007).
[CrossRef] [PubMed]

Ideses, I. A.

B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, and F. Roffet-Crété, Proc. SPIE 6808, 68080X (2008).
[CrossRef]

L. P. Yaroslavsky, G. Shabat, B. Fishbain, and I. A. Ideses, Proc. SPIE 6812, 681205 (2008).
[CrossRef]

B. Fishbain, L. P. Yaroslavsky, and I. A. Ideses, J. Real-Time Image Process. 2, 11 (2007).
[CrossRef]

Irani, M.

M. Irani and S. Peleg, CVGIP Graph. Models Image Process. 53, 231 (1991).
[CrossRef]

Meller, M.

Peleg, S.

M. Irani and S. Peleg, CVGIP Graph. Models Image Process. 53, 231 (1991).
[CrossRef]

Roffet-Crété, F.

B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, and F. Roffet-Crété, Proc. SPIE 6808, 68080X (2008).
[CrossRef]

Rozental, Sh.

Shabat, G.

L. P. Yaroslavsky, G. Shabat, B. Fishbain, and I. A. Ideses, Proc. SPIE 6812, 681205 (2008).
[CrossRef]

L. P. Yaroslavsky, B. Fishbain, G. Shabat, and I. Ideses, Opt. Lett. 32, 3038 (2007).
[CrossRef] [PubMed]

Wharton, W.

W. Wharton and D. Howorth, Principles of Television Reception (Pitman, 1971), p. 161.

Yaroslavsky, L. P.

L. P. Yaroslavsky, G. Shabat, B. Fishbain, and I. A. Ideses, Proc. SPIE 6812, 681205 (2008).
[CrossRef]

B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, and F. Roffet-Crété, Proc. SPIE 6808, 68080X (2008).
[CrossRef]

B. Fishbain, L. P. Yaroslavsky, and I. Ideses, Adv. Opt. Technol. 2008, 546808 (2008).

B. Fishbain, L. P. Yaroslavsky, and I. A. Ideses, J. Real-Time Image Process. 2, 11 (2007).
[CrossRef]

L. P. Yaroslavsky, B. Fishbain, G. Shabat, and I. Ideses, Opt. Lett. 32, 3038 (2007).
[CrossRef] [PubMed]

L. P. Yaroslavsky and H. J. Caulfield, Appl. Opt. 33, 2157 (1994).
[CrossRef] [PubMed]

Zalevsky, Z.

Adv. Opt. Technol.

B. Fishbain, L. P. Yaroslavsky, and I. Ideses, Adv. Opt. Technol. 2008, 546808 (2008).

Appl. Opt.

CVGIP Graph. Models Image Process.

M. Irani and S. Peleg, CVGIP Graph. Models Image Process. 53, 231 (1991).
[CrossRef]

J. Real-Time Image Process.

B. Fishbain, L. P. Yaroslavsky, and I. A. Ideses, J. Real-Time Image Process. 2, 11 (2007).
[CrossRef]

Opt. Eng.

O. Hadar and G. D. Boreman, Opt. Eng. 38, 782 (1999).
[CrossRef]

Opt. Lett.

Proc. SPIE

B. Fishbain, L. P. Yaroslavsky, I. A. Ideses, and F. Roffet-Crété, Proc. SPIE 6808, 68080X (2008).
[CrossRef]

L. P. Yaroslavsky, G. Shabat, B. Fishbain, and I. A. Ideses, Proc. SPIE 6812, 681205 (2008).
[CrossRef]

Other

W. Wharton and D. Howorth, Principles of Television Reception (Pitman, 1971), p. 161.

E. Hamilton, JPEG File Interchange Format Version 1.02, September 1992.

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (4)

Fig. 1
Fig. 1

Bayer CFA.

Fig. 2
Fig. 2

Sensor frequency response for fill factor of 1—cross section views. (a), (b), and (c) are, correspondingly, the diagonal, R, and the S cross sections of the 2D Y frequency response of a single sensor. The dotted, solid, and dashed curves represent the Y component frequency response for the green, red, and blue pixels in the Bayer scheme. The two greens, as defined in Eqs. (6, 7), are marked by red horizontal (R.H) and red vertical (R.V). The arrows mark frequencies where for the blue or red channel all luminance information is lost.

Fig. 3
Fig. 3

Acquisitioning setup.

Fig. 4
Fig. 4

Superresolution through turbulent water currents. (a) is the stable reference frame interpolated to twice its original size with aperture correction applied. (b) is the superresolved image with aperture correction, using the same filter applied on (a). (c) and (d) show corresponding image spectra intensities (for display purpose raised to the power of 0.4) of (a) and (b).

Equations (4)

Equations on this page are rendered with MathJax. Learn more.

I ( x , y ) R , G , B = Δ 1 , Δ 2 Ω w ( Δ 1 , Δ 2 ) R , G , B C ( x + Δ 1 , y + Δ 2 ) R , G , B ,
Δ 1 , Δ 2 Ω w ( Δ 1 , Δ 2 ) R , G , B = 1 .
H ( r , s ) R , G , B = H ( r , s ) Δ 1 , Δ 2 w ( Δ 1 , Δ 2 ) R , G , B e 2 π i ( r Δ 1 + s Δ 2 ) ,
Y = 0.299 R + 0.587 G + 0.114 B .

Metrics