Abstract

In this paper, a novel image fusion method based on the expectation maximization (EM) algorithm and steerable pyramid is proposed. The registered images are first decomposed by using steerable pyramid. The EM algorithm is used to fuse the image components in the low frequency band. The selection method involving the informative importance measure is applied to those in the high frequency band. The final fused image is then computed by taking the inverse transform on the composite coefficient representations. Experimental results show that the proposed method outperforms conventional image fusion methods.

© 2005 Chinese Optics Letters

PDF Article

References

  • View by:
  • |
  • |
  • |

  1. Z. Zhang and R. S. Blum, Proceedings of IEEE 87, 1315 (1999).
  2. P. J. Burt and R. J. Kolczynski, in Proceedings of 4th Int. Conf. Computer Vision 171 (1993).
  3. R. K. Sharma, Probabilistic model-based multisensor image fusion Ph.D Dissertation (Oregon Graduate Institute, Portland, October 1999).
  4. J. Yang and R. S. Blum, in Proceedings of IEEE International Conference on Image Processing 1, I/513 (2002).
  5. J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, IEEE Trans. Image Processing 12, 1338 (2003).
  6. M. J. Wainwright, E. P. Simoncelli, and A. S. Willsky, Applied and Computational Harmonic Analysis 11, 89 (2001).
  7. W. T. Freeman and E. H. Adelson, IEEE Trans. Pattern Anal. Mach. Intell. 13, 891 (1991).
  8. E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, IEEE Trans. Infrom. Theory 38, 587 (1991).
  9. J. A. Fessler and O. A. Hero, IEEE Trans. Signal Processing 42, 2664 (1994).
  10. R. S. Blum, R. J. Kozick, and B. M. Sadler, IEEE Trans. Signal Processing 47, 2100 (1999).
  11. E. Diamant, Proc. SPIE 5014, 20 (2003).
  12. C. S. Xydeas and V. Petrovic, Electron. Lett. 36, 308 (2000).
  13. G. H. Qu, D. L. Zhang, and P. F. Yan, Electron. Lett. 38, 313 (2002).
  14. Z. Liu, K. Tsukada, K. Hanasaki, Y. K. Ho, and Y. P. Dai, Pattern Recognition Lett. 22, 929 (2001).
  15. V. S. Petrovic and C. S. Xydeas, Information Fusion 4, 167 (2003).

2003 (3)

J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, IEEE Trans. Image Processing 12, 1338 (2003).

E. Diamant, Proc. SPIE 5014, 20 (2003).

V. S. Petrovic and C. S. Xydeas, Information Fusion 4, 167 (2003).

2002 (1)

G. H. Qu, D. L. Zhang, and P. F. Yan, Electron. Lett. 38, 313 (2002).

2001 (2)

Z. Liu, K. Tsukada, K. Hanasaki, Y. K. Ho, and Y. P. Dai, Pattern Recognition Lett. 22, 929 (2001).

M. J. Wainwright, E. P. Simoncelli, and A. S. Willsky, Applied and Computational Harmonic Analysis 11, 89 (2001).

2000 (1)

C. S. Xydeas and V. Petrovic, Electron. Lett. 36, 308 (2000).

1999 (2)

Z. Zhang and R. S. Blum, Proceedings of IEEE 87, 1315 (1999).

R. S. Blum, R. J. Kozick, and B. M. Sadler, IEEE Trans. Signal Processing 47, 2100 (1999).

1994 (1)

J. A. Fessler and O. A. Hero, IEEE Trans. Signal Processing 42, 2664 (1994).

1991 (2)

W. T. Freeman and E. H. Adelson, IEEE Trans. Pattern Anal. Mach. Intell. 13, 891 (1991).

E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, IEEE Trans. Infrom. Theory 38, 587 (1991).

Adelson, E. H.

W. T. Freeman and E. H. Adelson, IEEE Trans. Pattern Anal. Mach. Intell. 13, 891 (1991).

E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, IEEE Trans. Infrom. Theory 38, 587 (1991).

Blum, R. S.

Z. Zhang and R. S. Blum, Proceedings of IEEE 87, 1315 (1999).

R. S. Blum, R. J. Kozick, and B. M. Sadler, IEEE Trans. Signal Processing 47, 2100 (1999).

Dai, Y. P.

Z. Liu, K. Tsukada, K. Hanasaki, Y. K. Ho, and Y. P. Dai, Pattern Recognition Lett. 22, 929 (2001).

Diamant, E.

E. Diamant, Proc. SPIE 5014, 20 (2003).

Fessler, J. A.

J. A. Fessler and O. A. Hero, IEEE Trans. Signal Processing 42, 2664 (1994).

Freeman, W. T.

E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, IEEE Trans. Infrom. Theory 38, 587 (1991).

W. T. Freeman and E. H. Adelson, IEEE Trans. Pattern Anal. Mach. Intell. 13, 891 (1991).

Hanasaki, K.

Z. Liu, K. Tsukada, K. Hanasaki, Y. K. Ho, and Y. P. Dai, Pattern Recognition Lett. 22, 929 (2001).

Heeger, D. J.

E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, IEEE Trans. Infrom. Theory 38, 587 (1991).

Hero, O. A.

J. A. Fessler and O. A. Hero, IEEE Trans. Signal Processing 42, 2664 (1994).

Ho, Y. K.

Z. Liu, K. Tsukada, K. Hanasaki, Y. K. Ho, and Y. P. Dai, Pattern Recognition Lett. 22, 929 (2001).

Kozick, R. J.

R. S. Blum, R. J. Kozick, and B. M. Sadler, IEEE Trans. Signal Processing 47, 2100 (1999).

Liu, Z.

Z. Liu, K. Tsukada, K. Hanasaki, Y. K. Ho, and Y. P. Dai, Pattern Recognition Lett. 22, 929 (2001).

Petrovic, V.

C. S. Xydeas and V. Petrovic, Electron. Lett. 36, 308 (2000).

Petrovic, V. S.

V. S. Petrovic and C. S. Xydeas, Information Fusion 4, 167 (2003).

Portilla, J.

J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, IEEE Trans. Image Processing 12, 1338 (2003).

Qu, G. H.

G. H. Qu, D. L. Zhang, and P. F. Yan, Electron. Lett. 38, 313 (2002).

Sadler, B. M.

R. S. Blum, R. J. Kozick, and B. M. Sadler, IEEE Trans. Signal Processing 47, 2100 (1999).

Simoncelli, E. P.

J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, IEEE Trans. Image Processing 12, 1338 (2003).

M. J. Wainwright, E. P. Simoncelli, and A. S. Willsky, Applied and Computational Harmonic Analysis 11, 89 (2001).

E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, IEEE Trans. Infrom. Theory 38, 587 (1991).

Strela, V.

J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, IEEE Trans. Image Processing 12, 1338 (2003).

Tsukada, K.

Z. Liu, K. Tsukada, K. Hanasaki, Y. K. Ho, and Y. P. Dai, Pattern Recognition Lett. 22, 929 (2001).

Wainwright, M. J.

J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, IEEE Trans. Image Processing 12, 1338 (2003).

M. J. Wainwright, E. P. Simoncelli, and A. S. Willsky, Applied and Computational Harmonic Analysis 11, 89 (2001).

Willsky, A. S.

M. J. Wainwright, E. P. Simoncelli, and A. S. Willsky, Applied and Computational Harmonic Analysis 11, 89 (2001).

Xydeas, C. S.

V. S. Petrovic and C. S. Xydeas, Information Fusion 4, 167 (2003).

C. S. Xydeas and V. Petrovic, Electron. Lett. 36, 308 (2000).

Yan, P. F.

G. H. Qu, D. L. Zhang, and P. F. Yan, Electron. Lett. 38, 313 (2002).

Zhang, D. L.

G. H. Qu, D. L. Zhang, and P. F. Yan, Electron. Lett. 38, 313 (2002).

Zhang, Z.

Z. Zhang and R. S. Blum, Proceedings of IEEE 87, 1315 (1999).

Applied and Computational Harmonic Analysis (1)

M. J. Wainwright, E. P. Simoncelli, and A. S. Willsky, Applied and Computational Harmonic Analysis 11, 89 (2001).

Electron. Lett. (2)

C. S. Xydeas and V. Petrovic, Electron. Lett. 36, 308 (2000).

G. H. Qu, D. L. Zhang, and P. F. Yan, Electron. Lett. 38, 313 (2002).

IEEE Trans. Image Processing (1)

J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, IEEE Trans. Image Processing 12, 1338 (2003).

IEEE Trans. Infrom. Theory (1)

E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, IEEE Trans. Infrom. Theory 38, 587 (1991).

IEEE Trans. Pattern Anal. Mach. Intell. (1)

W. T. Freeman and E. H. Adelson, IEEE Trans. Pattern Anal. Mach. Intell. 13, 891 (1991).

IEEE Trans. Signal Processing (2)

J. A. Fessler and O. A. Hero, IEEE Trans. Signal Processing 42, 2664 (1994).

R. S. Blum, R. J. Kozick, and B. M. Sadler, IEEE Trans. Signal Processing 47, 2100 (1999).

Information Fusion (1)

V. S. Petrovic and C. S. Xydeas, Information Fusion 4, 167 (2003).

Pattern Recognition Lett. (1)

Z. Liu, K. Tsukada, K. Hanasaki, Y. K. Ho, and Y. P. Dai, Pattern Recognition Lett. 22, 929 (2001).

Proc. SPIE (1)

E. Diamant, Proc. SPIE 5014, 20 (2003).

Proceedings of IEEE (1)

Z. Zhang and R. S. Blum, Proceedings of IEEE 87, 1315 (1999).

Other (3)

P. J. Burt and R. J. Kolczynski, in Proceedings of 4th Int. Conf. Computer Vision 171 (1993).

R. K. Sharma, Probabilistic model-based multisensor image fusion Ph.D Dissertation (Oregon Graduate Institute, Portland, October 1999).

J. Yang and R. S. Blum, in Proceedings of IEEE International Conference on Image Processing 1, I/513 (2002).

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.