Abstract

Depth perception for night vision (NV) imagery could largely improve scene comprehension. We present a novel scheme to give fused multi-band NV imagery smoothly natural color appearance as well as depth sense from color. Our approach is based on simulating color cues by varying saturation values of each object in the color NV image, in correspondence with the ratio between the infrared and low-light-level sensor outputs which in practice is the depth feature for same materials. We render the NV image segment-by-segment by taking advantage of image segmentation, dominant color transfer, saturation variation, and image fusion. Experiments have shown that the proposed scheme can achieve satisfying results.

© 2009 Chinese Optics Letters

PDF Article

References

  • View by:
  • |
  • |
  • |

  1. B. Guo, Q. Zhang, and Y. Hou, Chin. Opt. Lett. 6, 338 (2008).
  2. C. Liu, Z. Jing, G. Xiao, and B. Yang, Chin. Opt. Lett. 5, 274 (2007).
  3. A. Toet and J. Walraven, Opt. Eng. 35, 650 (1996).
  4. A. M. Waxman, A. N. Gove, D. A. Fay, J. P. Racamato, J. E. Carrick, M. C. Seibert, and E. D. Savoye, Neural Netw. 10, 1 (1997).
  5. D. A. Fay, A. M. Waxman, M. Aguilar, D. B. Ireland, J. P. Racamato, W. D. Ross, W. W. Streilein, and M. I. Braun, Proc. SPIE 4023, 106 (2000).
  6. G. Ni, M. Xiao, Q. Qin, and G. Huang, Acta Opt. Sin. (in Chinese) 27, 2101 (2007).
  7. A. Toet, Information Fusion 4, 155 (2003).
  8. A. Toet, Displays 26, 15 (2005).
  9. S. Sun, Z. Jing, G. Liu, and Z. Li, Chin. Opt. Lett. 3, 448 (2005).
  10. V. Tsagiris and V. Anastassopoulos, Displays 26, 191 (2005).
  11. S. Shi, L. Wang, W. Jin, and Y. Zhao, Proc. SPIE 6623, 66230B (2008).
  12. M. A. Hogervorst and A. Toet, in Proceedings of 10th International Conference on Information Fusion 1 (2007).
  13. Y. Zheng and E. A. Essock, Information Fusion 9, 186 (2008).
  14. A. E. Welchman, A. Deubelius, V. Conrad, H. H. Bülthoff, and Z. Kourtzi, Nature Neurosci. 8, 820 (2005).
  15. A. Saxena, S. H. Chung, and A. Y. Ng, Int. J. Comput. Vis. 76, 53 (2008).
  16. R. P. O'Shea, S. G. Blackburn, and H. Ono, Vision Res. 34, 1595 (1994).
  17. D. Comaniciu and P. Meer, IEEE Trans. Pattern Anal. Machine Intell. 24, 603 (2002).

2008

B. Guo, Q. Zhang, and Y. Hou, Chin. Opt. Lett. 6, 338 (2008).

S. Shi, L. Wang, W. Jin, and Y. Zhao, Proc. SPIE 6623, 66230B (2008).

Y. Zheng and E. A. Essock, Information Fusion 9, 186 (2008).

A. Saxena, S. H. Chung, and A. Y. Ng, Int. J. Comput. Vis. 76, 53 (2008).

2007

C. Liu, Z. Jing, G. Xiao, and B. Yang, Chin. Opt. Lett. 5, 274 (2007).

G. Ni, M. Xiao, Q. Qin, and G. Huang, Acta Opt. Sin. (in Chinese) 27, 2101 (2007).

2005

A. Toet, Displays 26, 15 (2005).

S. Sun, Z. Jing, G. Liu, and Z. Li, Chin. Opt. Lett. 3, 448 (2005).

V. Tsagiris and V. Anastassopoulos, Displays 26, 191 (2005).

A. E. Welchman, A. Deubelius, V. Conrad, H. H. Bülthoff, and Z. Kourtzi, Nature Neurosci. 8, 820 (2005).

2003

A. Toet, Information Fusion 4, 155 (2003).

2002

D. Comaniciu and P. Meer, IEEE Trans. Pattern Anal. Machine Intell. 24, 603 (2002).

2000

D. A. Fay, A. M. Waxman, M. Aguilar, D. B. Ireland, J. P. Racamato, W. D. Ross, W. W. Streilein, and M. I. Braun, Proc. SPIE 4023, 106 (2000).

1997

A. M. Waxman, A. N. Gove, D. A. Fay, J. P. Racamato, J. E. Carrick, M. C. Seibert, and E. D. Savoye, Neural Netw. 10, 1 (1997).

1996

A. Toet and J. Walraven, Opt. Eng. 35, 650 (1996).

1994

R. P. O'Shea, S. G. Blackburn, and H. Ono, Vision Res. 34, 1595 (1994).

Aguilar, M.

D. A. Fay, A. M. Waxman, M. Aguilar, D. B. Ireland, J. P. Racamato, W. D. Ross, W. W. Streilein, and M. I. Braun, Proc. SPIE 4023, 106 (2000).

Anastassopoulos, V.

V. Tsagiris and V. Anastassopoulos, Displays 26, 191 (2005).

Blackburn, S. G.

R. P. O'Shea, S. G. Blackburn, and H. Ono, Vision Res. 34, 1595 (1994).

Braun, M. I.

D. A. Fay, A. M. Waxman, M. Aguilar, D. B. Ireland, J. P. Racamato, W. D. Ross, W. W. Streilein, and M. I. Braun, Proc. SPIE 4023, 106 (2000).

Bülthoff, H. H.

A. E. Welchman, A. Deubelius, V. Conrad, H. H. Bülthoff, and Z. Kourtzi, Nature Neurosci. 8, 820 (2005).

Carrick, J. E.

A. M. Waxman, A. N. Gove, D. A. Fay, J. P. Racamato, J. E. Carrick, M. C. Seibert, and E. D. Savoye, Neural Netw. 10, 1 (1997).

Chung, S. H.

A. Saxena, S. H. Chung, and A. Y. Ng, Int. J. Comput. Vis. 76, 53 (2008).

Comaniciu, D.

D. Comaniciu and P. Meer, IEEE Trans. Pattern Anal. Machine Intell. 24, 603 (2002).

Conrad, V.

A. E. Welchman, A. Deubelius, V. Conrad, H. H. Bülthoff, and Z. Kourtzi, Nature Neurosci. 8, 820 (2005).

Deubelius, A.

A. E. Welchman, A. Deubelius, V. Conrad, H. H. Bülthoff, and Z. Kourtzi, Nature Neurosci. 8, 820 (2005).

Essock, E. A.

Y. Zheng and E. A. Essock, Information Fusion 9, 186 (2008).

Fay, D. A.

D. A. Fay, A. M. Waxman, M. Aguilar, D. B. Ireland, J. P. Racamato, W. D. Ross, W. W. Streilein, and M. I. Braun, Proc. SPIE 4023, 106 (2000).

A. M. Waxman, A. N. Gove, D. A. Fay, J. P. Racamato, J. E. Carrick, M. C. Seibert, and E. D. Savoye, Neural Netw. 10, 1 (1997).

Gove, A. N.

A. M. Waxman, A. N. Gove, D. A. Fay, J. P. Racamato, J. E. Carrick, M. C. Seibert, and E. D. Savoye, Neural Netw. 10, 1 (1997).

Guo, B.

Hou, Y.

Huang, G.

G. Ni, M. Xiao, Q. Qin, and G. Huang, Acta Opt. Sin. (in Chinese) 27, 2101 (2007).

Ireland, D. B.

D. A. Fay, A. M. Waxman, M. Aguilar, D. B. Ireland, J. P. Racamato, W. D. Ross, W. W. Streilein, and M. I. Braun, Proc. SPIE 4023, 106 (2000).

Jin, W.

S. Shi, L. Wang, W. Jin, and Y. Zhao, Proc. SPIE 6623, 66230B (2008).

Jing, Z.

Kourtzi, Z.

A. E. Welchman, A. Deubelius, V. Conrad, H. H. Bülthoff, and Z. Kourtzi, Nature Neurosci. 8, 820 (2005).

Li, Z.

Liu, C.

Liu, G.

Meer, P.

D. Comaniciu and P. Meer, IEEE Trans. Pattern Anal. Machine Intell. 24, 603 (2002).

Ng, A. Y.

A. Saxena, S. H. Chung, and A. Y. Ng, Int. J. Comput. Vis. 76, 53 (2008).

Ni, G.

G. Ni, M. Xiao, Q. Qin, and G. Huang, Acta Opt. Sin. (in Chinese) 27, 2101 (2007).

Ono, H.

R. P. O'Shea, S. G. Blackburn, and H. Ono, Vision Res. 34, 1595 (1994).

O'Shea, R. P.

R. P. O'Shea, S. G. Blackburn, and H. Ono, Vision Res. 34, 1595 (1994).

Qin, Q.

G. Ni, M. Xiao, Q. Qin, and G. Huang, Acta Opt. Sin. (in Chinese) 27, 2101 (2007).

Racamato, J. P.

D. A. Fay, A. M. Waxman, M. Aguilar, D. B. Ireland, J. P. Racamato, W. D. Ross, W. W. Streilein, and M. I. Braun, Proc. SPIE 4023, 106 (2000).

A. M. Waxman, A. N. Gove, D. A. Fay, J. P. Racamato, J. E. Carrick, M. C. Seibert, and E. D. Savoye, Neural Netw. 10, 1 (1997).

Ross, W. D.

D. A. Fay, A. M. Waxman, M. Aguilar, D. B. Ireland, J. P. Racamato, W. D. Ross, W. W. Streilein, and M. I. Braun, Proc. SPIE 4023, 106 (2000).

Savoye, E. D.

A. M. Waxman, A. N. Gove, D. A. Fay, J. P. Racamato, J. E. Carrick, M. C. Seibert, and E. D. Savoye, Neural Netw. 10, 1 (1997).

Saxena, A.

A. Saxena, S. H. Chung, and A. Y. Ng, Int. J. Comput. Vis. 76, 53 (2008).

Seibert, M. C.

A. M. Waxman, A. N. Gove, D. A. Fay, J. P. Racamato, J. E. Carrick, M. C. Seibert, and E. D. Savoye, Neural Netw. 10, 1 (1997).

Shi, S.

S. Shi, L. Wang, W. Jin, and Y. Zhao, Proc. SPIE 6623, 66230B (2008).

Streilein, W. W.

D. A. Fay, A. M. Waxman, M. Aguilar, D. B. Ireland, J. P. Racamato, W. D. Ross, W. W. Streilein, and M. I. Braun, Proc. SPIE 4023, 106 (2000).

Sun, S.

Toet, A.

A. Toet, Displays 26, 15 (2005).

A. Toet, Information Fusion 4, 155 (2003).

A. Toet and J. Walraven, Opt. Eng. 35, 650 (1996).

Tsagiris, V.

V. Tsagiris and V. Anastassopoulos, Displays 26, 191 (2005).

Walraven, J.

A. Toet and J. Walraven, Opt. Eng. 35, 650 (1996).

Wang, L.

S. Shi, L. Wang, W. Jin, and Y. Zhao, Proc. SPIE 6623, 66230B (2008).

Waxman, A. M.

D. A. Fay, A. M. Waxman, M. Aguilar, D. B. Ireland, J. P. Racamato, W. D. Ross, W. W. Streilein, and M. I. Braun, Proc. SPIE 4023, 106 (2000).

A. M. Waxman, A. N. Gove, D. A. Fay, J. P. Racamato, J. E. Carrick, M. C. Seibert, and E. D. Savoye, Neural Netw. 10, 1 (1997).

Welchman, A. E.

A. E. Welchman, A. Deubelius, V. Conrad, H. H. Bülthoff, and Z. Kourtzi, Nature Neurosci. 8, 820 (2005).

Xiao, G.

Xiao, M.

G. Ni, M. Xiao, Q. Qin, and G. Huang, Acta Opt. Sin. (in Chinese) 27, 2101 (2007).

Yang, B.

Zhang, Q.

Zhao, Y.

S. Shi, L. Wang, W. Jin, and Y. Zhao, Proc. SPIE 6623, 66230B (2008).

Zheng, Y.

Y. Zheng and E. A. Essock, Information Fusion 9, 186 (2008).

Acta Opt. Sin. (in Chinese)

G. Ni, M. Xiao, Q. Qin, and G. Huang, Acta Opt. Sin. (in Chinese) 27, 2101 (2007).

Chin. Opt. Lett.

Displays

V. Tsagiris and V. Anastassopoulos, Displays 26, 191 (2005).

A. Toet, Displays 26, 15 (2005).

IEEE Trans. Pattern Anal. Machine Intell.

D. Comaniciu and P. Meer, IEEE Trans. Pattern Anal. Machine Intell. 24, 603 (2002).

Information Fusion

A. Toet, Information Fusion 4, 155 (2003).

Y. Zheng and E. A. Essock, Information Fusion 9, 186 (2008).

Int. J. Comput. Vis.

A. Saxena, S. H. Chung, and A. Y. Ng, Int. J. Comput. Vis. 76, 53 (2008).

Nature Neurosci.

A. E. Welchman, A. Deubelius, V. Conrad, H. H. Bülthoff, and Z. Kourtzi, Nature Neurosci. 8, 820 (2005).

Neural Netw.

A. M. Waxman, A. N. Gove, D. A. Fay, J. P. Racamato, J. E. Carrick, M. C. Seibert, and E. D. Savoye, Neural Netw. 10, 1 (1997).

Opt. Eng.

A. Toet and J. Walraven, Opt. Eng. 35, 650 (1996).

Proc. SPIE

D. A. Fay, A. M. Waxman, M. Aguilar, D. B. Ireland, J. P. Racamato, W. D. Ross, W. W. Streilein, and M. I. Braun, Proc. SPIE 4023, 106 (2000).

S. Shi, L. Wang, W. Jin, and Y. Zhao, Proc. SPIE 6623, 66230B (2008).

Vision Res.

R. P. O'Shea, S. G. Blackburn, and H. Ono, Vision Res. 34, 1595 (1994).

Other

M. A. Hogervorst and A. Toet, in Proceedings of 10th International Conference on Information Fusion 1 (2007).

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.