Abstract

Shadow is an inseparable aspect of all natural scenes. When there are multiple light sources or multiple reflections several different shadows may overlap at the same location and create complicated patterns. Shadows are a potentially good source of information about a scene if the shadow regions can be properly identified and segmented. However, shadow region identification and segmentation is a difficult task and improperly identified shadows often interfere with machine vision tasks like object recognition and tracking. We propose here a new shadow separation and contrast enhancement method based on the polarization of light. Polarization information of the scene captured by our polarization-sensitive camera is shown to separate shadows from different light sources effectively. Such shadow separation is almost impossible to realize with conventional, polarization-insensitive imaging.

© 2006 Optical Society of America

Full Article  |  PDF Article
OSA Recommended Articles
Polarization camera for computer vision with a beam splitter

Lawrence B. Wolff
J. Opt. Soc. Am. A 11(11) 2935-2945 (1994)

Adaptive algorithms for two-channel polarization sensing under various polarization statistics with nonuniform distributions

Konstantin M. Yemelyanov, Shih-Schön Lin, Edward N. Pugh, Jr., and Nader Engheta
Appl. Opt. 45(22) 5504-5520 (2006)

Interactive removal and ground truth for difficult shadow scenes

Han Gong and Darren Cosker
J. Opt. Soc. Am. A 33(9) 1798-1811 (2016)

More Recommended Articles

References

  • View by:
  • Article Order
  • |
  • Year
  • |
  • Author
  • |
  • Publication
  1. M. Nagao, T. Matsutyama, and Y. Ikeda, “Region extraction and shape analysis in aerial photographs,” Comput. Vis. Graph. Image Process. 10, 195–223 (1979).
    [Crossref]
  2. R. Gershon, A. D. Jepson, and J. K. Tsotsos, “Ambient illumination and the determination of material changes,” J. Opt. Soc. Am. A 3, 1700–1707 (1986).
    [Crossref] [PubMed]
  3. R. Irvin and D. Mckeown, “Methods for exploiting the relationship between buildings and their shadows in aerial imagery,” IEEE Trans. on Syst. Man..Cybern. 19, 1564–1575 (1989).
    [Crossref]
  4. J. M. Scanlan, D. M. Chabries, and R. W. Christiansen, “A Shadow Detection and Removal Algorithm for 2D Images,” in Proc. of Int. Conf. on Acoustics, Speech, and Signal Processing (1990) pp. 2057–2060.
  5. Y. Liow and T. Pavlidis, “Use of shadows for extracting buildings in aerial images,” Comput. Vis. Graph. Image Process. 49, 242–277 (1991).
    [Crossref]
  6. C. Wang, L. Huang, and A. Rosenfeld, “Detecting clouds and cloud shadows on aerial photographs,” Pattern. Recogn. Lett. 12, 55–64 (1991).
    [Crossref]
  7. D. Koller, K. Danilidis, and H.-H. Nagel, “Model-based object tracking in monocular image sequences of road traffic scenes,” Int. J. Comput. Vis. 10, 257–281 (1993).
    [Crossref]
  8. C. Jiang and M. O. Ward, “Shadow segmentation and classification in a constrained environment,” CVGIP: Image Understanding 59, 213–225 (1994).
    [Crossref]
  9. G. Funka-Lea and R. Bajcsy, “Combining color and geometry for the active visual recognition of shadows,” in Proc. Int. Conf. on Computer Vision (1995) pp. 203–209.
  10. J. Stauder, R. Melch, and J. Ostermann, “Detection of moving cast shadows for object segmentation,” IEEE Trans. Multimedia 1, 65–77 (1999).
    [Crossref]
  11. J. A. Marchant and C. M. Onyango, “Shadow-invariant classification for scenes illuminated by daylight,” J. Opt. Soc. Am. A 17, 1952–1961 (2000).
    [Crossref]
  12. G. Finlayson, S. Hordley, and M. S. Drew, “Removing shadows from images,” in ECCV (2002) pp. 823–836.
  13. R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, “Detecting moving objects, Ghosts, and shadows in video streams,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 1337–1342 (2003).
    [Crossref]
  14. T. Gevers and H. Stokman, “Classifying color edges in video into shadow-geometry, highlight, or material transitions,” IEEE Trans. Multimedia 5, 237–243 (2003).
    [Crossref]
  15. A. Prati, I. Mikic, M. M. Trivedi, and R. Cucchiara, “Detecting Moving Shadows: Algorithms and Evaluation,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 918–923 (2003).
    [Crossref]
  16. I. Sato, Y. Sato, and K. Ikeuchi, “Illumination from shadows,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 290–300 (2003).
    [Crossref]
  17. S. Nadimi and B. Bhanu, “Physical models for moving shadow and object detection in video,” IEEE Trans. Pattern Anal. Mach. Intell. 26, 1079–1087 (2004).
    [Crossref]
  18. E. Salvador, A. Cavallaro, and T. Ebrahimi, “Cast shadow segmentation using invariant color features,” Comput. Vis. Image Understand. 95, 238–259 (2004).
    [Crossref]
  19. J. M. Wang, Y. C. Chung, C. L. Chang, and S. W. Chen, “Shadow Detection and Removal for Traffic Images,” in Proc. 2004 IEEE Int. Conf. on Networking, Sensing and Control (IEEE Syst. Man Cybern. Society, Taipei, Taiwan, 2004) pp. 649–654.
    [Crossref]
  20. K. Frisch, “Die polarisation des himmelslichtes als orientierender faktor bei den tanzen der bienen,” Experientia 5, 142–148 (1949).
    [Crossref] [PubMed]
  21. R. Wehner, “Polarized-light navigation by insects,” Scientific American 235, 106–114 (1976).
    [Crossref] [PubMed]
  22. R. Schwind, “Zonation of the optical environment and zonation in the rhabdom structure within the eye of the backswimmer, Notenecta glauca,” Cell and Tissue Research 232, 53–63 (1983).
    [Crossref] [PubMed]
  23. G. Horváth, “Reflection polarization patterns at flat water surfaces and their relevance for insect polarization vision,” J. Theor. Biol. 175, 27–37 (1995).
    [Crossref] [PubMed]
  24. M. P. Rowe, E. N. Pugh, and N. Engheta, “Polarization-difference imaging: a biologically inspired technique for observation through scattering media,” Opt. Lett. 20, 608–610 (1995).
    [Crossref] [PubMed]
  25. J. S. Tyo, M. P. Rowe, E. N. Pugh, and N. Engheta, “Target detection in optically scatter media by polarization-difference imaging,” Appl. Opt. 35, 1855–1870 (1996).
    [Crossref] [PubMed]
  26. S.-S. Lin, K. M. Yemelyanov, E. N. Pugh, and N. Engheta, “Polarization Enhanced Visual Surveillance Techniques,” in Proc. IEEE Int. Conf. on Networking, Sensing and Control (IEEE Syst. Man. .Cybern. Society, Taipei, Taiwan, 2004), 1, pp. 216–221.
    [Crossref]
  27. S.-S. Lin, K. M. Yemelyanov, E. N. Pugh, and N. Engheta, “Polarization- and specular-reflection-based, non-contact latent fingerprint imaging and lifting,” J. Opt. Soc. Am. A (to be published).
  28. K. M. Yemelyanov, S.-S. Lin, E. N. Pugh, and N. Engheta, “Adaptive Algorithms for 2-channel polarization sensing under various polarization statistics with non-uniform distributions,” Appl. Opt. (to be published).
    [PubMed]
  29. J. S. Tyo, E. N. Pugh, and N. Engheta, “Colorimetric representation for use with polarization-difference imaging of objects in scattering media,” J. Opt. Soc. Am. A 15, 367–374 (1998).
    [Crossref]
  30. K. M. Yemelyanov, M. A. Lo, E. N. Pugh, and N. Engheta, “Display of polarization information by coherently moving dots,” Opt. Express 11, 1577–1584 (2003).
    [Crossref] [PubMed]
  31. W. G. Egan, “Dark-target retroreflection increase,” in Polarization: Measurement, Analysis, and Remote Sensing II, D. H. Goldstein and D. B. Chenault, eds., Proc. SPIE,  3754, 218–225 (1999).
    [Crossref]
  32. M. J. Duggin, “Imaging polarimetry in scene element discrimination,” in Polarization: Measurement, Analysis, and Remote Sensing II, D. H. Goldstein and D. B. Chenault, eds., Proc SPIE 3754, 108–117 (1999).
    [Crossref]
  33. D. H. Goldstein, D. B. Chenault, and J. L. Pezzaniti, “Polarimetric characterization of Spectralon,” in Polarization: Measurement, Analysis, and Remote Sensing II, D. H. Goldstein and D. B. Chenault, eds., Proc. SPIE 3754, 126–136 (1999).
    [Crossref]
  34. E. Hecht, Optics (Addison Wesley Longman, Inc., Reading, MA, USA1998).
  35. K. M. Yemelyanov, S.-S. Lin, W. Q. Luis, E. N. Pugh, and N. Engheta, “Bio-inspired display of polarization information using selected visual cues,” in Polarization Science and Remote Sensing, J. A. Shaw and J. S. Tyo eds. Proc. SPIE,  5158, 71–84 (2003).
    [Crossref]
  36. A. P. Pentland, “Finding the illuminant direction,” J. Opt. Soc. Am. 72, 448–455 (1982).
    [Crossref]
  37. Y. Zhang and Y. Yang, “Illuminant direction determination for multiple light sources,” in Proc. CVPR (IEEE, 2000) pp. 269–276.
  38. J. Pinel and H. Nicolas, “Estimation 2d illuminant direction and shadow segmentation in natural video sequences,” in Proc. VLBV (2001) pp. 197–202.
  39. M. W. Powell, S. Sarkar, and D. Goldgof, “A simple strategy for calibrating the geometry of light sources,” IEEE Trans. Pattern Anal. Mach. Intell. 23, 1022–1027 (2001).
    [Crossref]

2004 (2)

S. Nadimi and B. Bhanu, “Physical models for moving shadow and object detection in video,” IEEE Trans. Pattern Anal. Mach. Intell. 26, 1079–1087 (2004).
[Crossref]

E. Salvador, A. Cavallaro, and T. Ebrahimi, “Cast shadow segmentation using invariant color features,” Comput. Vis. Image Understand. 95, 238–259 (2004).
[Crossref]

2003 (6)

R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, “Detecting moving objects, Ghosts, and shadows in video streams,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 1337–1342 (2003).
[Crossref]

T. Gevers and H. Stokman, “Classifying color edges in video into shadow-geometry, highlight, or material transitions,” IEEE Trans. Multimedia 5, 237–243 (2003).
[Crossref]

A. Prati, I. Mikic, M. M. Trivedi, and R. Cucchiara, “Detecting Moving Shadows: Algorithms and Evaluation,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 918–923 (2003).
[Crossref]

I. Sato, Y. Sato, and K. Ikeuchi, “Illumination from shadows,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 290–300 (2003).
[Crossref]

K. M. Yemelyanov, M. A. Lo, E. N. Pugh, and N. Engheta, “Display of polarization information by coherently moving dots,” Opt. Express 11, 1577–1584 (2003).
[Crossref] [PubMed]

K. M. Yemelyanov, S.-S. Lin, W. Q. Luis, E. N. Pugh, and N. Engheta, “Bio-inspired display of polarization information using selected visual cues,” in Polarization Science and Remote Sensing, J. A. Shaw and J. S. Tyo eds. Proc. SPIE,  5158, 71–84 (2003).
[Crossref]

2001 (2)

J. Pinel and H. Nicolas, “Estimation 2d illuminant direction and shadow segmentation in natural video sequences,” in Proc. VLBV (2001) pp. 197–202.

M. W. Powell, S. Sarkar, and D. Goldgof, “A simple strategy for calibrating the geometry of light sources,” IEEE Trans. Pattern Anal. Mach. Intell. 23, 1022–1027 (2001).
[Crossref]

2000 (1)

1999 (4)

J. Stauder, R. Melch, and J. Ostermann, “Detection of moving cast shadows for object segmentation,” IEEE Trans. Multimedia 1, 65–77 (1999).
[Crossref]

W. G. Egan, “Dark-target retroreflection increase,” in Polarization: Measurement, Analysis, and Remote Sensing II, D. H. Goldstein and D. B. Chenault, eds., Proc. SPIE,  3754, 218–225 (1999).
[Crossref]

M. J. Duggin, “Imaging polarimetry in scene element discrimination,” in Polarization: Measurement, Analysis, and Remote Sensing II, D. H. Goldstein and D. B. Chenault, eds., Proc SPIE 3754, 108–117 (1999).
[Crossref]

D. H. Goldstein, D. B. Chenault, and J. L. Pezzaniti, “Polarimetric characterization of Spectralon,” in Polarization: Measurement, Analysis, and Remote Sensing II, D. H. Goldstein and D. B. Chenault, eds., Proc. SPIE 3754, 126–136 (1999).
[Crossref]

1998 (1)

1996 (1)

1995 (2)

G. Horváth, “Reflection polarization patterns at flat water surfaces and their relevance for insect polarization vision,” J. Theor. Biol. 175, 27–37 (1995).
[Crossref] [PubMed]

M. P. Rowe, E. N. Pugh, and N. Engheta, “Polarization-difference imaging: a biologically inspired technique for observation through scattering media,” Opt. Lett. 20, 608–610 (1995).
[Crossref] [PubMed]

1994 (1)

C. Jiang and M. O. Ward, “Shadow segmentation and classification in a constrained environment,” CVGIP: Image Understanding 59, 213–225 (1994).
[Crossref]

1993 (1)

D. Koller, K. Danilidis, and H.-H. Nagel, “Model-based object tracking in monocular image sequences of road traffic scenes,” Int. J. Comput. Vis. 10, 257–281 (1993).
[Crossref]

1991 (2)

Y. Liow and T. Pavlidis, “Use of shadows for extracting buildings in aerial images,” Comput. Vis. Graph. Image Process. 49, 242–277 (1991).
[Crossref]

C. Wang, L. Huang, and A. Rosenfeld, “Detecting clouds and cloud shadows on aerial photographs,” Pattern. Recogn. Lett. 12, 55–64 (1991).
[Crossref]

1989 (1)

R. Irvin and D. Mckeown, “Methods for exploiting the relationship between buildings and their shadows in aerial imagery,” IEEE Trans. on Syst. Man..Cybern. 19, 1564–1575 (1989).
[Crossref]

1986 (1)

1983 (1)

R. Schwind, “Zonation of the optical environment and zonation in the rhabdom structure within the eye of the backswimmer, Notenecta glauca,” Cell and Tissue Research 232, 53–63 (1983).
[Crossref] [PubMed]

1982 (1)

1979 (1)

M. Nagao, T. Matsutyama, and Y. Ikeda, “Region extraction and shape analysis in aerial photographs,” Comput. Vis. Graph. Image Process. 10, 195–223 (1979).
[Crossref]

1976 (1)

R. Wehner, “Polarized-light navigation by insects,” Scientific American 235, 106–114 (1976).
[Crossref] [PubMed]

1949 (1)

K. Frisch, “Die polarisation des himmelslichtes als orientierender faktor bei den tanzen der bienen,” Experientia 5, 142–148 (1949).
[Crossref] [PubMed]

Bajcsy, R.

G. Funka-Lea and R. Bajcsy, “Combining color and geometry for the active visual recognition of shadows,” in Proc. Int. Conf. on Computer Vision (1995) pp. 203–209.

Bhanu, B.

S. Nadimi and B. Bhanu, “Physical models for moving shadow and object detection in video,” IEEE Trans. Pattern Anal. Mach. Intell. 26, 1079–1087 (2004).
[Crossref]

Cavallaro, A.

E. Salvador, A. Cavallaro, and T. Ebrahimi, “Cast shadow segmentation using invariant color features,” Comput. Vis. Image Understand. 95, 238–259 (2004).
[Crossref]

Chabries, D. M.

J. M. Scanlan, D. M. Chabries, and R. W. Christiansen, “A Shadow Detection and Removal Algorithm for 2D Images,” in Proc. of Int. Conf. on Acoustics, Speech, and Signal Processing (1990) pp. 2057–2060.

Chang, C. L.

J. M. Wang, Y. C. Chung, C. L. Chang, and S. W. Chen, “Shadow Detection and Removal for Traffic Images,” in Proc. 2004 IEEE Int. Conf. on Networking, Sensing and Control (IEEE Syst. Man Cybern. Society, Taipei, Taiwan, 2004) pp. 649–654.
[Crossref]

Chen, S. W.

J. M. Wang, Y. C. Chung, C. L. Chang, and S. W. Chen, “Shadow Detection and Removal for Traffic Images,” in Proc. 2004 IEEE Int. Conf. on Networking, Sensing and Control (IEEE Syst. Man Cybern. Society, Taipei, Taiwan, 2004) pp. 649–654.
[Crossref]

Chenault, D. B.

D. H. Goldstein, D. B. Chenault, and J. L. Pezzaniti, “Polarimetric characterization of Spectralon,” in Polarization: Measurement, Analysis, and Remote Sensing II, D. H. Goldstein and D. B. Chenault, eds., Proc. SPIE 3754, 126–136 (1999).
[Crossref]

Christiansen, R. W.

J. M. Scanlan, D. M. Chabries, and R. W. Christiansen, “A Shadow Detection and Removal Algorithm for 2D Images,” in Proc. of Int. Conf. on Acoustics, Speech, and Signal Processing (1990) pp. 2057–2060.

Chung, Y. C.

J. M. Wang, Y. C. Chung, C. L. Chang, and S. W. Chen, “Shadow Detection and Removal for Traffic Images,” in Proc. 2004 IEEE Int. Conf. on Networking, Sensing and Control (IEEE Syst. Man Cybern. Society, Taipei, Taiwan, 2004) pp. 649–654.
[Crossref]

Cucchiara, R.

R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, “Detecting moving objects, Ghosts, and shadows in video streams,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 1337–1342 (2003).
[Crossref]

A. Prati, I. Mikic, M. M. Trivedi, and R. Cucchiara, “Detecting Moving Shadows: Algorithms and Evaluation,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 918–923 (2003).
[Crossref]

Danilidis, K.

D. Koller, K. Danilidis, and H.-H. Nagel, “Model-based object tracking in monocular image sequences of road traffic scenes,” Int. J. Comput. Vis. 10, 257–281 (1993).
[Crossref]

Drew, M. S.

G. Finlayson, S. Hordley, and M. S. Drew, “Removing shadows from images,” in ECCV (2002) pp. 823–836.

Duggin, M. J.

M. J. Duggin, “Imaging polarimetry in scene element discrimination,” in Polarization: Measurement, Analysis, and Remote Sensing II, D. H. Goldstein and D. B. Chenault, eds., Proc SPIE 3754, 108–117 (1999).
[Crossref]

Ebrahimi, T.

E. Salvador, A. Cavallaro, and T. Ebrahimi, “Cast shadow segmentation using invariant color features,” Comput. Vis. Image Understand. 95, 238–259 (2004).
[Crossref]

Egan, W. G.

W. G. Egan, “Dark-target retroreflection increase,” in Polarization: Measurement, Analysis, and Remote Sensing II, D. H. Goldstein and D. B. Chenault, eds., Proc. SPIE,  3754, 218–225 (1999).
[Crossref]

Engheta, N.

K. M. Yemelyanov, S.-S. Lin, W. Q. Luis, E. N. Pugh, and N. Engheta, “Bio-inspired display of polarization information using selected visual cues,” in Polarization Science and Remote Sensing, J. A. Shaw and J. S. Tyo eds. Proc. SPIE,  5158, 71–84 (2003).
[Crossref]

K. M. Yemelyanov, M. A. Lo, E. N. Pugh, and N. Engheta, “Display of polarization information by coherently moving dots,” Opt. Express 11, 1577–1584 (2003).
[Crossref] [PubMed]

J. S. Tyo, E. N. Pugh, and N. Engheta, “Colorimetric representation for use with polarization-difference imaging of objects in scattering media,” J. Opt. Soc. Am. A 15, 367–374 (1998).
[Crossref]

J. S. Tyo, M. P. Rowe, E. N. Pugh, and N. Engheta, “Target detection in optically scatter media by polarization-difference imaging,” Appl. Opt. 35, 1855–1870 (1996).
[Crossref] [PubMed]

M. P. Rowe, E. N. Pugh, and N. Engheta, “Polarization-difference imaging: a biologically inspired technique for observation through scattering media,” Opt. Lett. 20, 608–610 (1995).
[Crossref] [PubMed]

K. M. Yemelyanov, S.-S. Lin, E. N. Pugh, and N. Engheta, “Adaptive Algorithms for 2-channel polarization sensing under various polarization statistics with non-uniform distributions,” Appl. Opt. (to be published).
[PubMed]

S.-S. Lin, K. M. Yemelyanov, E. N. Pugh, and N. Engheta, “Polarization Enhanced Visual Surveillance Techniques,” in Proc. IEEE Int. Conf. on Networking, Sensing and Control (IEEE Syst. Man. .Cybern. Society, Taipei, Taiwan, 2004), 1, pp. 216–221.
[Crossref]

S.-S. Lin, K. M. Yemelyanov, E. N. Pugh, and N. Engheta, “Polarization- and specular-reflection-based, non-contact latent fingerprint imaging and lifting,” J. Opt. Soc. Am. A (to be published).

Finlayson, G.

G. Finlayson, S. Hordley, and M. S. Drew, “Removing shadows from images,” in ECCV (2002) pp. 823–836.

Frisch, K.

K. Frisch, “Die polarisation des himmelslichtes als orientierender faktor bei den tanzen der bienen,” Experientia 5, 142–148 (1949).
[Crossref] [PubMed]

Funka-Lea, G.

G. Funka-Lea and R. Bajcsy, “Combining color and geometry for the active visual recognition of shadows,” in Proc. Int. Conf. on Computer Vision (1995) pp. 203–209.

Gershon, R.

Gevers, T.

T. Gevers and H. Stokman, “Classifying color edges in video into shadow-geometry, highlight, or material transitions,” IEEE Trans. Multimedia 5, 237–243 (2003).
[Crossref]

Goldgof, D.

M. W. Powell, S. Sarkar, and D. Goldgof, “A simple strategy for calibrating the geometry of light sources,” IEEE Trans. Pattern Anal. Mach. Intell. 23, 1022–1027 (2001).
[Crossref]

Goldstein, D. H.

D. H. Goldstein, D. B. Chenault, and J. L. Pezzaniti, “Polarimetric characterization of Spectralon,” in Polarization: Measurement, Analysis, and Remote Sensing II, D. H. Goldstein and D. B. Chenault, eds., Proc. SPIE 3754, 126–136 (1999).
[Crossref]

Grana, C.

R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, “Detecting moving objects, Ghosts, and shadows in video streams,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 1337–1342 (2003).
[Crossref]

Hecht, E.

E. Hecht, Optics (Addison Wesley Longman, Inc., Reading, MA, USA1998).

Hordley, S.

G. Finlayson, S. Hordley, and M. S. Drew, “Removing shadows from images,” in ECCV (2002) pp. 823–836.

Horváth, G.

G. Horváth, “Reflection polarization patterns at flat water surfaces and their relevance for insect polarization vision,” J. Theor. Biol. 175, 27–37 (1995).
[Crossref] [PubMed]

Huang, L.

C. Wang, L. Huang, and A. Rosenfeld, “Detecting clouds and cloud shadows on aerial photographs,” Pattern. Recogn. Lett. 12, 55–64 (1991).
[Crossref]

Ikeda, Y.

M. Nagao, T. Matsutyama, and Y. Ikeda, “Region extraction and shape analysis in aerial photographs,” Comput. Vis. Graph. Image Process. 10, 195–223 (1979).
[Crossref]

Ikeuchi, K.

I. Sato, Y. Sato, and K. Ikeuchi, “Illumination from shadows,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 290–300 (2003).
[Crossref]

Irvin, R.

R. Irvin and D. Mckeown, “Methods for exploiting the relationship between buildings and their shadows in aerial imagery,” IEEE Trans. on Syst. Man..Cybern. 19, 1564–1575 (1989).
[Crossref]

Jepson, A. D.

Jiang, C.

C. Jiang and M. O. Ward, “Shadow segmentation and classification in a constrained environment,” CVGIP: Image Understanding 59, 213–225 (1994).
[Crossref]

Koller, D.

D. Koller, K. Danilidis, and H.-H. Nagel, “Model-based object tracking in monocular image sequences of road traffic scenes,” Int. J. Comput. Vis. 10, 257–281 (1993).
[Crossref]

Lin, S.-S.

K. M. Yemelyanov, S.-S. Lin, W. Q. Luis, E. N. Pugh, and N. Engheta, “Bio-inspired display of polarization information using selected visual cues,” in Polarization Science and Remote Sensing, J. A. Shaw and J. S. Tyo eds. Proc. SPIE,  5158, 71–84 (2003).
[Crossref]

S.-S. Lin, K. M. Yemelyanov, E. N. Pugh, and N. Engheta, “Polarization Enhanced Visual Surveillance Techniques,” in Proc. IEEE Int. Conf. on Networking, Sensing and Control (IEEE Syst. Man. .Cybern. Society, Taipei, Taiwan, 2004), 1, pp. 216–221.
[Crossref]

K. M. Yemelyanov, S.-S. Lin, E. N. Pugh, and N. Engheta, “Adaptive Algorithms for 2-channel polarization sensing under various polarization statistics with non-uniform distributions,” Appl. Opt. (to be published).
[PubMed]

S.-S. Lin, K. M. Yemelyanov, E. N. Pugh, and N. Engheta, “Polarization- and specular-reflection-based, non-contact latent fingerprint imaging and lifting,” J. Opt. Soc. Am. A (to be published).

Liow, Y.

Y. Liow and T. Pavlidis, “Use of shadows for extracting buildings in aerial images,” Comput. Vis. Graph. Image Process. 49, 242–277 (1991).
[Crossref]

Lo, M. A.

Luis, W. Q.

K. M. Yemelyanov, S.-S. Lin, W. Q. Luis, E. N. Pugh, and N. Engheta, “Bio-inspired display of polarization information using selected visual cues,” in Polarization Science and Remote Sensing, J. A. Shaw and J. S. Tyo eds. Proc. SPIE,  5158, 71–84 (2003).
[Crossref]

Marchant, J. A.

Matsutyama, T.

M. Nagao, T. Matsutyama, and Y. Ikeda, “Region extraction and shape analysis in aerial photographs,” Comput. Vis. Graph. Image Process. 10, 195–223 (1979).
[Crossref]

Mckeown, D.

R. Irvin and D. Mckeown, “Methods for exploiting the relationship between buildings and their shadows in aerial imagery,” IEEE Trans. on Syst. Man..Cybern. 19, 1564–1575 (1989).
[Crossref]

Melch, R.

J. Stauder, R. Melch, and J. Ostermann, “Detection of moving cast shadows for object segmentation,” IEEE Trans. Multimedia 1, 65–77 (1999).
[Crossref]

Mikic, I.

A. Prati, I. Mikic, M. M. Trivedi, and R. Cucchiara, “Detecting Moving Shadows: Algorithms and Evaluation,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 918–923 (2003).
[Crossref]

Nadimi, S.

S. Nadimi and B. Bhanu, “Physical models for moving shadow and object detection in video,” IEEE Trans. Pattern Anal. Mach. Intell. 26, 1079–1087 (2004).
[Crossref]

Nagao, M.

M. Nagao, T. Matsutyama, and Y. Ikeda, “Region extraction and shape analysis in aerial photographs,” Comput. Vis. Graph. Image Process. 10, 195–223 (1979).
[Crossref]

Nagel, H.-H.

D. Koller, K. Danilidis, and H.-H. Nagel, “Model-based object tracking in monocular image sequences of road traffic scenes,” Int. J. Comput. Vis. 10, 257–281 (1993).
[Crossref]

Nicolas, H.

J. Pinel and H. Nicolas, “Estimation 2d illuminant direction and shadow segmentation in natural video sequences,” in Proc. VLBV (2001) pp. 197–202.

Onyango, C. M.

Ostermann, J.

J. Stauder, R. Melch, and J. Ostermann, “Detection of moving cast shadows for object segmentation,” IEEE Trans. Multimedia 1, 65–77 (1999).
[Crossref]

Pavlidis, T.

Y. Liow and T. Pavlidis, “Use of shadows for extracting buildings in aerial images,” Comput. Vis. Graph. Image Process. 49, 242–277 (1991).
[Crossref]

Pentland, A. P.

Pezzaniti, J. L.

D. H. Goldstein, D. B. Chenault, and J. L. Pezzaniti, “Polarimetric characterization of Spectralon,” in Polarization: Measurement, Analysis, and Remote Sensing II, D. H. Goldstein and D. B. Chenault, eds., Proc. SPIE 3754, 126–136 (1999).
[Crossref]

Piccardi, M.

R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, “Detecting moving objects, Ghosts, and shadows in video streams,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 1337–1342 (2003).
[Crossref]

Pinel, J.

J. Pinel and H. Nicolas, “Estimation 2d illuminant direction and shadow segmentation in natural video sequences,” in Proc. VLBV (2001) pp. 197–202.

Powell, M. W.

M. W. Powell, S. Sarkar, and D. Goldgof, “A simple strategy for calibrating the geometry of light sources,” IEEE Trans. Pattern Anal. Mach. Intell. 23, 1022–1027 (2001).
[Crossref]

Prati, A.

R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, “Detecting moving objects, Ghosts, and shadows in video streams,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 1337–1342 (2003).
[Crossref]

A. Prati, I. Mikic, M. M. Trivedi, and R. Cucchiara, “Detecting Moving Shadows: Algorithms and Evaluation,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 918–923 (2003).
[Crossref]

Pugh, E. N.

K. M. Yemelyanov, S.-S. Lin, W. Q. Luis, E. N. Pugh, and N. Engheta, “Bio-inspired display of polarization information using selected visual cues,” in Polarization Science and Remote Sensing, J. A. Shaw and J. S. Tyo eds. Proc. SPIE,  5158, 71–84 (2003).
[Crossref]

K. M. Yemelyanov, M. A. Lo, E. N. Pugh, and N. Engheta, “Display of polarization information by coherently moving dots,” Opt. Express 11, 1577–1584 (2003).
[Crossref] [PubMed]

J. S. Tyo, E. N. Pugh, and N. Engheta, “Colorimetric representation for use with polarization-difference imaging of objects in scattering media,” J. Opt. Soc. Am. A 15, 367–374 (1998).
[Crossref]

J. S. Tyo, M. P. Rowe, E. N. Pugh, and N. Engheta, “Target detection in optically scatter media by polarization-difference imaging,” Appl. Opt. 35, 1855–1870 (1996).
[Crossref] [PubMed]

M. P. Rowe, E. N. Pugh, and N. Engheta, “Polarization-difference imaging: a biologically inspired technique for observation through scattering media,” Opt. Lett. 20, 608–610 (1995).
[Crossref] [PubMed]

S.-S. Lin, K. M. Yemelyanov, E. N. Pugh, and N. Engheta, “Polarization Enhanced Visual Surveillance Techniques,” in Proc. IEEE Int. Conf. on Networking, Sensing and Control (IEEE Syst. Man. .Cybern. Society, Taipei, Taiwan, 2004), 1, pp. 216–221.
[Crossref]

S.-S. Lin, K. M. Yemelyanov, E. N. Pugh, and N. Engheta, “Polarization- and specular-reflection-based, non-contact latent fingerprint imaging and lifting,” J. Opt. Soc. Am. A (to be published).

K. M. Yemelyanov, S.-S. Lin, E. N. Pugh, and N. Engheta, “Adaptive Algorithms for 2-channel polarization sensing under various polarization statistics with non-uniform distributions,” Appl. Opt. (to be published).
[PubMed]

Rosenfeld, A.

C. Wang, L. Huang, and A. Rosenfeld, “Detecting clouds and cloud shadows on aerial photographs,” Pattern. Recogn. Lett. 12, 55–64 (1991).
[Crossref]

Rowe, M. P.

Salvador, E.

E. Salvador, A. Cavallaro, and T. Ebrahimi, “Cast shadow segmentation using invariant color features,” Comput. Vis. Image Understand. 95, 238–259 (2004).
[Crossref]

Sarkar, S.

M. W. Powell, S. Sarkar, and D. Goldgof, “A simple strategy for calibrating the geometry of light sources,” IEEE Trans. Pattern Anal. Mach. Intell. 23, 1022–1027 (2001).
[Crossref]

Sato, I.

I. Sato, Y. Sato, and K. Ikeuchi, “Illumination from shadows,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 290–300 (2003).
[Crossref]

Sato, Y.

I. Sato, Y. Sato, and K. Ikeuchi, “Illumination from shadows,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 290–300 (2003).
[Crossref]

Scanlan, J. M.

J. M. Scanlan, D. M. Chabries, and R. W. Christiansen, “A Shadow Detection and Removal Algorithm for 2D Images,” in Proc. of Int. Conf. on Acoustics, Speech, and Signal Processing (1990) pp. 2057–2060.

Schwind, R.

R. Schwind, “Zonation of the optical environment and zonation in the rhabdom structure within the eye of the backswimmer, Notenecta glauca,” Cell and Tissue Research 232, 53–63 (1983).
[Crossref] [PubMed]

Stauder, J.

J. Stauder, R. Melch, and J. Ostermann, “Detection of moving cast shadows for object segmentation,” IEEE Trans. Multimedia 1, 65–77 (1999).
[Crossref]

Stokman, H.

T. Gevers and H. Stokman, “Classifying color edges in video into shadow-geometry, highlight, or material transitions,” IEEE Trans. Multimedia 5, 237–243 (2003).
[Crossref]

Trivedi, M. M.

A. Prati, I. Mikic, M. M. Trivedi, and R. Cucchiara, “Detecting Moving Shadows: Algorithms and Evaluation,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 918–923 (2003).
[Crossref]

Tsotsos, J. K.

Tyo, J. S.

Wang, C.

C. Wang, L. Huang, and A. Rosenfeld, “Detecting clouds and cloud shadows on aerial photographs,” Pattern. Recogn. Lett. 12, 55–64 (1991).
[Crossref]

Wang, J. M.

J. M. Wang, Y. C. Chung, C. L. Chang, and S. W. Chen, “Shadow Detection and Removal for Traffic Images,” in Proc. 2004 IEEE Int. Conf. on Networking, Sensing and Control (IEEE Syst. Man Cybern. Society, Taipei, Taiwan, 2004) pp. 649–654.
[Crossref]

Ward, M. O.

C. Jiang and M. O. Ward, “Shadow segmentation and classification in a constrained environment,” CVGIP: Image Understanding 59, 213–225 (1994).
[Crossref]

Wehner, R.

R. Wehner, “Polarized-light navigation by insects,” Scientific American 235, 106–114 (1976).
[Crossref] [PubMed]

Yang, Y.

Y. Zhang and Y. Yang, “Illuminant direction determination for multiple light sources,” in Proc. CVPR (IEEE, 2000) pp. 269–276.

Yemelyanov, K. M.

K. M. Yemelyanov, M. A. Lo, E. N. Pugh, and N. Engheta, “Display of polarization information by coherently moving dots,” Opt. Express 11, 1577–1584 (2003).
[Crossref] [PubMed]

K. M. Yemelyanov, S.-S. Lin, W. Q. Luis, E. N. Pugh, and N. Engheta, “Bio-inspired display of polarization information using selected visual cues,” in Polarization Science and Remote Sensing, J. A. Shaw and J. S. Tyo eds. Proc. SPIE,  5158, 71–84 (2003).
[Crossref]

K. M. Yemelyanov, S.-S. Lin, E. N. Pugh, and N. Engheta, “Adaptive Algorithms for 2-channel polarization sensing under various polarization statistics with non-uniform distributions,” Appl. Opt. (to be published).
[PubMed]

S.-S. Lin, K. M. Yemelyanov, E. N. Pugh, and N. Engheta, “Polarization- and specular-reflection-based, non-contact latent fingerprint imaging and lifting,” J. Opt. Soc. Am. A (to be published).

S.-S. Lin, K. M. Yemelyanov, E. N. Pugh, and N. Engheta, “Polarization Enhanced Visual Surveillance Techniques,” in Proc. IEEE Int. Conf. on Networking, Sensing and Control (IEEE Syst. Man. .Cybern. Society, Taipei, Taiwan, 2004), 1, pp. 216–221.
[Crossref]

Zhang, Y.

Y. Zhang and Y. Yang, “Illuminant direction determination for multiple light sources,” in Proc. CVPR (IEEE, 2000) pp. 269–276.

Appl. Opt. (2)

J. S. Tyo, M. P. Rowe, E. N. Pugh, and N. Engheta, “Target detection in optically scatter media by polarization-difference imaging,” Appl. Opt. 35, 1855–1870 (1996).
[Crossref] [PubMed]

K. M. Yemelyanov, S.-S. Lin, E. N. Pugh, and N. Engheta, “Adaptive Algorithms for 2-channel polarization sensing under various polarization statistics with non-uniform distributions,” Appl. Opt. (to be published).
[PubMed]

Cell and Tissue Research (1)

R. Schwind, “Zonation of the optical environment and zonation in the rhabdom structure within the eye of the backswimmer, Notenecta glauca,” Cell and Tissue Research 232, 53–63 (1983).
[Crossref] [PubMed]

Comput. Vis. Graph. Image Process. (2)

M. Nagao, T. Matsutyama, and Y. Ikeda, “Region extraction and shape analysis in aerial photographs,” Comput. Vis. Graph. Image Process. 10, 195–223 (1979).
[Crossref]

Y. Liow and T. Pavlidis, “Use of shadows for extracting buildings in aerial images,” Comput. Vis. Graph. Image Process. 49, 242–277 (1991).
[Crossref]

Comput. Vis. Image Understand. (1)

E. Salvador, A. Cavallaro, and T. Ebrahimi, “Cast shadow segmentation using invariant color features,” Comput. Vis. Image Understand. 95, 238–259 (2004).
[Crossref]

CVGIP: Image Understanding (1)

C. Jiang and M. O. Ward, “Shadow segmentation and classification in a constrained environment,” CVGIP: Image Understanding 59, 213–225 (1994).
[Crossref]

Experientia (1)

K. Frisch, “Die polarisation des himmelslichtes als orientierender faktor bei den tanzen der bienen,” Experientia 5, 142–148 (1949).
[Crossref] [PubMed]

IEEE Trans. Multimedia (2)

J. Stauder, R. Melch, and J. Ostermann, “Detection of moving cast shadows for object segmentation,” IEEE Trans. Multimedia 1, 65–77 (1999).
[Crossref]

T. Gevers and H. Stokman, “Classifying color edges in video into shadow-geometry, highlight, or material transitions,” IEEE Trans. Multimedia 5, 237–243 (2003).
[Crossref]

IEEE Trans. on Syst. Man..Cybern. (1)

R. Irvin and D. Mckeown, “Methods for exploiting the relationship between buildings and their shadows in aerial imagery,” IEEE Trans. on Syst. Man..Cybern. 19, 1564–1575 (1989).
[Crossref]

IEEE Trans. Pattern Anal. Mach. Intell. (5)

A. Prati, I. Mikic, M. M. Trivedi, and R. Cucchiara, “Detecting Moving Shadows: Algorithms and Evaluation,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 918–923 (2003).
[Crossref]

I. Sato, Y. Sato, and K. Ikeuchi, “Illumination from shadows,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 290–300 (2003).
[Crossref]

S. Nadimi and B. Bhanu, “Physical models for moving shadow and object detection in video,” IEEE Trans. Pattern Anal. Mach. Intell. 26, 1079–1087 (2004).
[Crossref]

R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, “Detecting moving objects, Ghosts, and shadows in video streams,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 1337–1342 (2003).
[Crossref]

M. W. Powell, S. Sarkar, and D. Goldgof, “A simple strategy for calibrating the geometry of light sources,” IEEE Trans. Pattern Anal. Mach. Intell. 23, 1022–1027 (2001).
[Crossref]

Int. J. Comput. Vis. (1)

D. Koller, K. Danilidis, and H.-H. Nagel, “Model-based object tracking in monocular image sequences of road traffic scenes,” Int. J. Comput. Vis. 10, 257–281 (1993).
[Crossref]

J. Opt. Soc. Am. (1)

J. Opt. Soc. Am. A (4)

J. Theor. Biol. (1)

G. Horváth, “Reflection polarization patterns at flat water surfaces and their relevance for insect polarization vision,” J. Theor. Biol. 175, 27–37 (1995).
[Crossref] [PubMed]

Opt. Express (1)

Opt. Lett. (1)

Pattern. Recogn. Lett. (1)

C. Wang, L. Huang, and A. Rosenfeld, “Detecting clouds and cloud shadows on aerial photographs,” Pattern. Recogn. Lett. 12, 55–64 (1991).
[Crossref]

Proc SPIE (1)

M. J. Duggin, “Imaging polarimetry in scene element discrimination,” in Polarization: Measurement, Analysis, and Remote Sensing II, D. H. Goldstein and D. B. Chenault, eds., Proc SPIE 3754, 108–117 (1999).
[Crossref]

Proc. SPIE (3)

D. H. Goldstein, D. B. Chenault, and J. L. Pezzaniti, “Polarimetric characterization of Spectralon,” in Polarization: Measurement, Analysis, and Remote Sensing II, D. H. Goldstein and D. B. Chenault, eds., Proc. SPIE 3754, 126–136 (1999).
[Crossref]

K. M. Yemelyanov, S.-S. Lin, W. Q. Luis, E. N. Pugh, and N. Engheta, “Bio-inspired display of polarization information using selected visual cues,” in Polarization Science and Remote Sensing, J. A. Shaw and J. S. Tyo eds. Proc. SPIE,  5158, 71–84 (2003).
[Crossref]

W. G. Egan, “Dark-target retroreflection increase,” in Polarization: Measurement, Analysis, and Remote Sensing II, D. H. Goldstein and D. B. Chenault, eds., Proc. SPIE,  3754, 218–225 (1999).
[Crossref]

Scientific American (1)

R. Wehner, “Polarized-light navigation by insects,” Scientific American 235, 106–114 (1976).
[Crossref] [PubMed]

Other (8)

J. M. Wang, Y. C. Chung, C. L. Chang, and S. W. Chen, “Shadow Detection and Removal for Traffic Images,” in Proc. 2004 IEEE Int. Conf. on Networking, Sensing and Control (IEEE Syst. Man Cybern. Society, Taipei, Taiwan, 2004) pp. 649–654.
[Crossref]

S.-S. Lin, K. M. Yemelyanov, E. N. Pugh, and N. Engheta, “Polarization Enhanced Visual Surveillance Techniques,” in Proc. IEEE Int. Conf. on Networking, Sensing and Control (IEEE Syst. Man. .Cybern. Society, Taipei, Taiwan, 2004), 1, pp. 216–221.
[Crossref]

E. Hecht, Optics (Addison Wesley Longman, Inc., Reading, MA, USA1998).

G. Funka-Lea and R. Bajcsy, “Combining color and geometry for the active visual recognition of shadows,” in Proc. Int. Conf. on Computer Vision (1995) pp. 203–209.

J. M. Scanlan, D. M. Chabries, and R. W. Christiansen, “A Shadow Detection and Removal Algorithm for 2D Images,” in Proc. of Int. Conf. on Acoustics, Speech, and Signal Processing (1990) pp. 2057–2060.

G. Finlayson, S. Hordley, and M. S. Drew, “Removing shadows from images,” in ECCV (2002) pp. 823–836.

Y. Zhang and Y. Yang, “Illuminant direction determination for multiple light sources,” in Proc. CVPR (IEEE, 2000) pp. 269–276.

J. Pinel and H. Nicolas, “Estimation 2d illuminant direction and shadow segmentation in natural video sequences,” in Proc. VLBV (2001) pp. 197–202.

Cited By

OSA participates in Crossref's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (6)

Fig. 1.
Fig. 1.

(a) General macroscopic reflection model (b) Polarization of light resulting from specular reflection from a dielectric surface.

Download Full Size | PPT Slide | PDF

Fig. 2.
Fig. 2.

Left: “Intensity-only” image of an outdoor scene with light and shadow. Right: “Degree-of-polarization” image of the same scene; this image plots the quantity p = IA/IU [see Eq. (2)], extracted for each image pixel. Hidden patterns of shadows within shadows are clearly visible in high contrast. The glass-walled building is shown in Fig. 4. The yellow circle points out the same sewage drain cover that is visible in all related pictures up to Fig. 4 except Fig. 4 Left to help orientation.

Download Full Size | PPT Slide | PDF

Fig. 3.
Fig. 3.

Images in Fig. 2 are contrast-enhanced by linear intensity range stretch followed by gamma correction of 0.5 to show the details in the dark area. Left: intensity image. Right: degree of polarization image. It is clear that the pattern revealed in the polarization image is not present in the intensity image even after contrast enhancement. The yellow circle points out the same sewage drain cover that is visible in all related pictures up to Fig. 4 except Fig. 4 Left to help orientation.

Download Full Size | PPT Slide | PDF

Fig. 4.
Fig. 4.

(Pictures shown in this figure are all regular intensity images with no polarization information) Left: the glass-wall building showing big glass rectangles and frames. Right: A picture of the same walk way as in Fig. 2 and Fig. 3 taken another day when the direct sun light is blocked due to nearby construction scaffolding. The shadow pattern cast on the walk way by the glass-wall and frames is visible. The yellow circle in the Right picture points out the same sewer drain cover as seen in Fig. 2 and Fig. 3. The left and right pictures in this figure can be related by the same glass door bracketed by the overlaid green rectangle. Note that pictures in Fig. 4 are taken with the camera at about the same position and general view direction as when taking pictures in Fig. 2 and Fig. 3. The only difference is that in Fig. 4 the camera zooms out and points more upward in order to put the tall glass-walled building into view.

Download Full Size | PPT Slide | PDF

Fig. 5.
Fig. 5.

Controlled lab experiment of complex overlapping shadow: (a) Overview of the experiment setup. A metal pillar on a optical table illuminated by a strong incandescent light from the side opposite to the camera, while another much weaker fluorescent light illuminating from the right hand side of the picture. The polarization of the observed reflection from the side illuminating fluorescent light is weaker because they are all diffusely scattered reflection, as opposed to the mostly Fresnel reflection [34] coming from the incandescent light shining directly opposing the view of the camera. (b) Intensity-only image. (c) Degree-of-polarization image.

Download Full Size | PPT Slide | PDF

Fig. 6.
Fig. 6.

Left: Segmentation results from region-growing analysis (starting with the entire image divided into 2x2 regions and with adjacent similar regions merging in each iteration) of Fig. 5 (c) into 21 regions. Right: Hidden shadow area extracted from Fig. 5 (c). Note that this pattern is only a portion of a larger shadow of the metal pillar cast by the source at right, and that this larger shadow is partially obscured by both the small knob and the shadow of the small knob cast by the source opposing the camera.

Download Full Size | PPT Slide | PDF

Equations (4)

Equations on this page are rendered with MathJax. Learn more.

I ( φ ) = I U + I A cos [ 2 ( θ − φ ) ] = I U { 1 + p cos [ 2 ( θ − φ ) ] } ,
I U = ( I 0 + I 90 ) / 2
I A = ( I 45 − I U ) 2 + ( I 90 − I U ) 2
θ = arctan [ ( I 45 − I U ) / ( I 90 − I U ) ] / 2 .

Metrics