Abstract

Most Mueller matrix imaging polarimeters implement sequential acquisition of at least 16 raw images of the same object with different incident and detected light polarizations. When this technique is implemented in vivo, the unavoidable motions of the subject may shift and distort the raw images to an extent such that the final Mueller images cannot be extracted. We describe a registration algorithm which solves this problem for the typical conditions of in vivo imaging, e.g. with spatially inhomogeneous medium to strong depolarization. The algorithm, based on the so called “optical flow”, is validated experimentally by comparing the Mueller images of a pig skin sample taken in static and in dynamic conditions.

© 2007 Optical Society of America

Full Article  |  PDF Article

References

  • View by:
  • Article Order
  • |
  • Year
  • |
  • Author
  • |
  • Publication
  1. S. G. Demos and R. R. Alfano, “Optical Polarization Imaging,” Appl. Opt. 36, 150–155 (1997).
    [Crossref] [PubMed]
  2. M. H. Smith, P. Burke, A. Lompado, E. Tanner, and L. W. Hillman, “Mueller matrix imaging polarimetry in dermatology,” Proc. SPIE,  3911, 210–216 (2000).
    [Crossref]
  3. S. L. Jacques, R. J. Roman, and K. Lee, “Imaging skin pathology with polarized light,” J. Biomed. Opt. 7, 329–340 (2002).
    [Crossref] [PubMed]
  4. R. R. Anderson, “Polarized-light examination and photography of the skin,” Arch. Dermatol. 127, 1000–1005 (1991).
    [Crossref] [PubMed]
  5. F. Boulvert, B. Boulbry, G. Le Brun, B. Le Jeune, S. Rivet, and J. Cariou, “Analysis of the depolarizing properties of irradiated pig skin,” J. Opt. A: Pure Appl. Opt. 7, 21–28 (2005).
    [Crossref]
  6. B. Laude-Boulesteix, A. De Martino, B. Drévillon, and L. Schwartz, “Mueller polarimetric imaging system with liquid crystals,” Appl. Opt.,  43, 2824 (2004).
    [Crossref] [PubMed]
  7. S. Manhas, M. K. Swami, P. Buddhiwant, N. Ghosh, P. K. Gupta, and J. Singh, “Mueller matrix approach for determination of optical rotation in chiral turbid media in backscattering geometry,” Opt. Express 14, 190–202 (2006).
    [Crossref] [PubMed]
  8. A. Hielscher, A. Eick, J. Mourant, D. Shen, J. Freyer, and I. Bigio, “Diffuse backscattering Mueller matrices of highly scattering media,” Opt. Express 1, 441 (1997).
    [Crossref] [PubMed]
  9. S. L. Jacques, J. C. Ramella-Roman, and Ken Lee, “Imaging skin pathology with polarized light”, J. Biomed. Opt. 7, 329–340 (2002).
    [Crossref] [PubMed]
  10. K. Oka and T. Kaneko, “Compact complete imaging polarimeter using birefringent wedge prisms” Opt. Express 11, 1510–1518 (2003).
    [Crossref] [PubMed]
  11. N. Ritter, R. Owens, J. Cooper, R. H. Eikelboom, and P. P. v. Saarloos, “Registration of stereo and temporal images of the retina,” IEEE Trans. Med. Image 18, 404–418 (1999).
    [Crossref]
  12. J. A. Bangham, R. Harvey, and P. D. Ling, “Morphological scale-space preserving transforms in many dimensions,” J. Electron. Imaging 5, 283–299 (1996).
    [Crossref]
  13. M. Kim, J. C. Jeon, J. S. Kwak, M. H. Lee, and C. Ahn, “Moving object segmentation in video sequences by user interaction and automatic object tracking,” Image Vis. Comput. 19, 245–260 (2001).
    [Crossref]
  14. J. M. Odobez and P. Bouthemy, “Robust multi-resolution estimation of parametric motion models applied to complex scenes,” IRISA, Technical Report,  788 (1994).
  15. Z. Zhang and R. S. Blum, “A hybrid image registration technique for a digital camera image fusion application,” Information Fusion 2, 135–149 (2001).
    [Crossref]
  16. B. K. P. Horn and B. G. Schunk, “Determining optical flow,” Artif. Intell. 17, 185–203 (1981).
    [Crossref]
  17. J. A. Perrone, “Simple technique for optical flow estimation,” J. Opt. Soc. Am. A 7, 264–278 (1990).
    [Crossref]
  18. C. Brosseau, Fundamental of polarized light: a statistical optics approach (Wiley, NY, 1998).
  19. P. J. Burt and E. H. Adelson, “The Laplacian Pyramid as a Compact Image Code,” IEEE Trans. Commun.,  COM-31, 532–540 (1983).
    [Crossref]
  20. G. Yao and L. V. Wang, “Two-dimensional depth-resolved Mueller matrix characterization of biological tissue by optical coherence tomography,” Opt. Lett. 24, 537–539 (1999).
    [Crossref]
  21. M. Yamanari, S. Makita, V. D. Madjarova, T. Yatagai, and Y. Yasuno, “fiber-based polarization sensitive optical coherence tomography using B-scan-oriented polarization modulation method,” Opt. Express 14, 6502–6515 (2006)
    [Crossref] [PubMed]

2006 (2)

2005 (1)

F. Boulvert, B. Boulbry, G. Le Brun, B. Le Jeune, S. Rivet, and J. Cariou, “Analysis of the depolarizing properties of irradiated pig skin,” J. Opt. A: Pure Appl. Opt. 7, 21–28 (2005).
[Crossref]

2004 (1)

2003 (1)

2002 (2)

S. L. Jacques, R. J. Roman, and K. Lee, “Imaging skin pathology with polarized light,” J. Biomed. Opt. 7, 329–340 (2002).
[Crossref] [PubMed]

S. L. Jacques, J. C. Ramella-Roman, and Ken Lee, “Imaging skin pathology with polarized light”, J. Biomed. Opt. 7, 329–340 (2002).
[Crossref] [PubMed]

2001 (2)

M. Kim, J. C. Jeon, J. S. Kwak, M. H. Lee, and C. Ahn, “Moving object segmentation in video sequences by user interaction and automatic object tracking,” Image Vis. Comput. 19, 245–260 (2001).
[Crossref]

Z. Zhang and R. S. Blum, “A hybrid image registration technique for a digital camera image fusion application,” Information Fusion 2, 135–149 (2001).
[Crossref]

2000 (1)

M. H. Smith, P. Burke, A. Lompado, E. Tanner, and L. W. Hillman, “Mueller matrix imaging polarimetry in dermatology,” Proc. SPIE,  3911, 210–216 (2000).
[Crossref]

1999 (2)

N. Ritter, R. Owens, J. Cooper, R. H. Eikelboom, and P. P. v. Saarloos, “Registration of stereo and temporal images of the retina,” IEEE Trans. Med. Image 18, 404–418 (1999).
[Crossref]

G. Yao and L. V. Wang, “Two-dimensional depth-resolved Mueller matrix characterization of biological tissue by optical coherence tomography,” Opt. Lett. 24, 537–539 (1999).
[Crossref]

1997 (2)

1996 (1)

J. A. Bangham, R. Harvey, and P. D. Ling, “Morphological scale-space preserving transforms in many dimensions,” J. Electron. Imaging 5, 283–299 (1996).
[Crossref]

1994 (1)

J. M. Odobez and P. Bouthemy, “Robust multi-resolution estimation of parametric motion models applied to complex scenes,” IRISA, Technical Report,  788 (1994).

1991 (1)

R. R. Anderson, “Polarized-light examination and photography of the skin,” Arch. Dermatol. 127, 1000–1005 (1991).
[Crossref] [PubMed]

1990 (1)

1983 (1)

P. J. Burt and E. H. Adelson, “The Laplacian Pyramid as a Compact Image Code,” IEEE Trans. Commun.,  COM-31, 532–540 (1983).
[Crossref]

1981 (1)

B. K. P. Horn and B. G. Schunk, “Determining optical flow,” Artif. Intell. 17, 185–203 (1981).
[Crossref]

Adelson, E. H.

P. J. Burt and E. H. Adelson, “The Laplacian Pyramid as a Compact Image Code,” IEEE Trans. Commun.,  COM-31, 532–540 (1983).
[Crossref]

Ahn, C.

M. Kim, J. C. Jeon, J. S. Kwak, M. H. Lee, and C. Ahn, “Moving object segmentation in video sequences by user interaction and automatic object tracking,” Image Vis. Comput. 19, 245–260 (2001).
[Crossref]

Alfano, R. R.

Anderson, R. R.

R. R. Anderson, “Polarized-light examination and photography of the skin,” Arch. Dermatol. 127, 1000–1005 (1991).
[Crossref] [PubMed]

Bangham, J. A.

J. A. Bangham, R. Harvey, and P. D. Ling, “Morphological scale-space preserving transforms in many dimensions,” J. Electron. Imaging 5, 283–299 (1996).
[Crossref]

Bigio, I.

Blum, R. S.

Z. Zhang and R. S. Blum, “A hybrid image registration technique for a digital camera image fusion application,” Information Fusion 2, 135–149 (2001).
[Crossref]

Boulbry, B.

F. Boulvert, B. Boulbry, G. Le Brun, B. Le Jeune, S. Rivet, and J. Cariou, “Analysis of the depolarizing properties of irradiated pig skin,” J. Opt. A: Pure Appl. Opt. 7, 21–28 (2005).
[Crossref]

Boulvert, F.

F. Boulvert, B. Boulbry, G. Le Brun, B. Le Jeune, S. Rivet, and J. Cariou, “Analysis of the depolarizing properties of irradiated pig skin,” J. Opt. A: Pure Appl. Opt. 7, 21–28 (2005).
[Crossref]

Bouthemy, P.

J. M. Odobez and P. Bouthemy, “Robust multi-resolution estimation of parametric motion models applied to complex scenes,” IRISA, Technical Report,  788 (1994).

Brosseau, C.

C. Brosseau, Fundamental of polarized light: a statistical optics approach (Wiley, NY, 1998).

Buddhiwant, P.

Burke, P.

M. H. Smith, P. Burke, A. Lompado, E. Tanner, and L. W. Hillman, “Mueller matrix imaging polarimetry in dermatology,” Proc. SPIE,  3911, 210–216 (2000).
[Crossref]

Burt, P. J.

P. J. Burt and E. H. Adelson, “The Laplacian Pyramid as a Compact Image Code,” IEEE Trans. Commun.,  COM-31, 532–540 (1983).
[Crossref]

Cariou, J.

F. Boulvert, B. Boulbry, G. Le Brun, B. Le Jeune, S. Rivet, and J. Cariou, “Analysis of the depolarizing properties of irradiated pig skin,” J. Opt. A: Pure Appl. Opt. 7, 21–28 (2005).
[Crossref]

Cooper, J.

N. Ritter, R. Owens, J. Cooper, R. H. Eikelboom, and P. P. v. Saarloos, “Registration of stereo and temporal images of the retina,” IEEE Trans. Med. Image 18, 404–418 (1999).
[Crossref]

De Martino, A.

Demos, S. G.

Drévillon, B.

Eick, A.

Eikelboom, R. H.

N. Ritter, R. Owens, J. Cooper, R. H. Eikelboom, and P. P. v. Saarloos, “Registration of stereo and temporal images of the retina,” IEEE Trans. Med. Image 18, 404–418 (1999).
[Crossref]

Freyer, J.

Ghosh, N.

Gupta, P. K.

Harvey, R.

J. A. Bangham, R. Harvey, and P. D. Ling, “Morphological scale-space preserving transforms in many dimensions,” J. Electron. Imaging 5, 283–299 (1996).
[Crossref]

Hielscher, A.

Hillman, L. W.

M. H. Smith, P. Burke, A. Lompado, E. Tanner, and L. W. Hillman, “Mueller matrix imaging polarimetry in dermatology,” Proc. SPIE,  3911, 210–216 (2000).
[Crossref]

Horn, B. K. P.

B. K. P. Horn and B. G. Schunk, “Determining optical flow,” Artif. Intell. 17, 185–203 (1981).
[Crossref]

Jacques, S. L.

S. L. Jacques, J. C. Ramella-Roman, and Ken Lee, “Imaging skin pathology with polarized light”, J. Biomed. Opt. 7, 329–340 (2002).
[Crossref] [PubMed]

S. L. Jacques, R. J. Roman, and K. Lee, “Imaging skin pathology with polarized light,” J. Biomed. Opt. 7, 329–340 (2002).
[Crossref] [PubMed]

Jeon, J. C.

M. Kim, J. C. Jeon, J. S. Kwak, M. H. Lee, and C. Ahn, “Moving object segmentation in video sequences by user interaction and automatic object tracking,” Image Vis. Comput. 19, 245–260 (2001).
[Crossref]

Kaneko, T.

Kim, M.

M. Kim, J. C. Jeon, J. S. Kwak, M. H. Lee, and C. Ahn, “Moving object segmentation in video sequences by user interaction and automatic object tracking,” Image Vis. Comput. 19, 245–260 (2001).
[Crossref]

Kwak, J. S.

M. Kim, J. C. Jeon, J. S. Kwak, M. H. Lee, and C. Ahn, “Moving object segmentation in video sequences by user interaction and automatic object tracking,” Image Vis. Comput. 19, 245–260 (2001).
[Crossref]

Laude-Boulesteix, B.

Le Brun, G.

F. Boulvert, B. Boulbry, G. Le Brun, B. Le Jeune, S. Rivet, and J. Cariou, “Analysis of the depolarizing properties of irradiated pig skin,” J. Opt. A: Pure Appl. Opt. 7, 21–28 (2005).
[Crossref]

Le Jeune, B.

F. Boulvert, B. Boulbry, G. Le Brun, B. Le Jeune, S. Rivet, and J. Cariou, “Analysis of the depolarizing properties of irradiated pig skin,” J. Opt. A: Pure Appl. Opt. 7, 21–28 (2005).
[Crossref]

Lee, K.

S. L. Jacques, R. J. Roman, and K. Lee, “Imaging skin pathology with polarized light,” J. Biomed. Opt. 7, 329–340 (2002).
[Crossref] [PubMed]

Lee, Ken

S. L. Jacques, J. C. Ramella-Roman, and Ken Lee, “Imaging skin pathology with polarized light”, J. Biomed. Opt. 7, 329–340 (2002).
[Crossref] [PubMed]

Lee, M. H.

M. Kim, J. C. Jeon, J. S. Kwak, M. H. Lee, and C. Ahn, “Moving object segmentation in video sequences by user interaction and automatic object tracking,” Image Vis. Comput. 19, 245–260 (2001).
[Crossref]

Ling, P. D.

J. A. Bangham, R. Harvey, and P. D. Ling, “Morphological scale-space preserving transforms in many dimensions,” J. Electron. Imaging 5, 283–299 (1996).
[Crossref]

Lompado, A.

M. H. Smith, P. Burke, A. Lompado, E. Tanner, and L. W. Hillman, “Mueller matrix imaging polarimetry in dermatology,” Proc. SPIE,  3911, 210–216 (2000).
[Crossref]

Madjarova, V. D.

Makita, S.

Manhas, S.

Mourant, J.

Odobez, J. M.

J. M. Odobez and P. Bouthemy, “Robust multi-resolution estimation of parametric motion models applied to complex scenes,” IRISA, Technical Report,  788 (1994).

Oka, K.

Owens, R.

N. Ritter, R. Owens, J. Cooper, R. H. Eikelboom, and P. P. v. Saarloos, “Registration of stereo and temporal images of the retina,” IEEE Trans. Med. Image 18, 404–418 (1999).
[Crossref]

Perrone, J. A.

Ramella-Roman, J. C.

S. L. Jacques, J. C. Ramella-Roman, and Ken Lee, “Imaging skin pathology with polarized light”, J. Biomed. Opt. 7, 329–340 (2002).
[Crossref] [PubMed]

Ritter, N.

N. Ritter, R. Owens, J. Cooper, R. H. Eikelboom, and P. P. v. Saarloos, “Registration of stereo and temporal images of the retina,” IEEE Trans. Med. Image 18, 404–418 (1999).
[Crossref]

Rivet, S.

F. Boulvert, B. Boulbry, G. Le Brun, B. Le Jeune, S. Rivet, and J. Cariou, “Analysis of the depolarizing properties of irradiated pig skin,” J. Opt. A: Pure Appl. Opt. 7, 21–28 (2005).
[Crossref]

Roman, R. J.

S. L. Jacques, R. J. Roman, and K. Lee, “Imaging skin pathology with polarized light,” J. Biomed. Opt. 7, 329–340 (2002).
[Crossref] [PubMed]

Saarloos, P. P. v.

N. Ritter, R. Owens, J. Cooper, R. H. Eikelboom, and P. P. v. Saarloos, “Registration of stereo and temporal images of the retina,” IEEE Trans. Med. Image 18, 404–418 (1999).
[Crossref]

Schunk, B. G.

B. K. P. Horn and B. G. Schunk, “Determining optical flow,” Artif. Intell. 17, 185–203 (1981).
[Crossref]

Schwartz, L.

Shen, D.

Singh, J.

Smith, M. H.

M. H. Smith, P. Burke, A. Lompado, E. Tanner, and L. W. Hillman, “Mueller matrix imaging polarimetry in dermatology,” Proc. SPIE,  3911, 210–216 (2000).
[Crossref]

Swami, M. K.

Tanner, E.

M. H. Smith, P. Burke, A. Lompado, E. Tanner, and L. W. Hillman, “Mueller matrix imaging polarimetry in dermatology,” Proc. SPIE,  3911, 210–216 (2000).
[Crossref]

Wang, L. V.

Yamanari, M.

Yao, G.

Yasuno, Y.

Yatagai, T.

Zhang, Z.

Z. Zhang and R. S. Blum, “A hybrid image registration technique for a digital camera image fusion application,” Information Fusion 2, 135–149 (2001).
[Crossref]

Appl. Opt. (2)

Arch. Dermatol. (1)

R. R. Anderson, “Polarized-light examination and photography of the skin,” Arch. Dermatol. 127, 1000–1005 (1991).
[Crossref] [PubMed]

Artif. Intell. (1)

B. K. P. Horn and B. G. Schunk, “Determining optical flow,” Artif. Intell. 17, 185–203 (1981).
[Crossref]

IEEE Trans. Commun. (1)

P. J. Burt and E. H. Adelson, “The Laplacian Pyramid as a Compact Image Code,” IEEE Trans. Commun.,  COM-31, 532–540 (1983).
[Crossref]

IEEE Trans. Med. Image (1)

N. Ritter, R. Owens, J. Cooper, R. H. Eikelboom, and P. P. v. Saarloos, “Registration of stereo and temporal images of the retina,” IEEE Trans. Med. Image 18, 404–418 (1999).
[Crossref]

Image Vis. Comput. (1)

M. Kim, J. C. Jeon, J. S. Kwak, M. H. Lee, and C. Ahn, “Moving object segmentation in video sequences by user interaction and automatic object tracking,” Image Vis. Comput. 19, 245–260 (2001).
[Crossref]

Information Fusion (1)

Z. Zhang and R. S. Blum, “A hybrid image registration technique for a digital camera image fusion application,” Information Fusion 2, 135–149 (2001).
[Crossref]

IRISA, Technical Report (1)

J. M. Odobez and P. Bouthemy, “Robust multi-resolution estimation of parametric motion models applied to complex scenes,” IRISA, Technical Report,  788 (1994).

J. Biomed. Opt. (2)

S. L. Jacques, R. J. Roman, and K. Lee, “Imaging skin pathology with polarized light,” J. Biomed. Opt. 7, 329–340 (2002).
[Crossref] [PubMed]

S. L. Jacques, J. C. Ramella-Roman, and Ken Lee, “Imaging skin pathology with polarized light”, J. Biomed. Opt. 7, 329–340 (2002).
[Crossref] [PubMed]

J. Electron. Imaging (1)

J. A. Bangham, R. Harvey, and P. D. Ling, “Morphological scale-space preserving transforms in many dimensions,” J. Electron. Imaging 5, 283–299 (1996).
[Crossref]

J. Opt. A: Pure Appl. Opt. (1)

F. Boulvert, B. Boulbry, G. Le Brun, B. Le Jeune, S. Rivet, and J. Cariou, “Analysis of the depolarizing properties of irradiated pig skin,” J. Opt. A: Pure Appl. Opt. 7, 21–28 (2005).
[Crossref]

J. Opt. Soc. Am. A (1)

Opt. Express (4)

Opt. Lett. (1)

Proc. SPIE (1)

M. H. Smith, P. Burke, A. Lompado, E. Tanner, and L. W. Hillman, “Mueller matrix imaging polarimetry in dermatology,” Proc. SPIE,  3911, 210–216 (2000).
[Crossref]

Other (1)

C. Brosseau, Fundamental of polarized light: a statistical optics approach (Wiley, NY, 1998).

Cited By

OSA participates in Crossref's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (7)

Fig. 1.
Fig. 1.

Two typical raw images of the tattooed pig skin sample, taken with different polarizations.

Download Full Size | PPT Slide | PDF

Fig. 2.
Fig. 2.

Intensity histograms of the raw images shown in Fig.1. The intensities (horizontal axis) are normalized by the CCD saturation level.

Download Full Size | PPT Slide | PDF

Fig. 3.
Fig. 3.

Normalized Mueller matrix of the tattooed pig skin, taken in static conditions. All matrix elements are normalized by M 00, which is not shown. Diagonal and off-diagonal elements are displayed with different color scales, to enhance the visualization of the smaller off diagonal terms.

Download Full Size | PPT Slide | PDF

Fig. 4.
Fig. 4.

Mueller matrix of the sample with motion, without registration of the raw images.

Download Full Size | PPT Slide | PDF

Fig. 5.
Fig. 5.

Left: field of displacement between the two images shown in Fig. 1. Right: magnified visualization of the non uniformity of the transformation.

Download Full Size | PPT Slide | PDF

Fig. 6.
Fig. 6.

Result of the registration on the Mueller matrix of the Fig. 3.

Download Full Size | PPT Slide | PDF

Fig. 7.
Fig. 7.

Static, dynamic and readjusted M 22 terms of the previous matrices, with the same color scale as above.

Download Full Size | PPT Slide | PDF

Equations (6)

Equations on this page are rendered with MathJax. Learn more.

B = AMW .
p ( x , y , t ) = a + bx + cy , q ( x , y , t ) = d + ex + fy ,
I ( x + p , y + q , t + 1 ) − I ( x , y , t ) = pI x + qI y + I t ,
D 2 ( p , q ) = ∑ x , y ( pI x + qI y + I t ) 2 ,
[ ∑ I x 2 ∑ xI x 2 ∑ yI x 2 ∑ I x I y ∑ x I x I y ∑ y I x I y ∑ x I x 2 ∑ x 2 I x 2 ∑ xy I x 2 ∑ x I x I y ∑ x 2 I x I y ∑ x y I x I y ∑ y I x 2 ∑ xy I x 2 ∑ y 2 I x 2 ∑ y I x I y ∑ x y I x I y ∑ y 2 I x I y ∑ I x I y ∑ x I x I y ∑ y I x I y ∑ I y 2 ∑ x I y 2 ∑ y I y 2 ∑ x I x I y ∑ x 2 I x I y ∑ xy I x I y ∑ x I y 2 ∑ x 2 I y 2 ∑ xy I y 2 ∑ y I x I y ∑ xy I x I y ∑ y 2 I x I y ∑ y I y 2 ∑ xy I y 2 ∑ y 2 I y 2 ] [ a b c d e f ] = − [ ∑ I x I t ∑ x I x I t ∑ y I x I t ∑ I y I t ∑ x I y I t ∑ y I y I t ]
r = ∑ m ∑ n ( A mn − A ¯ ) ( B mn − B ¯ ) ∑ m ∑ n ( A mn − A ¯ ) 2 ∑ m ∑ n ( B mn − B ¯ ) 2 .

Metrics