Abstract

A method for reconstructing high-spatial-resolution images in an imaging system known as thin observation module by bound optics (TOMBO) is reported. We investigate a novel procedure combining a pixel-rearrangement method and iterative backprojection (IBP). Pixel rearrangement has been used until now in TOMBO, and IBP is a digital superresolution technique. We verify the effectiveness of the combined procedure with simulated and experimental results.

© 2006 Optical Society of America

Full Article  |  PDF Article

References

  • View by:
  • |
  • |
  • |

  1. J. Tanida, T. Kumagai, K. Yamada, S. Miyatake, K. Ishida, T. Morimoto, N. Kondou, D. Miyazaki, and Y. Ichioka, "Thin observation module by bound optics (TOMBO): concept and experimental verification," Appl. Opt. 40, 1806-1813 (2001).
    [CrossRef]
  2. S. Ogata, J. Ishida, and T. Sasano, "Optical sensor array in an artificial compound eye," Opt. Eng. 33, 3649-3655 (1994).
    [CrossRef]
  3. J. S. Sanders and C. E. Halford, "Design and analysis of apposition compound eye optical sensors," Opt. Eng. 34, 222-235 (1995).
    [CrossRef]
  4. K. Hamanaka and H. Koshi, "An artificial compound eye using a microlens array and its application to scale-invariant processing," Opt. Rev. 3,264-268 (1996).
    [CrossRef]
  5. Y. Kitamura, R. Shogenji, K. Yamada, S. Miyatake, M. Miyamoto, T. Morimoto, Y. Masaki, N. Kondou, D. Miyazaki, J. Tanida, and Y. Ichioka, "Reconstruction of a high-resolution image on a compound-eye image-capturing system," Appl. Opt. 43, 1719-1727 (2004).
    [CrossRef] [PubMed]
  6. M. Irani and S. Peleg, "Improving resolution by image registration," CVGIP Graph. Models Image Process. 53, 231-239 (1991).
    [CrossRef]
  7. J. Tanida, R. Shogenji, Y. Kitamura, K. Yamada, M. Miyamoto, and S. Miyatake, "Color imaging with an integrated compound imaging system," Opt. Express 11, 18-26 (2003).
    [CrossRef]
  8. R. Shogenji, Y. Kitamura, K. Yamada, S. Miyatake, and J. Tanida, "Multispectral imaging using compact compound optics," Opt. Express 12, 1643-1655 (2004).
    [CrossRef] [PubMed]
  9. R. Shogenji, Y. Kitamura, K. Yamada, S. Miyatake, and J. Tanida, "Bimodal fingerprint capturing system based on compound-eye imaging module," Appl. Opt. 43, 1355-1359 (2004).
    [CrossRef] [PubMed]
  10. M. Irani and S. Peleg, "Motion analysis for image enhancement: resolution, occlusion, and transparency," J. Visual Commun. Image Represent. 4, 324-335 (1993).
    [CrossRef]
  11. J. Tanida, R. Shogenji, Y. Kitamura, K. Yamada, M. Miyamoto, and S. Miyatake "Functional extension of thin observation module by bound optics (TOMBO)," in Optics in Computing, vol. 90 of OSA Trends in Optics and Photonics Series (Optical Society of America, 2003), pp. 170-172 (2003).

2004 (3)

2003 (1)

J. Tanida, R. Shogenji, Y. Kitamura, K. Yamada, M. Miyamoto, and S. Miyatake, "Color imaging with an integrated compound imaging system," Opt. Express 11, 18-26 (2003).
[CrossRef]

2001 (1)

1996 (1)

K. Hamanaka and H. Koshi, "An artificial compound eye using a microlens array and its application to scale-invariant processing," Opt. Rev. 3,264-268 (1996).
[CrossRef]

1995 (1)

J. S. Sanders and C. E. Halford, "Design and analysis of apposition compound eye optical sensors," Opt. Eng. 34, 222-235 (1995).
[CrossRef]

1994 (1)

S. Ogata, J. Ishida, and T. Sasano, "Optical sensor array in an artificial compound eye," Opt. Eng. 33, 3649-3655 (1994).
[CrossRef]

1993 (1)

M. Irani and S. Peleg, "Motion analysis for image enhancement: resolution, occlusion, and transparency," J. Visual Commun. Image Represent. 4, 324-335 (1993).
[CrossRef]

1991 (1)

M. Irani and S. Peleg, "Improving resolution by image registration," CVGIP Graph. Models Image Process. 53, 231-239 (1991).
[CrossRef]

Halford, C. E.

J. S. Sanders and C. E. Halford, "Design and analysis of apposition compound eye optical sensors," Opt. Eng. 34, 222-235 (1995).
[CrossRef]

Hamanaka, K.

K. Hamanaka and H. Koshi, "An artificial compound eye using a microlens array and its application to scale-invariant processing," Opt. Rev. 3,264-268 (1996).
[CrossRef]

Ichioka, Y.

Irani, M.

M. Irani and S. Peleg, "Motion analysis for image enhancement: resolution, occlusion, and transparency," J. Visual Commun. Image Represent. 4, 324-335 (1993).
[CrossRef]

M. Irani and S. Peleg, "Improving resolution by image registration," CVGIP Graph. Models Image Process. 53, 231-239 (1991).
[CrossRef]

Ishida, J.

S. Ogata, J. Ishida, and T. Sasano, "Optical sensor array in an artificial compound eye," Opt. Eng. 33, 3649-3655 (1994).
[CrossRef]

Ishida, K.

Kitamura, Y.

R. Shogenji, Y. Kitamura, K. Yamada, S. Miyatake, and J. Tanida, "Bimodal fingerprint capturing system based on compound-eye imaging module," Appl. Opt. 43, 1355-1359 (2004).
[CrossRef] [PubMed]

R. Shogenji, Y. Kitamura, K. Yamada, S. Miyatake, and J. Tanida, "Multispectral imaging using compact compound optics," Opt. Express 12, 1643-1655 (2004).
[CrossRef] [PubMed]

Y. Kitamura, R. Shogenji, K. Yamada, S. Miyatake, M. Miyamoto, T. Morimoto, Y. Masaki, N. Kondou, D. Miyazaki, J. Tanida, and Y. Ichioka, "Reconstruction of a high-resolution image on a compound-eye image-capturing system," Appl. Opt. 43, 1719-1727 (2004).
[CrossRef] [PubMed]

J. Tanida, R. Shogenji, Y. Kitamura, K. Yamada, M. Miyamoto, and S. Miyatake, "Color imaging with an integrated compound imaging system," Opt. Express 11, 18-26 (2003).
[CrossRef]

J. Tanida, R. Shogenji, Y. Kitamura, K. Yamada, M. Miyamoto, and S. Miyatake "Functional extension of thin observation module by bound optics (TOMBO)," in Optics in Computing, vol. 90 of OSA Trends in Optics and Photonics Series (Optical Society of America, 2003), pp. 170-172 (2003).

Kondou, N.

Koshi, H.

K. Hamanaka and H. Koshi, "An artificial compound eye using a microlens array and its application to scale-invariant processing," Opt. Rev. 3,264-268 (1996).
[CrossRef]

Kumagai, T.

Masaki, Y.

Miyamoto, M.

Y. Kitamura, R. Shogenji, K. Yamada, S. Miyatake, M. Miyamoto, T. Morimoto, Y. Masaki, N. Kondou, D. Miyazaki, J. Tanida, and Y. Ichioka, "Reconstruction of a high-resolution image on a compound-eye image-capturing system," Appl. Opt. 43, 1719-1727 (2004).
[CrossRef] [PubMed]

J. Tanida, R. Shogenji, Y. Kitamura, K. Yamada, M. Miyamoto, and S. Miyatake, "Color imaging with an integrated compound imaging system," Opt. Express 11, 18-26 (2003).
[CrossRef]

J. Tanida, R. Shogenji, Y. Kitamura, K. Yamada, M. Miyamoto, and S. Miyatake "Functional extension of thin observation module by bound optics (TOMBO)," in Optics in Computing, vol. 90 of OSA Trends in Optics and Photonics Series (Optical Society of America, 2003), pp. 170-172 (2003).

Miyatake, S.

Miyazaki, D.

Morimoto, T.

Ogata, S.

S. Ogata, J. Ishida, and T. Sasano, "Optical sensor array in an artificial compound eye," Opt. Eng. 33, 3649-3655 (1994).
[CrossRef]

Peleg, S.

M. Irani and S. Peleg, "Motion analysis for image enhancement: resolution, occlusion, and transparency," J. Visual Commun. Image Represent. 4, 324-335 (1993).
[CrossRef]

M. Irani and S. Peleg, "Improving resolution by image registration," CVGIP Graph. Models Image Process. 53, 231-239 (1991).
[CrossRef]

Sanders, J. S.

J. S. Sanders and C. E. Halford, "Design and analysis of apposition compound eye optical sensors," Opt. Eng. 34, 222-235 (1995).
[CrossRef]

Sasano, T.

S. Ogata, J. Ishida, and T. Sasano, "Optical sensor array in an artificial compound eye," Opt. Eng. 33, 3649-3655 (1994).
[CrossRef]

Shogenji, R.

R. Shogenji, Y. Kitamura, K. Yamada, S. Miyatake, and J. Tanida, "Bimodal fingerprint capturing system based on compound-eye imaging module," Appl. Opt. 43, 1355-1359 (2004).
[CrossRef] [PubMed]

Y. Kitamura, R. Shogenji, K. Yamada, S. Miyatake, M. Miyamoto, T. Morimoto, Y. Masaki, N. Kondou, D. Miyazaki, J. Tanida, and Y. Ichioka, "Reconstruction of a high-resolution image on a compound-eye image-capturing system," Appl. Opt. 43, 1719-1727 (2004).
[CrossRef] [PubMed]

R. Shogenji, Y. Kitamura, K. Yamada, S. Miyatake, and J. Tanida, "Multispectral imaging using compact compound optics," Opt. Express 12, 1643-1655 (2004).
[CrossRef] [PubMed]

J. Tanida, R. Shogenji, Y. Kitamura, K. Yamada, M. Miyamoto, and S. Miyatake, "Color imaging with an integrated compound imaging system," Opt. Express 11, 18-26 (2003).
[CrossRef]

J. Tanida, R. Shogenji, Y. Kitamura, K. Yamada, M. Miyamoto, and S. Miyatake "Functional extension of thin observation module by bound optics (TOMBO)," in Optics in Computing, vol. 90 of OSA Trends in Optics and Photonics Series (Optical Society of America, 2003), pp. 170-172 (2003).

Tanida, J.

Yamada, K.

Appl. Opt. (3)

CVGIP Graph. Models Image Process. (1)

M. Irani and S. Peleg, "Improving resolution by image registration," CVGIP Graph. Models Image Process. 53, 231-239 (1991).
[CrossRef]

J. Visual Commun. Image Represent. (1)

M. Irani and S. Peleg, "Motion analysis for image enhancement: resolution, occlusion, and transparency," J. Visual Commun. Image Represent. 4, 324-335 (1993).
[CrossRef]

Opt. Eng. (2)

S. Ogata, J. Ishida, and T. Sasano, "Optical sensor array in an artificial compound eye," Opt. Eng. 33, 3649-3655 (1994).
[CrossRef]

J. S. Sanders and C. E. Halford, "Design and analysis of apposition compound eye optical sensors," Opt. Eng. 34, 222-235 (1995).
[CrossRef]

Opt. Express (2)

J. Tanida, R. Shogenji, Y. Kitamura, K. Yamada, M. Miyamoto, and S. Miyatake, "Color imaging with an integrated compound imaging system," Opt. Express 11, 18-26 (2003).
[CrossRef]

R. Shogenji, Y. Kitamura, K. Yamada, S. Miyatake, and J. Tanida, "Multispectral imaging using compact compound optics," Opt. Express 12, 1643-1655 (2004).
[CrossRef] [PubMed]

Opt. Rev. (1)

K. Hamanaka and H. Koshi, "An artificial compound eye using a microlens array and its application to scale-invariant processing," Opt. Rev. 3,264-268 (1996).
[CrossRef]

Other (1)

J. Tanida, R. Shogenji, Y. Kitamura, K. Yamada, M. Miyamoto, and S. Miyatake "Functional extension of thin observation module by bound optics (TOMBO)," in Optics in Computing, vol. 90 of OSA Trends in Optics and Photonics Series (Optical Society of America, 2003), pp. 170-172 (2003).

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (11)

Fig. 1
Fig. 1

Schematic diagram of optical module in the TOMBO system.

Fig. 2
Fig. 2

Schematic diagram of the pixel-rearrangement method.

Fig. 3
Fig. 3

One-dimensional model [g(x)] for (a) single-eye imaging and (b) the pixel-rearrangement method in TOMBO.

Fig. 4
Fig. 4

G x ) of both analysis models: (a) single-eye imaging and (b) the pixel-rearrangement method in TOMBO.

Fig. 5
Fig. 5

Schematic diagram of the IBP method.

Fig. 6
Fig. 6

Flow chart of the IBP method for the TOMBO system.

Fig. 7
Fig. 7

(Color online) Simulation results: (a) the original image, (b) the compound image, (c) the result obtained by the pixel-rearrangement method, (d) the result of the IBP method after 2500 iterations.

Fig. 8
Fig. 8

Simulation results with a resolution chart: (a) the original image, (b) the compound image, (c) the result obtained by the pixel-rearrangement method, (d) the result of the IBP method after 2500 iterations.

Fig. 9
Fig. 9

(Color online) Picture of the prototype module.

Fig. 10
Fig. 10

(Color online) Experimental results: (a) the reconstructed image with the pixel-rearrangement method and (b) that with the IBP method. (c), (d) Show specific parts of (a) and (b), respectively.

Fig. 11
Fig. 11

Relation between SNR and the number of iterations n.

Equations (8)

Equations on this page are rendered with MathJax. Learn more.

ν = N / μ .
g ( x ) = f ( x ) comb ( x / p ) rect ( x / a ) ,
G ( ν x ) = | a p | F ( ν x ) comb ( p ν x ) sinc ( a ν x ) ,
ν N = 1 / 2 p .
g u x , u y ( n ) = [ T u x , u y ( f ( n ) ) h ] s ,
e ( n ) = [ ( 1 / N 2 ) u y = 1 N u x = 1 N ( g u x , u y g u x , u y ( n ) ) 2 ] 1 / 2 .
f ( n + 1 ) = f ( n ) + ( 1 / N 2 ) u y = 1 N u x = 1 N T u x , u y - 1 × { [ ( g ( u x , u y ) g u x , u y ( n ) ) s ] p } ,
δ h p 2 1.

Metrics