Abstract

This paper proposes an efficient GPU-based massively parallel implementation of the edge-directed adaptive intra-field deinterlacing method which interpolates the missing pixels based on the deinterlaced covariance estimated from the interlaced covariance according to the geometric duality between the interlaced and the deinterlaced covariance. Although the edge-directed adaptive intra-field deinterlacing method can obtain better visual quality than conventional intra-field deinterlacing methods, the time-consuming computation is usually the bottleneck of this deinterlacing method. In order to tackle the problem, Graphics Processing Units (GPUs), as opposed to traditional CPU architectures, are better candidates to speed up the computation process. The proposed method interpolates more than one missing pixel at a time in order to gain a significant speedup compared to the case of interpolating just one missing pixel at a time. Experimental results show that we obtained a speedup of 94.6$\times$ when the I/O transfer time was taken into account, compared to the original single-threaded C CPU code with the -O2 compiling optimization.

© 2014 IEEE

PDF Article

References

  • View by:
  • |
  • |

  1. K. Jack, Video Demystified: A Handbook for the Digital Engineer (Newnes, 2005).
  2. G. de Haan, "Television display processing: Past & future," Proc. IEEE ICCE 2007 pp. 1-2.
  3. G. Jeon, M. Anisetti, D. Kim, V. Bellandi, E. Damiani, J. Jeong, "Weighted fuzzy reasoning scheme for interlaced to progressive conversion," Image Vision Comput. 27, 425-436 (2009).
  4. G. Jeon, M. Anisetti, V. Bellandi, J. Jeong, "Fuzzy rule-based edge-restoration algorithm in HDTV interlaced sequences," IEEE Trans. Consumer Electron. 53, 725-731 (2007).
  5. G. Jeon, M. Anisetti, V. Bellandi, E. Damiani, J. Jeong, "Fuzzy weighted approach to improve visual quality of edge-based filtering," IEEE Trans. Consumer Electron. 53, 1661-1667 (2007).
  6. G. Jeon, M. Anisetti, J. Lee, V. Bellandi, E. Damiani, J. Jeong, "Concept of linguistic variable-based fuzzy ensemble approach: Application to interlaced HDTV sequences," IEEE Trans. Fuzzy Syst. 17, 1245-1258 (2009).
  7. G. Jeon, M. Y. Jung, M. Anisetti, V. Bellandi, E. Damiani, J. Jeong, "Specification of the geometric regularity model for fuzzy if-then rule-based deinterlacing," J. Display Technol. 6, 235-243 (2010).
  8. G. Jeon, M. Anisetti, D. Kim, V. Bellandi, E. Damiani, J. Jeong, "Fuzzy rough sets hybrid scheme for motion and scene complexity adaptive deinterlacing," Image and Vision Comput. 27, 425-436 (2009).
  9. G. Jeon, M. Anisetti, V. Bellandi, E. Damiani, J. Jeong, "Designing of a type-2 fuzzy logic filter for improving edge-preserving restoration of interlaced-to-progressive conversion," Inf. Sci. 179, 2194-2207 (2009).
  10. G. Jeon, M. Anisetti, S. Kang, "A rank-ordered marginal filter for deinterlacing," Sensors 13, 3056-3065 (2013).
  11. E. B. Bellers, G. De Haan, De-Interlacing: A Key Technology for Scan Rate Conversion (North Holland, 2000).
  12. T. Chen, H. R. Wu, Z. H. Yu, "Efficient deinterlacing algorithm using edge-based line average interpolation," Opt. Eng. 39, 2101-2105 (2000).
  13. H. Yoo, J. Jeong, "Direction-oriented interpolation and its application to de-interlacing," IEEE Trans. Consumer Electron. 48, 954-962 (2002).
  14. M. K. Park, M. G. Kang, "A new edge dependent deinterlacing algorithm based on edge patterns," Proc. IEEE ISPACS 2004 pp. 96-99.
  15. S. Tai, C. Yu, F. Chang, "A motion and edge adaptive deinterlacing algorithm," Proc. IEEE ICME 2004 pp. 659-662.
  16. J. Lee, M. Kim, J. Jeong, "An efficient deinterlacing method based on new edge-directed interpolation," Proc. IWAIT 2005 pp. 1-4.
  17. W. Kim, S. Jin, J. Jeong, "Novel intra deinterlacing algorithm using content adaptive interpolation," IEEE Trans. Consumer Electron. 53, 1036-1043 (2007).
  18. S. Jin, W. Kim, J. Jeong, "Fine directional de-interlacing algorithm using modified Sobel operation," IEEE Trans. Consumer Electron. 54, 587-862 (2008).
  19. S. J. Park, C. Min, J. Jeong, G. Jeon, "Adaptive weighting scheme for edge-based line interpolation," Proc. IEEE PSIVT 2010 pp. 320-324.
  20. J. Wang, G. Jeon, J. Jeong, "Efficient adaptive deinterlacing algorithm with awareness of closeness and similarity," Opt. Eng. 51, 017003 (2012).
  21. X. Li, M. T. Orchard, "New edge-directed interpolation," IEEE Trans. Image Process. 10, 1521-1527 (2001).
  22. J. Wu, T. Li, B. Huang, "Parallel implementation of edge-directed image interpolation on a Graphics Processing Unit," Proc. IEEE ICPADS 2011 pp. 1052-1056.
  23. NVIDIA CUDA Programming Guide NVIDIASanta ClaraCAUSA (2011).
  24. J. Nickolls, W. J. Dally, "The GPU computing era," IEEE Micro 30, 56-69 (2010).
  25. J. Sanders, E. Kandrot, CUDA by Example: An Introduction to General-Purpose GPU Programming (Addison-Wesley, 2010).
  26. C Best Practices Guide NVIDIASanta ClaraCA (2012) NVIDIA.
  27. Z. Yang, Y. Zhu, Y. Pu, "Parallel image processing based on CUDA," Proc. IEEE CSSE 2008 pp. 198-201.
  28. W.-N. Chen, H.-M. Hang, "H. 264/AVC motion estimation implementation on compute unified device architecture (CUDA)," Proc. IEEE ICME 2008 pp. 697-700.
  29. B. Huang, J. Mielikainen, H. Oh, H.-L. Huang, "Development of a GPU-based high-performance radiative transfer model for the Infrared Atmospheric Sounding Interferometer (IASI)," J. Computat. Phys. 230, 2207-2221 (2011).
  30. J. Mielikainen, B. Huang, H.-L. Huang, "GPU-accelerated multi-profile radiative transfer model for the infrared atmospheric sounding interferometer," IEEE J. Sel. Topics Appl. Earth Observ. in Commun. 4, 691-700 (2011).
  31. A. Plaza, Q. Du, Y.-L. Chang, R. L. King, "Foreword to the special issue on high performance computing in Earth observation and remote sensing," IEEE J. Sel. Topics Appl. Earth Observ. in Commun. 4, 503-507 (2011).
  32. C. A. Lee, S. D. Gasster, A. Plaza, C.-I. Chang, B. Huang, "Recent developments in high performance computing for remote sensing: A review," IEEE J. Sel. Topics Appl. Earth Observ. in Commun. 4, 508-527 (2011).
  33. A. Plaza, J. Plaza, H. Vegas, "Improving the performance of hyperspectral image and signal processing algorithms using parallel distributed and specialized hardware-based systems," J. Signal Process. Syst. 61, 293-315 (2010).
  34. X. Wu, J. Cao, "GPU-aided motion adaptive video deinterlacing," Proc. 2010 IS&T/SPIE Electron. Imag. pp. 754308.
  35. P. Goorts, S. Rogmans, P. Bekaert, "Optimal data distribution for versatile finite impulse response filtering on next-generation graphics hardware using cuda," Proc. IEEE ICPADS 2009 pp. 300-307.
  36. G. Kowarzyk, N. Bélanger, Y. Savaria, "A GPGPU-based software implementation of the PBDI deinterlacing algorithm," Proc. IEEE ICECS 2011 pp. 780-783.
  37. S. Mallat, A Wavelet Tour of Signal Processing (Academic, 1998).
  38. J. Wu, J. Huang, G. Jeon, J. Cho, J. Jeong, L. Jiao, "Adaptive autoregressive deinterlacing method," Opt. Eng. 50, 7001-7006 (2011).
  39. X. Wu, E. Barthel, W. Zhang, "Piecewise 2D autoregression for predictive image coding," Proc. IEEE ICIP1998 pp. 903-904.

2013 (1)

G. Jeon, M. Anisetti, S. Kang, "A rank-ordered marginal filter for deinterlacing," Sensors 13, 3056-3065 (2013).

2012 (1)

J. Wang, G. Jeon, J. Jeong, "Efficient adaptive deinterlacing algorithm with awareness of closeness and similarity," Opt. Eng. 51, 017003 (2012).

2011 (5)

B. Huang, J. Mielikainen, H. Oh, H.-L. Huang, "Development of a GPU-based high-performance radiative transfer model for the Infrared Atmospheric Sounding Interferometer (IASI)," J. Computat. Phys. 230, 2207-2221 (2011).

J. Mielikainen, B. Huang, H.-L. Huang, "GPU-accelerated multi-profile radiative transfer model for the infrared atmospheric sounding interferometer," IEEE J. Sel. Topics Appl. Earth Observ. in Commun. 4, 691-700 (2011).

A. Plaza, Q. Du, Y.-L. Chang, R. L. King, "Foreword to the special issue on high performance computing in Earth observation and remote sensing," IEEE J. Sel. Topics Appl. Earth Observ. in Commun. 4, 503-507 (2011).

C. A. Lee, S. D. Gasster, A. Plaza, C.-I. Chang, B. Huang, "Recent developments in high performance computing for remote sensing: A review," IEEE J. Sel. Topics Appl. Earth Observ. in Commun. 4, 508-527 (2011).

J. Wu, J. Huang, G. Jeon, J. Cho, J. Jeong, L. Jiao, "Adaptive autoregressive deinterlacing method," Opt. Eng. 50, 7001-7006 (2011).

2010 (3)

J. Nickolls, W. J. Dally, "The GPU computing era," IEEE Micro 30, 56-69 (2010).

A. Plaza, J. Plaza, H. Vegas, "Improving the performance of hyperspectral image and signal processing algorithms using parallel distributed and specialized hardware-based systems," J. Signal Process. Syst. 61, 293-315 (2010).

G. Jeon, M. Y. Jung, M. Anisetti, V. Bellandi, E. Damiani, J. Jeong, "Specification of the geometric regularity model for fuzzy if-then rule-based deinterlacing," J. Display Technol. 6, 235-243 (2010).

2009 (4)

G. Jeon, M. Anisetti, D. Kim, V. Bellandi, E. Damiani, J. Jeong, "Fuzzy rough sets hybrid scheme for motion and scene complexity adaptive deinterlacing," Image and Vision Comput. 27, 425-436 (2009).

G. Jeon, M. Anisetti, V. Bellandi, E. Damiani, J. Jeong, "Designing of a type-2 fuzzy logic filter for improving edge-preserving restoration of interlaced-to-progressive conversion," Inf. Sci. 179, 2194-2207 (2009).

G. Jeon, M. Anisetti, D. Kim, V. Bellandi, E. Damiani, J. Jeong, "Weighted fuzzy reasoning scheme for interlaced to progressive conversion," Image Vision Comput. 27, 425-436 (2009).

G. Jeon, M. Anisetti, J. Lee, V. Bellandi, E. Damiani, J. Jeong, "Concept of linguistic variable-based fuzzy ensemble approach: Application to interlaced HDTV sequences," IEEE Trans. Fuzzy Syst. 17, 1245-1258 (2009).

2008 (1)

S. Jin, W. Kim, J. Jeong, "Fine directional de-interlacing algorithm using modified Sobel operation," IEEE Trans. Consumer Electron. 54, 587-862 (2008).

2007 (3)

W. Kim, S. Jin, J. Jeong, "Novel intra deinterlacing algorithm using content adaptive interpolation," IEEE Trans. Consumer Electron. 53, 1036-1043 (2007).

G. Jeon, M. Anisetti, V. Bellandi, J. Jeong, "Fuzzy rule-based edge-restoration algorithm in HDTV interlaced sequences," IEEE Trans. Consumer Electron. 53, 725-731 (2007).

G. Jeon, M. Anisetti, V. Bellandi, E. Damiani, J. Jeong, "Fuzzy weighted approach to improve visual quality of edge-based filtering," IEEE Trans. Consumer Electron. 53, 1661-1667 (2007).

2002 (1)

H. Yoo, J. Jeong, "Direction-oriented interpolation and its application to de-interlacing," IEEE Trans. Consumer Electron. 48, 954-962 (2002).

2001 (1)

X. Li, M. T. Orchard, "New edge-directed interpolation," IEEE Trans. Image Process. 10, 1521-1527 (2001).

2000 (1)

T. Chen, H. R. Wu, Z. H. Yu, "Efficient deinterlacing algorithm using edge-based line average interpolation," Opt. Eng. 39, 2101-2105 (2000).

J. Display Technol. (1)

G. Jeon, M. Y. Jung, M. Anisetti, V. Bellandi, E. Damiani, J. Jeong, "Specification of the geometric regularity model for fuzzy if-then rule-based deinterlacing," J. Display Technol. 6, 235-243 (2010).

IEEE J. Sel. Topics Appl. Earth Observ. in Commun. (1)

A. Plaza, Q. Du, Y.-L. Chang, R. L. King, "Foreword to the special issue on high performance computing in Earth observation and remote sensing," IEEE J. Sel. Topics Appl. Earth Observ. in Commun. 4, 503-507 (2011).

IEEE Trans. Fuzzy Syst. (1)

G. Jeon, M. Anisetti, J. Lee, V. Bellandi, E. Damiani, J. Jeong, "Concept of linguistic variable-based fuzzy ensemble approach: Application to interlaced HDTV sequences," IEEE Trans. Fuzzy Syst. 17, 1245-1258 (2009).

IEEE J. Sel. Topics Appl. Earth Observ. in Commun. (1)

C. A. Lee, S. D. Gasster, A. Plaza, C.-I. Chang, B. Huang, "Recent developments in high performance computing for remote sensing: A review," IEEE J. Sel. Topics Appl. Earth Observ. in Commun. 4, 508-527 (2011).

IEEE J. Sel. Topics Appl. Earth Observ. in Commun. (1)

J. Mielikainen, B. Huang, H.-L. Huang, "GPU-accelerated multi-profile radiative transfer model for the infrared atmospheric sounding interferometer," IEEE J. Sel. Topics Appl. Earth Observ. in Commun. 4, 691-700 (2011).

IEEE Micro (1)

J. Nickolls, W. J. Dally, "The GPU computing era," IEEE Micro 30, 56-69 (2010).

IEEE Trans. Consumer Electron. (2)

G. Jeon, M. Anisetti, V. Bellandi, E. Damiani, J. Jeong, "Fuzzy weighted approach to improve visual quality of edge-based filtering," IEEE Trans. Consumer Electron. 53, 1661-1667 (2007).

H. Yoo, J. Jeong, "Direction-oriented interpolation and its application to de-interlacing," IEEE Trans. Consumer Electron. 48, 954-962 (2002).

IEEE Trans. Consumer Electron. (1)

G. Jeon, M. Anisetti, V. Bellandi, J. Jeong, "Fuzzy rule-based edge-restoration algorithm in HDTV interlaced sequences," IEEE Trans. Consumer Electron. 53, 725-731 (2007).

IEEE Trans. Consumer Electron. (2)

W. Kim, S. Jin, J. Jeong, "Novel intra deinterlacing algorithm using content adaptive interpolation," IEEE Trans. Consumer Electron. 53, 1036-1043 (2007).

S. Jin, W. Kim, J. Jeong, "Fine directional de-interlacing algorithm using modified Sobel operation," IEEE Trans. Consumer Electron. 54, 587-862 (2008).

IEEE Trans. Image Process. (1)

X. Li, M. T. Orchard, "New edge-directed interpolation," IEEE Trans. Image Process. 10, 1521-1527 (2001).

Image and Vision Comput. (1)

G. Jeon, M. Anisetti, D. Kim, V. Bellandi, E. Damiani, J. Jeong, "Fuzzy rough sets hybrid scheme for motion and scene complexity adaptive deinterlacing," Image and Vision Comput. 27, 425-436 (2009).

Image Vision Comput. (1)

G. Jeon, M. Anisetti, D. Kim, V. Bellandi, E. Damiani, J. Jeong, "Weighted fuzzy reasoning scheme for interlaced to progressive conversion," Image Vision Comput. 27, 425-436 (2009).

Inf. Sci. (1)

G. Jeon, M. Anisetti, V. Bellandi, E. Damiani, J. Jeong, "Designing of a type-2 fuzzy logic filter for improving edge-preserving restoration of interlaced-to-progressive conversion," Inf. Sci. 179, 2194-2207 (2009).

J. Computat. Phys. (1)

B. Huang, J. Mielikainen, H. Oh, H.-L. Huang, "Development of a GPU-based high-performance radiative transfer model for the Infrared Atmospheric Sounding Interferometer (IASI)," J. Computat. Phys. 230, 2207-2221 (2011).

J. Signal Process. Syst. (1)

A. Plaza, J. Plaza, H. Vegas, "Improving the performance of hyperspectral image and signal processing algorithms using parallel distributed and specialized hardware-based systems," J. Signal Process. Syst. 61, 293-315 (2010).

Opt. Eng. (3)

J. Wu, J. Huang, G. Jeon, J. Cho, J. Jeong, L. Jiao, "Adaptive autoregressive deinterlacing method," Opt. Eng. 50, 7001-7006 (2011).

T. Chen, H. R. Wu, Z. H. Yu, "Efficient deinterlacing algorithm using edge-based line average interpolation," Opt. Eng. 39, 2101-2105 (2000).

J. Wang, G. Jeon, J. Jeong, "Efficient adaptive deinterlacing algorithm with awareness of closeness and similarity," Opt. Eng. 51, 017003 (2012).

Sensors (1)

G. Jeon, M. Anisetti, S. Kang, "A rank-ordered marginal filter for deinterlacing," Sensors 13, 3056-3065 (2013).

Other (18)

E. B. Bellers, G. De Haan, De-Interlacing: A Key Technology for Scan Rate Conversion (North Holland, 2000).

K. Jack, Video Demystified: A Handbook for the Digital Engineer (Newnes, 2005).

G. de Haan, "Television display processing: Past & future," Proc. IEEE ICCE 2007 pp. 1-2.

S. J. Park, C. Min, J. Jeong, G. Jeon, "Adaptive weighting scheme for edge-based line interpolation," Proc. IEEE PSIVT 2010 pp. 320-324.

M. K. Park, M. G. Kang, "A new edge dependent deinterlacing algorithm based on edge patterns," Proc. IEEE ISPACS 2004 pp. 96-99.

S. Tai, C. Yu, F. Chang, "A motion and edge adaptive deinterlacing algorithm," Proc. IEEE ICME 2004 pp. 659-662.

J. Lee, M. Kim, J. Jeong, "An efficient deinterlacing method based on new edge-directed interpolation," Proc. IWAIT 2005 pp. 1-4.

J. Wu, T. Li, B. Huang, "Parallel implementation of edge-directed image interpolation on a Graphics Processing Unit," Proc. IEEE ICPADS 2011 pp. 1052-1056.

NVIDIA CUDA Programming Guide NVIDIASanta ClaraCAUSA (2011).

J. Sanders, E. Kandrot, CUDA by Example: An Introduction to General-Purpose GPU Programming (Addison-Wesley, 2010).

C Best Practices Guide NVIDIASanta ClaraCA (2012) NVIDIA.

Z. Yang, Y. Zhu, Y. Pu, "Parallel image processing based on CUDA," Proc. IEEE CSSE 2008 pp. 198-201.

W.-N. Chen, H.-M. Hang, "H. 264/AVC motion estimation implementation on compute unified device architecture (CUDA)," Proc. IEEE ICME 2008 pp. 697-700.

X. Wu, E. Barthel, W. Zhang, "Piecewise 2D autoregression for predictive image coding," Proc. IEEE ICIP1998 pp. 903-904.

X. Wu, J. Cao, "GPU-aided motion adaptive video deinterlacing," Proc. 2010 IS&T/SPIE Electron. Imag. pp. 754308.

P. Goorts, S. Rogmans, P. Bekaert, "Optimal data distribution for versatile finite impulse response filtering on next-generation graphics hardware using cuda," Proc. IEEE ICPADS 2009 pp. 300-307.

G. Kowarzyk, N. Bélanger, Y. Savaria, "A GPGPU-based software implementation of the PBDI deinterlacing algorithm," Proc. IEEE ICECS 2011 pp. 780-783.

S. Mallat, A Wavelet Tour of Signal Processing (Academic, 1998).

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.