Abstract

This study proposes an adaptive error concealment selection process in order to improve the quality of reconstructed images which have low computation complexity for multi-view video coding. In this study, the proposed algorithm uses the motion vector variances and texture histogram bins in the blocks neighboring the damaged block in order to define two correlations; the degree of motion and the degree of texture similarity. To increase the accuracy of the suitable EC for the damaged macro-block, these two correlations are used to select a suitable error concealment method for reconstructing the damaged macro-block through fuzzy reasoning. The motion degree indicates the motion complexity for the damaged macro-block, and the texture similarity degree indicates the spatial continuity between the damaged macro-block and its neighboring block. The proposed adaptive error concealment is selected to reduce concealing time on homogenous damaged blocks and to improve the reconstructed image quality on non-homogenous damaged blocks. The experiment results show that the proposed algorithm can reduce the concealing time by at least 1.16 s and can improve the peak signal-to-noise (PSNR) by 0.13 dB–2.44 dB and 0.11 dB–3.52 dB in the main views and auxiliary views, respectively. This proposed algorithm is suitable for the multi-view video transmission on the consumer electronic fields such as 3D mobile devices, 3D television.

© 2014 IEEE

PDF Article

References

  • View by:
  • |
  • |

  1. H. Schwarz, D. Marpe, T. Wiegand, "Overview of the scalable video coding extension of the H.264/AVC standard," IEEE Trans. Circuits Syst. Video Technol. 17, 1103-1124 (2007).
  2. Joint Draft 8.0 on Multiview Video Coding JVT-AB204 (2008).
  3. P. Merkle, A. Smolic, K. Muller, T. Wiegand, "Efficient prediction structures for multiview video coding," IEEE Trans. Circuits Syst. Video Technol. 17, 1461-1473 (2007).
  4. Y. Zhang, S. Kwong, G. Jiang, H. Wang, "Efficient multi-reference frame selection algorithm for hierarchical B pictures in multiview video coding," IEEE Trans. Broadcast. 57, 15-23 (2011).
  5. Y. Liu, Q. M. Huang, S. W. Ma, D. B. Zhao, W. Gao, S. Ci, H. Tang, "A novel rate control technique for multiview video plus depth based 3D video coding," IEEE Trans. Broadcast. 57, 2562-571 (2011).
  6. L. Q. Shen, Z. Liu, P. An, R. Ma, Z. Y. Zhang, "Low-complexity mode decision for MVC," IEEE Trans. Circuits Syst. Video Technol. 21, 837-843 (2011).
  7. H. Q. Zegn, K. K. Ma, C. H. Cai, "Fast mode decision for multiview video coding using mode correlation," IEEE Trans. Circuits Syst. Video Technol. 21, 1659-1666 (2011).
  8. S. J. Liu, Y. Chen, Y. K. Wang, M. Gabbouj, M. M. Hannuksela, H. Q. Li, "Frame loss error concealment for multiview video coding," 2008 IEEE Int. Symp. on Circuits Syst. (2008) pp. 3470-3473.
  9. L. Liang, R. Ma, P. An, C. Liu, "An effective error concealment method used in multi-view video coding," Int. Congress on Image and Signal Process. (2011) pp. 76-79.
  10. B. W. Micallef, C. J. Debono, R. A. Farrugia, "Performance of enhanced error concealment techniques in multi-view video coding systems," Int. Conf. on Syst., Signals and Image Process. (2011) pp. 1-4.
  11. E. Kurtepe, A. Aksay, C. Bilen, C. G. Gurler, T. Sikora, G. B. Akar, A. M. Tekalp, "A standards-based, flexible, end-to-end multi-view video streaming architecture," Packer Video 2007 (2007) pp. 302-307.
  12. P. J. Lee, K. T. Kuo, "An adaptive error concealment method selection algorithm for multi-view video coding," Int. Conf. on Consumer Electronics (2013) pp. 1-2.
  13. T. C. Chiang, W. J. Wang, "Highway on-ramp control using fuzzy decision making," J. Vibr. Control 17, 205-213 (2011).
  14. P. J. Lee, H. H. Chen, W. J. Wang, L. G. Chen, "Feature-based error concealment for object-based video," IEICE Trans. Commun. E88-B, 2616-2626 (2005).

2011 (5)

Y. Zhang, S. Kwong, G. Jiang, H. Wang, "Efficient multi-reference frame selection algorithm for hierarchical B pictures in multiview video coding," IEEE Trans. Broadcast. 57, 15-23 (2011).

Y. Liu, Q. M. Huang, S. W. Ma, D. B. Zhao, W. Gao, S. Ci, H. Tang, "A novel rate control technique for multiview video plus depth based 3D video coding," IEEE Trans. Broadcast. 57, 2562-571 (2011).

L. Q. Shen, Z. Liu, P. An, R. Ma, Z. Y. Zhang, "Low-complexity mode decision for MVC," IEEE Trans. Circuits Syst. Video Technol. 21, 837-843 (2011).

H. Q. Zegn, K. K. Ma, C. H. Cai, "Fast mode decision for multiview video coding using mode correlation," IEEE Trans. Circuits Syst. Video Technol. 21, 1659-1666 (2011).

T. C. Chiang, W. J. Wang, "Highway on-ramp control using fuzzy decision making," J. Vibr. Control 17, 205-213 (2011).

2007 (2)

H. Schwarz, D. Marpe, T. Wiegand, "Overview of the scalable video coding extension of the H.264/AVC standard," IEEE Trans. Circuits Syst. Video Technol. 17, 1103-1124 (2007).

P. Merkle, A. Smolic, K. Muller, T. Wiegand, "Efficient prediction structures for multiview video coding," IEEE Trans. Circuits Syst. Video Technol. 17, 1461-1473 (2007).

2005 (1)

P. J. Lee, H. H. Chen, W. J. Wang, L. G. Chen, "Feature-based error concealment for object-based video," IEICE Trans. Commun. E88-B, 2616-2626 (2005).

IEEE Trans. Broadcast. (1)

Y. Zhang, S. Kwong, G. Jiang, H. Wang, "Efficient multi-reference frame selection algorithm for hierarchical B pictures in multiview video coding," IEEE Trans. Broadcast. 57, 15-23 (2011).

IEEE Trans. Broadcast. (1)

Y. Liu, Q. M. Huang, S. W. Ma, D. B. Zhao, W. Gao, S. Ci, H. Tang, "A novel rate control technique for multiview video plus depth based 3D video coding," IEEE Trans. Broadcast. 57, 2562-571 (2011).

IEEE Trans. Circuits Syst. Video Technol. (4)

L. Q. Shen, Z. Liu, P. An, R. Ma, Z. Y. Zhang, "Low-complexity mode decision for MVC," IEEE Trans. Circuits Syst. Video Technol. 21, 837-843 (2011).

H. Q. Zegn, K. K. Ma, C. H. Cai, "Fast mode decision for multiview video coding using mode correlation," IEEE Trans. Circuits Syst. Video Technol. 21, 1659-1666 (2011).

H. Schwarz, D. Marpe, T. Wiegand, "Overview of the scalable video coding extension of the H.264/AVC standard," IEEE Trans. Circuits Syst. Video Technol. 17, 1103-1124 (2007).

P. Merkle, A. Smolic, K. Muller, T. Wiegand, "Efficient prediction structures for multiview video coding," IEEE Trans. Circuits Syst. Video Technol. 17, 1461-1473 (2007).

IEICE Trans. Commun. (1)

P. J. Lee, H. H. Chen, W. J. Wang, L. G. Chen, "Feature-based error concealment for object-based video," IEICE Trans. Commun. E88-B, 2616-2626 (2005).

J. Vibr. Control (1)

T. C. Chiang, W. J. Wang, "Highway on-ramp control using fuzzy decision making," J. Vibr. Control 17, 205-213 (2011).

Other (6)

Joint Draft 8.0 on Multiview Video Coding JVT-AB204 (2008).

S. J. Liu, Y. Chen, Y. K. Wang, M. Gabbouj, M. M. Hannuksela, H. Q. Li, "Frame loss error concealment for multiview video coding," 2008 IEEE Int. Symp. on Circuits Syst. (2008) pp. 3470-3473.

L. Liang, R. Ma, P. An, C. Liu, "An effective error concealment method used in multi-view video coding," Int. Congress on Image and Signal Process. (2011) pp. 76-79.

B. W. Micallef, C. J. Debono, R. A. Farrugia, "Performance of enhanced error concealment techniques in multi-view video coding systems," Int. Conf. on Syst., Signals and Image Process. (2011) pp. 1-4.

E. Kurtepe, A. Aksay, C. Bilen, C. G. Gurler, T. Sikora, G. B. Akar, A. M. Tekalp, "A standards-based, flexible, end-to-end multi-view video streaming architecture," Packer Video 2007 (2007) pp. 302-307.

P. J. Lee, K. T. Kuo, "An adaptive error concealment method selection algorithm for multi-view video coding," Int. Conf. on Consumer Electronics (2013) pp. 1-2.

Cited By

OSA participates in CrossRef's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.