USING PLACEHOLDER SLICES AND MPEG-21 BSDL FOR ROI EXTRACTION IN H.264/AVC FMO-ENCODED BITSTREAMS

Peter Lambert, Wesley De Neve, Davy De Schrijver, Yves Dhondt, Rik Van de Walle

2006

Abstract

The concept of Regions of Interest (ROIs) within a video sequence is useful for many application scenarios. This paper concentrates on the exploitation of ROI coding within the H.264/AVC specification by making use of Flexible Macroblock Ordering. It shows how ROIs can be coded in an H.264/AVC compliant bitstream and how the MPE-21 BSDL framework can be used for the extraction of the ROIs. The first type of ROI extraction that is described, is simply dropping the slices that are not part of one of the ROIs. The second type is the replacement of these slices with so-called placeholder slices, the latter being implemented as P slices containing only macroblocks that are marked as ‘skipped’. The exploitation of ROI scalability, as achieved by the presented methodology, illustrates the possibilities that are offered by the single-layered H.264/AVC specification for content adaptation. The results show that the bit rate needed to transmit the adapted bitstreams can be reduced significantly. Especially in the case of a static camera and a fixed background, this bit rate reduction has very little impact on the visual quality. Another advantage of the adaptation process is the fact that the execution speed of the receiving decoder fairly increases.

References

  1. Cimprich, P. (2004). Streaming transformations for XML (STX) version 1.0 working draft. http://stx.sourceforge.net/documents/spec-stx20040701.html.
  2. De Neve, W., De Schrijver, D., Van de Walle, D., Lambert, P., and Van de Walle, R. (2006). Description-based substitution methods for emulating temporal scalability in state-of-the-art video coding formats. In Proceedings of the 7th International Workshop on Image Analysis for Multimedia Interactive Services, Korea, accepted for publication.
  3. De Neve, W., Van Deursen, D., De Schrijver, D., De Wolf, K., and Van de Walle, R. (2005). Using bitstream structure descriptions for the exploitation of multilayered temporal scalability in h.264/avc's base specification. Lecture Notes in Computer Science, Advances in Multimedia Information Processing, PCM 2005, 6th Pacific-Rim Conference on Multimedia, pages 641-652.
  4. De Schrijver, D., Poppe, C., Lerouge, S., De Neve, W., and Van de Walle, R. (2006). MPEG-21 bitstream syntax descriptions for scalable video codecs. Multimedia Systems, article in press.
  5. Devillers, S., Timmerer, C., Heuer, J., and Hellwagner, H. (2005). Bitstream syntax description-based adaptation in streaming and constrained environments. IEEE Trans. Multimedia, 7(3):463-470.
  6. Dhondt, Y., Lambert, P., Notebaert, S., and Van de Walle, R. (2005). Flexible macroblock ordering as a content adaptation tool in H.264/AVC. In Proceedings of the SPIE/Optics East conference, Boston.
  7. Hannuksela, M. M., Wang, Y.-K., and Gabbouj, M. (2004). Isolated regions in video coding. IEEE Transactions on Multimedia, 6(2):259-267.
  8. Ichimura, D., Honda, Y., Sun, H., Lee, M., and Shen, S. (2005). A tool for interactive ROI scalability. JVT-Q020, http://ftp3.itu.ch/av-arch/jvtsite/2005 10 Nice/JVT-Q020.doc.
  9. ISO/IEC JTC1/SC29/WG11, . (2005). tions and requirements for scalable coding. ISO/IEC JTC1/SC29/WG11 http://www.chiariglione.org/mpeg/working documents/mpeg-04/svc/requirements.zip.
  10. N6880,
  11. Kay, M. (2001). XSLT Programmer's Reference, 2nd Edition. Wrox Press Ltd., Birmingham, UK.
  12. Lambert, P., De Neve, W., Dhondt, Y., and Van de Walle, R. (2006). Flexible macroblock ordering in H.264/AVC. Journal of Visual Communication and Image Representation, 17(2):358-375.
  13. Li, W. (2001). Overview of fine granularity scalability in MPEG-4 video standard. IEEE Trans. Circuits Syst. Video Technol., 11(3):301-317.
  14. Reichel, J., Schwarz, H., and Wien, M. (2005). Joint scalable video model JSVM-4. JVT-Q202, http://ftp3.itu.ch/av-arch/jvt-site/2005 10 Nice/JVTQ202.zip.
  15. Taubman, D. and Marcellin, M. (2002). JPEG2000 : Image Compression Fundamentals, Standards and Practice. Kluwer Academic Publishers.
  16. Thang, T. C., Kim, D., Bae, T. M., Kang, J. W., Ro, Y. M., and Kim, J.-G. (2005). Show case of ROI extraction using scalability information SEI message. JVT-Q077, http://ftp3.itu.ch/av-arch/jvtsite/2005 10 Nice/JVT-Q077.doc.
  17. Vetro, A. and Timmerer, C. (2003). Text of ISO/IEC 21000-7 FCD - part 7: Digital item adaptation. ISO/IEC JTC1/SC29/WG11 N5845, http://www.chiariglione.org/mpeg/working documents/mpeg-21/dia/dia fcd.zip.
  18. Wiegand, T., Sullivan, G. J., Bjøntegaard, G., and Luthra, A. (2003). Overview of the H.264/AVC video coding standard. IEEE Trans. Circuits Syst. Video Technol., 13(7):560-576.
  19. Yin, P., Boyce, J., and Pandit, P. (2005). FMO and ROI scalability. JVT-Q029, http://ftp3.itu.ch/av-arch/jvtsite/2005 10 Nice/JVT-Q029.doc.
Download


Paper Citation


in Harvard Style

Lambert P., De Neve W., De Schrijver D., Dhondt Y. and Van de Walle R. (2006). USING PLACEHOLDER SLICES AND MPEG-21 BSDL FOR ROI EXTRACTION IN H.264/AVC FMO-ENCODED BITSTREAMS . In Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2006) ISBN 978-972-8865-64-1, pages 9-16. DOI: 10.5220/0001567900090016


in Bibtex Style

@conference{sigmap06,
author={Peter Lambert and Wesley De Neve and Davy De Schrijver and Yves Dhondt and Rik Van de Walle},
title={USING PLACEHOLDER SLICES AND MPEG-21 BSDL FOR ROI EXTRACTION IN H.264/AVC FMO-ENCODED BITSTREAMS},
booktitle={Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2006)},
year={2006},
pages={9-16},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001567900090016},
isbn={978-972-8865-64-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2006)
TI - USING PLACEHOLDER SLICES AND MPEG-21 BSDL FOR ROI EXTRACTION IN H.264/AVC FMO-ENCODED BITSTREAMS
SN - 978-972-8865-64-1
AU - Lambert P.
AU - De Neve W.
AU - De Schrijver D.
AU - Dhondt Y.
AU - Van de Walle R.
PY - 2006
SP - 9
EP - 16
DO - 10.5220/0001567900090016