Pedro Amado Assunção - 3D Visual Content Creation, Coding and Delivery

Signals and Communication Technology

More information about this series at http://www.springer.com/series/4748

Editors

Pedro Amado Assuno and Atanas Gotchev

3D Visual Content Creation, Coding and Delivery

Editors

Pedro Amado Assuno

Instituto de Telecomunicaes and Politcnico de Leiria, Leiria, Portugal

Atanas Gotchev

Department of Signal Processing, Tampere University of Technology, Tampere, Finland

ISSN 1860-4862 e-ISSN 1860-4870

Signals and Communication Technology

ISBN 978-3-319-77841-9 e-ISBN 978-3-319-77842-6

https://doi.org/10.1007/978-3-319-77842-6

Library of Congress Control Number: 2018939315

Springer International Publishing AG, part of Springer Nature 2019

This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed.

The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use.

The publisher, the authors and the editors are safe to assume that the advice and information in this book are believed to be true and accurate at the date of publication. Neither the publisher nor the authors or the editors give a warranty, express or implied, with respect to the material contained herein or for any errors or omissions that may have been made. The publisher remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This Springer imprint is published by the registered company Springer Nature Switzerland AG

The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland

Contents

Pedro Amado Assuno and Atanas Gotchev

Marek Domaski , Tomasz Grajek , Caroline Conti , Carl James Debono , Srgio M. M. de Faria , Peter Kovacs , Lus F. R. Lucas , Paulo Nunes , Cristian Perra , Nuno M. M. Rodrigues , Mrten Sjstrm , Lus Ducla Soares and Olgierd Stankiewicz

Dragan Kukolj , Libor Bolecek , Ladislav Polak , Tomas Kratochvil , Ondrej Zach , Jan Kufa , Martin Slanina , Tomasz Grajek , Jarosw Samelak , Marek Domaski and Dragorad A. Milovanovic

Carl James Debono , Marek Domaski , Srgio M. M. de Faria , Krzysztof Klimaszewski , Lus F. R. Lucas , Nuno M. M. Rodrigues and Krzysztof Wegner

Srgio M. M. de Faria , Sylvain Marcelino , Carl J. Debono , Salviano Soares and Pedro Amado Assuno

Caroline Conti , Lus Ducla Soares , Paulo Nunes , Cristian Perra , Pedro Amado Assuno , Mrten Sjstrm , Yun Li , Roger Olsson and Ulf Jennehag

Caroline Conti , Paulo Nunes and Lus Ducla Soares

Emil Dumic , Anamaria Bjelopera , Khaled Boussetta , Luis A. da Silva Cruz , Yuansong Qiao , A. Murat Tekalp and Yuhang Ye

Emil Dumic , Khaled Boussetta , Luis A. da Silva Cruz , Tasos Dagiuklas , Antonio Liotta , Ilias Politis , Yuansong Qiao , A. Murat Tekalp , Maria Torres Vega and Yuhang Ye

Miguel Barreda-ngeles , Federica Battisti , Giulia Boato , Marco Carli , Emil Dumic , Margrit Gelautz , Chaminda Hewage , Dragan Kukolj , Patrick Le-Callet , Antonio Liotta , Cecilia Pasquini , Alexandre Pereda-Baos , Christos Politis , Dragana Sandic , Murat Tekalp , Mara Torres-Vega and Vladimir Zlokolica

Karel Fliegel , Federica Battisti , Marco Carli , Margrit Gelautz , Luk Krasula , Patrick Le Callet and Vladimir Zlokolica

Three-dimensional (3D) audiovisual content is nowadays the driving force of many multimedia applications and services as well as development of different support technologies. The recent evolution of 3D media technologies has been quite diverse and progressing in different directions, not only enhancing existing technology but also developing and pushing forward new and richer content-driven applications. The main goals of using 3D multimedia have been maintained over the years as the ability to provide users with perceptual elements (mostly audiovisual) capable of providing an immersion feeling of being part of the scene, interacting and perceiving the 3D nature of the real physical environments conveyed by 3D content. More recently, the search for better technology, more pleasant user experiences and growing consumer markets have been driving a lot of research projects and new results with high potential impact in future evolution of 3D multimedia services and applications.

While immersive multimedia systems have been attracting increasing attention from researchers, industry and consumer market, many technological challenges remain associated with the huge amount of data that has to be dealt with at all stages of delivery systems. Evolution in this field has been essentially accomplished through expansion of audiovisual acquisition and rendering from single to many (virtually infinite) spatial locations, which requires audiovisual scene representations through acoustic wave fields and light fields, rather than single audio and video capturing the scene from a single spatial location. In this context, the ultimate goal of 3D multimedia technologies is to bring higher realism in the visual scenes being communicated and to provide the user with more creative tools for interacting with the visual content. Correspondingly, the interest in 3D technologies has been ever strong caused by their potential to enrich the human perception and support the development of novel applications and services in areas such as entertainment, 3DTV, games, medical and scientific visualization. Subsequently, the advances in 3D multimedia technologies open new market opportunities and enhance the user experience. Many research projects have aimed at developing future 3D technologies and reaching the next frontiers. As exciting as the novel results could be, they are always only the current state of the art and a starting point to go beyond.

This book presents recent developments in the field of 3D visual communications, departing from current technologies and analyzing their evolution to reveal the constraints that still limit the ultimate 3D user experience.

Multi-view video and light field representations are characteristic of the current trends in 3D visual technologies, and thus, they are addressed first in order to establish the fundamentals for representing the latest developments in efficient coding and delivery methods and tools. The aim to capture high-quality 3D visual content faces the need to process high amount of captured data. This, subsequently, calls for new efficient representations and effective coding tools. In this context, the book describes advances in multi-view video coding, including both standard-compliant techniques and non-standard ones, dense multi-view and depth-based coding.