Yoshiaki Shishikui

Yoshiaki Shishikui

Professor,
Department of Frontier Media Science, School of Interdisciplinary Mathematical Sciences
Meiji University, Tokyo, Japan

Yoshiaki Shishikui received the B.S., M.S. and Ph.D. degrees in electrical engineering from the University of Tokyo, Tokyo, Japan, in 1981, 1983, and 1997, respectively.

He joined NHK (Japan Broadcasting Corporation), Tokyo, Japan, in 1983. From 1986 to 2014, he was with NHK Science and Technology Research Laboratories, where he had been engaged in research on digital signal processing, picture coding, HDTV broadcasting systems, IPTV systems, advanced data broadcasting systems and UHDTV research activities. He led the Super Hi-Vision public viewing project at the London 2012 Olympics. From 2001 to 2003, he was with NHK Engineering Services Inc., where he helped to develop video archives and video-on-demand systems.

He was appointed a professor in the Department of Frontier Media Science of the School of Interdisciplinary Mathematical Sciences at Meiji University, in April 2014.

He is a member of IEEE, IEICE Japan and ITE Japan. He has been actively involved in standardization activities at SMPTE and ISO-IEC (MPEG).

8K SUPER Hi-VISION: Science, Engineering, Deployment and Expectations

Abstract:

Following the HDTV development, NHK, Japanese public service broadcaster, began research on ultra-HDTV in 1995. Over the last two decades, 8K SUPER Hi-VISION (SHV) has been developed as a next generation broadcast system that provides viewers a much greater sensation of reality. Video and audio parameters were determined based on scientific research on human perception. The video system with 7680 x 4320 pixels delivers images so real that viewers can almost feel they are present at the scenes of the broadcast, and the 22.2 multichannel sound system produces three-dimensional spatial sound that augments the sense of reality and presence.

Triggered by a successful showcase of SHV at the London Olympic Games, where the SHV visual and audio system demonstrated the feasibility and raised the viewers’ sensation to a new level, the promotions for the early realization of UHDTV were accelerated in Japan. The ministry of communications published a roadmap to launch a test broadcast of 8K SHV in 2016 and full-service in 2018.

The ultimate in television refers to TV that realizes an overwhelming degree of realism, like the images seen by the human eye. 8K technology can be deployed in a wide range of ways in various directions, bringing about the advent of an age of putting imaging technologies to their fullest extent.

The presentation describes the scientific background of video parameters, features of SHV signals for video coding, current status of SHV in terms of standardization, equipment development and deployment. It also covers expectations of applications beyond broadcasting.


Fernando-PereiraFernando Pereira

Professor
Department of Electrical and Computer Engineering
Instituto de Telecomunicações, IST, Lisbon, Portugal

Fernando Pereira received the B.S., M.Sc., and Ph.D. degrees in electrical and computer engineering from Instituto Superior Técnico (IST), Universidade Técnica de Lisboa, Lisbon, Portugal, in 1985, 1988, and 1991, respectively. He is a Professor with the Electrical and Computer Engineering Department, Instituto de Telecomunicações, IST, where he is responsible for the participation of IST in many national and international research projects. Dr. Pereira has been participating in the work of ISO/MPEG for many years, particularly, the Head of the Portuguese delegation, the Chairman of the MPEG Requirements Group, and chairing many ad hoc groups related to the MPEG-4 and MPEG-7 standards. He is a EURASIP Fellow for contributions to digital video representation technologies and standards and was an IEEE Distinguished Lecturer in 2005.

Visual Coding: Step by Step towards Reality

Abstract:

In recent years, 3D experiences have become more popular, acknowledging that a faithful, transparent and immersive representation of our world requires more than 2D video. In this context, the current visual representation status quo may be understood as providing only efficient multiview video coding solutions for linear, horizontal only parallax camera arrangements, narrow baselines and reduced viewing range. Moreover, current display solutions based on stereoscopic vision only exploit limited depth cues and have inherent accommodation/vergence conflicts.

The emergence of new 3D cameras and displays and the increasing request for more immersive experiences led to questioning the fundamentals of the vision process, notably the structure of the information in the light impinging on an observer of a scene. These advances and needs led to the so-called plenoptic function which measures the intensity of light seen from any viewpoint/camera centre 3D spatial position (x,y,z), any angular viewing direction (θ,ϕ), over time (t) and for each wavelength (λ). In this context, new (3D) visual representation models and associated coding solutions are needed to improve the immersion and interaction experiences as provided by some emerging displays to overcome the limitations. However, the novel imaging representations, notably based on the plenoptic function, will require huge amounts of raw data and thus efficient coding is a must.

Nowadays, a plenoptic representation of a visual scene involving full (horizontal and vertical) parallax may be obtained by using two main representation approaches: i) a so-called super multiview video (SMV) approach where multiple, high-density views are acquired using a multi-camera array (or a single camera rig) with a certain (e.g. linear or arc) arrangement; and ii) a so-called plenoptic approach based on a single integral/holoscopic camera using a lenticular array composed of a large number of micro lenses able to acquire the light information coming from different incident angles.

Considering the relevance of the novel potential functionalities, both the MPEG (Free-viewpoint TV (FTV) Adhoc group) and JPEG (JPEG PLENO) standardization groups started studying the representation and coding of the new data types associated to plenoptic imaging representations.

In this context, the main objective of this talk is to review and discuss the present and trends on visual coding, notably the available coding standards and future coding solutions adopting a plenoptic representation framework.