The Moving Picture Experts Group

Workshop on standard coding technologies for immersive audio and visual experiences

Wednesday, 10 July 2019 - 1:00pm to 6:00pm
Clarion Post Hotel
Drottningtorget 10
411 03 Gothenburg

MPEG aims at standardizing coding solutions for the digital representation of light fields, which contain color and directional light information from any point in space. The objective is to support immersive applications - virtual and augmented reality - with the highest level of visual comfort with parallax cues that are required in natural vision.

Since any digital capture will subsample the light field in which we are immersed, various capture technologies (omnidirectional and plenoptic cameras, camera arrays, etc.) as well as display technologies (head mounted devices, light field displays, integral photography displays, etc.) lead to a wide range of coding technologies to be explored. Some will be selected for further standardization.

MPEG has already standardized 360° video - also called omnidirectional video - in OMAF version 1, and is in the process of standardizing extensions in 3DoF+ OMAF version 2 by mid-2020, bringing natural vision parallax cues, albeit within a limited range of viewer motion. Full parallax of dynamic object is supported in the first version of Point Cloud Coding ready by early 2020, while coding of 6DoF virtual reality over large navigation volumes is further studied for standardization by 2023.

This workshop will cover the MPEG-I immersive activities - past, present and future – calling participants to present demos and future requirements to the MPEG community.

Title: Standard coding technologies for immersive audio-visual experiences

Date: 10 July, 2019

Address: MPEG meeting venue 

Clarion Post Hotel

Drottningtorget 10, 411 03 Gothenburg, Sweden



(Lu Yu, Zhejiang University)


Usecases and challenges about user immersive experiences

(Valerie Allie, InterDigital)


Overview of technologies for immersive visual experiences: capture, processing, compression, standardization and display

(Marek Domanski, Poznan University of Technology)


MPEG-I Immersive Audio

(Schuyler Quackenbush, Audio Research Labs)


Brief introduction about demos:

  • Integral photography display (NHK)
  • Realtime interactive demo with 3DoF+ content (InterDigital)
  • Plenoptic 2.0 video camera (Tsinghua University)
  • A simple free-viewpoint television system (Poznan University of Technology)



Coffee break


360° and 3DoF+ video

(Bart Kroon, Philips)


Point cloud compression

(Marius Preda, Telecom SudParis, CNRS Samovar)


How can we achieve 6DoF video compression?

(Joel Jung, Orange)


How can we achieve lenslet video compression?

(Xin Jin, Tsinghua University,

Mehrdad Teratani, Nagoya University)