1        Media coding

1.1       Frame Packing Arrangement Signalling in MPEG-2 Video

1.2       Frame Packing Arrangement Signalling for Quincunx Pattern

1.3       New SEI message on MVC view and additional signaling in frame packing SEI signaling

1.4       Multi-resolution 3D mesh coding

1.5       Composite Font Representation

1.6       OFF Additional script and language tags

1.7       Web Video Coding

1.8       Contract Expression Language

1.9       CAL Extensions

1.10         Reconfigurable Media Coding

1.11         Media Context and Control – Control Information

1.12         Media Context and Control – Sensory Information

1.13         Media Context and Control – Virtual World Object Characteristics

1.14         Media Context and Control – Data Formats for Interaction Devices

1.15         Media Context and Control – Common Types and Tools

1.16         High-Efficiency Video Coding

1.17         3D Audio

1.18         3D Video Coding

1.19         Internet Video Coding

1.20         Multimedia Preservation

1.21         Codec independent media description

2        Composition coding

2.1       Scene Description Based Collaborative Applications

2.2       Advanced User Interaction

3        Description coding

3.1       Audio-visual description profile

3.2       Compact Descriptors for Visual Search

3.3       Social Metadata

3.4       AVDP Profiles

3.5       User Description

4        Systems support

4.1       Audio Systems Interaction

5        IPMP

5.1       Common Encryption Format for ISO Base Media File Format

6        Digital Item.

6.1       Digital Item Linking

7        Transport and File formats

7.1       MPEG-2 Systems DASH support

7.2       Simplified carriage of MPEG-4 over MPEG-2 TS

7.3       Various enhancements including support for large metadata

7.4       MPEG-DASH Implementation Guidelines

7.5       MPEG Media Transport

8        Multimedia architecture

8.1       MPEG-M Architecture

8.2       MXM API

8.3       MPEG-M Elementary Services

8.4       MPEG-M Service Aggregation

8.5       MPEG-M Usage guidelines

8.6       MPEG-V Architecture

9        Application formats

9.1       Surveillance Application Format

9.2       Professional Archival Application Format

9.3       Stereoscopic Video AF DASH support

9.4       Augmented Reality AF

10     Reference implementation

10.1         Efficient representation of 3D meshes with multiple attributes Reference Software

10.2         Reference software multi-resolution 3D mesh compression

10.3         Audio-visual Description Profile Reference Software

10.4         DASH Reference Software

10.5         Video Tool Library Reference Software

10.6         SAOC Reference Software

10.7         USAC Reference Software

10.8         USAC Reference Software

10.9         MPEG-DASH Reference Software

10.10       MPEG-M Reference Software

10.11       MPEG-V – Reference Software

11     Conformance

11.1         3D Efficient representation of 3D meshes with multiple attributes Conformance

11.2         Multiresolution 3D mesh coding Conformance

11.3         Video Tool Library Conformance

11.4         SAOC Conformance

11.5         USAC Conformance

11.6         MPEG-DASH Conformance

11.7         MPEG-M Conformance

11.8         MPEG-V – Conformance

12     Maintenance

12.1         Systems coding standards

12.2         Video coding standards

12.3         Audio coding standards

12.4         3DG coding standards

12.5         Systems description coding standards

12.6         Visual description coding standards

12.7         Audio description coding standards

12.8         MPEG-21 standards

12.9         MPEG-A standards

13     Work plan and time line

Std

Pt

Amd

Req

Short description

2

2

4

This amendment specifies a way to indicate that the decoded video produced by the decoding process for an MPEG-2 Video bitstream contains a "frame-compatible" packed representation of two stereoscopic video views for 3D display.

Std

Pt

Amd

Req

Short description

2

2

1

12359

This amendment specifies a way to indicate that the decoded video produced by the decoding process for an MPEG-2 Video bitstream contains a "frame-compatible" packed representation of 3D stereoscopic video content using a side by side frame packing arrangement with quincunx sampling. It extends the prior specifications of other frame packing arrangements for 3D content.

Std

Pt

Amd

Req

Short description

4

10

1

Std

Pt

Amd

Req

Short description

4

16

2

The coding of 3D meshes utilizing a multi-resolution approach enables the progressive transmissions of static 3D objects, starting from a coarse mesh and adding details to reconstruct the mesh at higher resolutions. The main purpose is to enable the control of the reconstructed mesh resolution with respect to the conditions imposed by the transmission bandwidth, terminal characteristics and position of the object in the 3D scene. 

Std

Pt

Amd

Req

Short description

4

22

The advances in developing the Unicode Standard and the addition of new characters that represent most of the world's languages and writing systems resulted in a significant increase of the Unicode character repertoire to more than 100,000 characters. However, due to the finite size of many bitfields, the existing ISO/IEC 14496-22:2009 specification only provides the capabilities for a single font to support up to 64K glyphs. The Composite Font Standard is intended to resolve the existing limitation by providing a solution that would allow linking of existing OFF fonts (and, possibly, fonts in other formats) into a single Composite Font to be used as a virtual font by any compliant implementation.

Std

Pt

Amd

Req

Short description

4

22

2

The amendment introduces new script tags to address the changes that were recently added in Unicode 5.2 and Unicode 6.0 standards. It also includes new language tags in accordance with ISO 639/3, and updates and clarifications for different parts of the Open Font Format specification, including the definition of the MIME type for OFF format and its subsets.

Std

Pt

Amd

Req

Short description

WVC coding aims to deliver a video coding standard based on royalty-free technology with a performance similar to AVC Baseline Profile

Std

Pt

Amd

Req

Short description

21

20

1^st E

The Contract Expression Language specifies a language for representing agreements made in an environment of use of MPEG-21, being these contracts about both transactions of content packed as Digital Items as well as services provided around this content

Std

Pt

Amd

Req

Short description

B

4

This amendment contains a precise specification of the RVC computation model, RVC-CAL I/O extended support, definition of typing rules for large number arithmetic and (non-normative) definition of Functional Unit dataflow classes, classification rules and methods.

Std

Pt

Amd

Req

Short description

C

4

Reconfigurable Graphics Coding (RGC) is borrowing the essential idea of the RVC framework that is a dynamic dataflow mechanism of constructing new video codecs by a collection of video coding tools from video tool libraries. The difference is here that RGC deals with graphics, therefore its goal is to set up the collection of graphics tool library.

Std

Pt

Amd

Req

Short description

V

2

Specifies syntax and semantics of the tools required to provide interoperability in controlling devices in real as well as virtual world. The scope of this Part of the standard covers the interfaces between the adaptation engine and the capability descriptions of actuators (sensory devices)/sensors (SDC/SC) in the real world and the user’s sensory preference information (USEP), which characterizes devices and users, so that appropriate information to control individual devices (actuators and sensors) for individual users can be generated. In other words, user’s sensory effect preferences, sensory device capabilities, and sensor capabilities are within the scope of this Part of the standard. These tools are defined in this Part of the standard using XML Schema. The overall structure of the tools are organized and defined by specifying Control Information Description Language (CIDL). The CIDL enables the instantiation of three types of descriptions. The actual descriptions (sensory device capabilities, sensor capabilities, and user’s sensory effect preferences) are not part of CIDL, but defined as the Device Capability Description Vocabulary (DCDV), Sensor Capability Description Vocabulary (SCDV), and User’s Sensory Effect Preference Vocabulary (SEPV), respectively.

Std

Pt

Amd

Req

Short description

V

3

To enhance the experience of users while consuming media resources by stimulate also other senses than vision or audition, e.g., olfaction, mechanoreception, equilibrioception, thermo(re)ception, or proprioception. That is, in addition to the audio-visual content of, e.g., a movie, also other sense shall be stimulated giving her/him the sensation of being part of the particular media which shall result in a worthwhile, informative user experience. This motivates the annotation of the media resources with metadata as defined in this part of ISO/IEC 23005 that steers appropriate devices capable of stimulating these other senses.

Std

Pt

Amd

Req

Short description

V

4

The scope of MPEG-V Part 4 - Virtual World Object Characteristics is to standardize a set of types used to characterize a virtual world object related metadata, making possible to migrate a virtual object or its characteristics from one virtual world to another and control a virtual world object in a virtual world by real word devices. A dedicated set of tools are standardized for avatars characteristics.

Std

Pt

Amd

Req

Short description

V

5

10990

Specifies syntax and semantics of the data formats for interaction devices, Device Commands and Sensed Information, required for providing interoperability in controlling and sensing interaction devices. The interaction devices include both actuators and sensors to provide a wide range of interaction capabilities in real as well as virtual world.

Std

Pt

Amd

Req

Short description

V

6

Specifies syntax and semantics of the datatypes and tools common to the tools defined in other parts of ISO/IEC 23005. To be specific, basic data types which are used as basic building blocks in more than one tools of ISO/IEC 23005, color-related basic types which are used in light and color related tools to help specifying color related characteristics of the devices or commands, and time stamp types which can be used in device commands and sensed informations to specify timing related information. Also several classification schemes which are used in more than one parts of ISO/IEC 23005 are defined in the annex of this part. Other tools to be developed shall be included in this part of ISO/IEC 23005, if those tools are to be commonly used with more than one tool which are defined in different parts of ISO/IEC 23005. Please note that most of the tools defined  in this part are not intended to be used alone, but to be used as a part or as a supporting tool of other tools defined in other part of ISO/IEC 23005.

Std

Pt

Amd

Req

Short description

The overall amount of video data rate that is to be transferred over networks will continue to grow at a very fast pace, driven by the increased number of services and users and the increasing resolution of video from SD to HD and beyond.

High-efficiency video coding (HEVC) is the next generation of video compression technology that will have clearly higher compression capability than the existing AVC standard in its dominant configuration, the High Profile. The HEVC standard will support all commonly used progressive scan picture formats, ranging at least from QVGA (320x240) to Ultra HD resolutions such as 8Kx4K, as well as picture formats of arbitrary size.

Std

Pt

Amd

Req

Short description

H

3

1E

This is an exploration of the role that MPEG audio standardization can play in two emerging trends in multi-media. The first is "3-D Audio" in which there may be many loudspeakers used in the audio presentation. Issues being explored are how to automatically adapt audio program material to the target number of loudspeakers in a given consumer's listening venue.  The second is "Audio for new video presentation" in which the video will very high resolution (as in MPEG HEVC). This would permit a closer viewing distance such that the user is within the audio near field. Issues being explored are how the audio presentation (i.e. number and position of loudspeakers) can enhance sound source localization and the sense of immersiveness. Both large "home theatre" and smaller portable audio-visual presenations are being considered.

Std

Pt

Amd

Req

Short description

3D video (3DV) supports new types of audio-visual systems that allow users to view videos of the real 3D space from different user viewpoints.  In an advanced application of 3DV, denoted as Free-viewpoinT Video (FTV), a user can set the viewpoint to an almost arbitrary location and direction, which can be static, change abruptly, or vary continuously, within the limits that are given by the available camera setup. Similarly, the audio listening point is changed accordingly. 

The first phase of 3DV development is expected to support advanced 3D displays, where M dense views must be generated from a sparse set of K transmitted views (typically K£3) with associated depth data. The allowable range of view synthesis will be relatively narrow (20 degrees view angle from leftmost to rightmost view).

Std

Pt

Amd

Req

Short description

Std

Pt

Amd

Req

Short description

?

?

1^st Ed

Std

Pt

Amd

Req

Short description

?

?

1^st Ed

Std

Pt

Amd

Req

Short description

4

11

4

The Widgets Extensions amendment of 23007-1 contains a small set of extensions coming from early implementation experience. The protocol for widget migration has been defined to ensure the interoperability of widget managers sharing the same service protocol. The possibility to migrate a widget to multiple other widget managers has been added. A simple capabilities exchange mechanism has been added for a widget manager to be able to migrate the appropriate version of a widget to another widget manager.

Std

Pt

Amd

Req

Short description

4

20

4

Specifies advanced user interaction interfaces to support various advanced user interaction devices such as a multi-point interaction device. A mapping mechanism needed to utilize ISO/IEC 23005-5 Data Formats for Interaction Devices in ISO/IEC 23007 is provided in this part. Additional interfaces accommodating Advanced User Interaction that can be utilized by ISO/IEC 23007-1 and ISO/IEC 14496-20 are provided.

Std

Pt

Amd

Req

Short description

4

11

The AVDP profile is proposed as a common metadata format for generating and exchanging information from automatic metadata extraction tools (e.g. speech to text, scene detection, etc.). This standardised metadata will be used as a reference format when such tools are implemented and integrated as web services in future production file-based SOA architectures.

Std

Pt

Amd

Req

Short description

7

1^st Ed

Relating contents of images with databases requires to describe the images and match the description of the image to the one available in the database. This activity strives to create compact descriptors that allow for efficient search of images in databases.

Std

Pt

Amd

Req

Short description

7

5

4

Std

Pt

Amd

Req

Short description

7

9

1

The AVDP profile is defined as a common metadata format for generating and exchanging information from automatic metadata extraction tools (e.g. speech to text, scene detection, etc.). This standardised metadata will be used as a reference format when such tools are implemented and integrated as web services in future production file-based SOA architectures.

Std

Pt

Amd

Req

Short description

?

?

1^st Ed

Std

Pt

Amd

Req

Short description

4

24

1

Amendment 1 to this Technical Report demonstrates the interaction between MPEG-4 Systems and MPEG-D USAC, which can be carried in an

MPEG-4 File Format. A very notable benefit documented in the TR is that an MP4-FF edit list can be used with USAC to insure that an exact, finite-duration segment of decoded waveform is produced. This has application in WAV to MP4-FF to WAV encoding/decoding situations such that the decoded WAV file is the exact time segment as the original WAV file.

Std

Pt

Amd

Req

Short description

B

7

This format defines a way to encrypt media (audio, video, etc.) in files of the ISO base media file format family. By using a common encryption format, a single media asset can be used by several services and devices using different digital rights management systems, and the implementation complexity that would be consequent on having duplicate files and formats for the same content can be reduced or eliminated. 

Std

Pt

Amd

Req

Short description

21

3

2

As the social character of the Web grows stronger, online multimedia resources become more tangled, exhibiting multiple and complex relationships. Often, these relationships are not easily spotted by search engines because they are not explicit. The proposed extension to MPEG-21, which enables it to support a uniform, semantically expressive and precise specification of the relationships between MPEG-21 digital items, renders it a much more effective tool for a ubiquitous representation and interconnection of digital resources.

Std

Pt

Amd

Req

Short description

2

1

9

12264

MPEG transport did not specify a profile as all the capabilities were signaled using the relevant bits in the headers. The recent development of streaming standards required signaling of a transport profile where some capabilities were limited. Second, stereoscopic MVC specifications did not associate the views with left or right eye display. This amendment specifies signaling of 'transport profiles' and extends the MVC descriptor to signal view to eye association. The amendment also includes an Annex to list the current mime types being used in various applications.

Std

Pt

Amd

Req

Short description

2

1

8

Currently multimedia services based on ISO/IEC-14496-1 and ISO/IEC 14496-11 technologies cannot be played by ISO/IEC-14496-1 unaware players, in a backward compatible manner, even if the service uses video or audio components formats playable. Additionally, the carriage of ISO/IEC-14496-1 services over ISO/IEC 13818-1 uses, in some cases, inefficient signalling. This amendment to ISO/IEC 13818- provides mechanisms to use media components in backward compatible manner and improves the delivery efficiency of ISO/IEC-14496-1 multimedia services.

Std

Pt

Amd

Req

Short description

4

3

Std

Pt

Amd

Req

Short description

DASH

3

1^st Ed

This technical report contains a set of guidelines for design and deployment of streaming media delivery systems using ISO/IEC 23009 (MPEG-DASH) standard.  This includes guidelines for content generation, guidelines for client implementation, and examples of deployment scenarios.  

Std

Pt

Amd

Req

Short description

?

?

?

?

In order to overcome current limitations of available standards in the area of media streaming, the development of a media aware client is envisioned in line with the MPEG philosophy of concentrating the work on the media client. Possible topics of work are:

·       Transport- and file format friendly stream format

·       Cross layer optimization between video and transport layer

·       Error resilience for MPEG streams,

·       Conversion between transport mechanisms

·       Content adaptation to different networks.

Std

Pt

Amd

Req

Short description

M

1

2E

ISO/IEC 23006 or MPEG-M is a suite of standards on Multimedia Service Platform Technologies developed for the purpose of enabling the easy design and implementation of media-handling value chains whose devices interoperate because they are all based on the same set of technologies, especially technologies standardised by MPEG, accessible from the middleware and multimedia services.

This part of ISO/IEC 23006 specifies the architecture of the Service Oriented Architecture character that is made accessible through the set of MPEG-M middleware APIs (MPEG-M part 2), elementary services (MPEG-M part 4) and service aggregation (MPEG-M part 5).

Std

Pt

Amd

Req

Short description

M

2

2E

This part of MXM specifies a set of Application Programming Interfaces (APIs) so that MXM Applications executing on an MXM Device can access the standard multimedia technologies contained in its Middleware as MXM Engines, as specified by part 1 of MXM.

The APIs belong to two classes

—       The MXM Orchestrator API, i.e. the API of the special MXM Engine that is capable of creating chains of MXM engines to execute a high-level application call such as Play, as opposed to the typically low-level MXM Engine API calls

—       The MXM Engine APIs, i.e. the collection of the individual MXM Engine APIs providing access to a single MPEG technology (e.g. video coding) or to a group of MPEG technologies where this is convenient

—       The MXM Service APIs, i.e. the collection of the individual MXM Engine APIs

Std

Pt

Amd

Req

Short description

M

4

2E

This part of MPEG-M specifies a set of Elementary Services and respective protocols enabling distributed applications to exchange information related to content items and parts thereof, including rights and protection information. The second edition conserves the architecture and design philosophy of the first edition, but stressing the Service Oriented Architecture character. Also, this second edition has been specified to address the demand of service specification for advanced IPTV terminals.

Std

Pt

Amd

Req

Short description

M

5

1E

This part of MPEG-M specifies the technology enabling the combination of Elementary Services to build Aggregated Services. The workflow definitions of Services are represented by the BPMN 2.0 XML format, allowing for formal descriptions of the workflows of Aggregated Services, and consequently enabling the implementation automated tools for Service aggregation..

Std

Pt

Amd

Req

Short description

M

6

1E

This part of MPEG-M

Std

Pt

Amd

Req

Short description

V

1

2^nd Ed

MPEG-V (Media context and control) provides an architecture and specifies associated information representations to enable interoperability between

·       virtual worlds, e.g., digital content provider of a virtual world, (serious) gaming, simulation, and

·       real and virtual worlds e.g., sensors, actuators, vision and rendering, robotics.

The MPEG-V Part 1 specifies the Architecture of MPEG-V by specifying the components, APIs and use cases.

Std

Pt

Amd

Req

Short description

A

10

2^nd E

A packaging format designed for the storage of video and audio content originating from surveillance cameras and microphones. It packages the media content together with associated metadata by using the appropriate file format definitions e.g. AVC file format.

Std

Pt

Amd

Req

Short description

A

6

2

Support for larger number of files

Std

Pt

Amd

Req

Short description

A

11

3

Stereoscopic Video AF (SVAF) provides information about composition type and transition between 2D and 3D view. This amendment is to provide a further investigation of said information in terms of movie fregment level in order to enable delivery of SVAF content over DASH.

Std

Pt

Amd

Req

Short description

Augmented reality applications refer to a live view of a real-world environment whose elements are augmented by computer-generated content, such as sound or graphics.

Using MPEG technologies it is possible to design a generic AR browser. Instead of downloading a new and heavy application for every context, users could simply point to a URL. The browser would retrieve a scenario from the internet, start the video acquisition, track objects, recognize few of them from visual signatures, recover the camera pose, download 3D graphics, compose a new scene, get inputs from various sensors, and constantly adapt the interaction possibilities and objects from a remote server to offer an optimal AR experience. Instead of developing a new application for each use case and smart-phone platform, the industry could rely on MPEG-compliant authoring tools, and MPEG-compliant browsers to reach the maximum number of customers.

Std

Pt

Amd

Req

Short description

4

5

31

Provides a reference implementation of Efficient representation of 3D meshes as defined in ISO/IEC 14496-16 AMD1.

Std

Pt

Amd

Req

Short description

4

5

32

12417

Provides a reference implementation of.

Std

Pt

Amd

Req

Short description

7

9

1

xxx

Std

Pt

Amd

Req

Short description

B

6

Reference Software for DASH

Std

Pt

Amd

Req

Short description

C

4

1

This work provides VTL conformance testing and RVC simulation model (RSM).

VTL conformance testing comprises of input/output patterns that can be used for testing FU-level conformance. The FU conformance testing is compliant to the VTL standard (ISO/IEC 23002-4:2010). RSM is the reference implementation of RVC framework defined from ISO/IEC 23001-4:2010 and ISO/IEC 23002-4:2010

Std

Pt

Amd

Req

Short description

D

2

2

Std

Pt

Amd

Req

Short description

D

2

2

Std

Pt

Amd

Req

Short description

D

2

2

Std

Pt

Amd

Req

Short description

D

2

2

Std

Pt

Amd

Req

Short description

M

3

2E

Reference Software for MXM/AIT

Std

Pt

Amd

Req

Short description

V

5

Provides the reference implementation of the XML and binary version of MPEG-V types

Std

Pt

Amd

Req

Short description

4

27

4

Provides the conformance data set for Efficient representation of 3D meshes as defined in ISO/IEC 14496-16 AMD1.

Std

Pt

Amd

Req

Short description

4

27

5

12420

Provides the conformance data set for Efficient representation of.

Std

Pt

Amd

Req

Short description

C

4

1

This work provides VTL conformance testing and RVC simulation model (RSM).

VTL conformance testing comprises of input/output patterns that can be used for testing FU-level conformance. The FU conformance testing is compliant to the VTL standard (ISO/IEC 23002-4:2010). RSM is the reference implementation of RVC framework defined from ISO/IEC 23001-4:2010 and ISO/IEC 23002-4:2010

Std

Pt

Amd

Req

Short description

D

2

1

Std

Pt

Amd

Req

Short description

D

2

2

Std

Pt

Amd

Req

Short description

D

2

2

Std

Pt

Amd

Req

Short description

M

3

This part of MXM specifies the conformance tests for MXM applications, devices, and components.

Std

Pt

Amd

Req

Short description

V

4

Provides the conformance of the XML and binary version of MPEG-V types.

Std

Pt

Cor

Req

Short description

2

2

3

Correction for field pictures

Std

Pt

Cor

Req

Short description

4

2

3

Correction of two small bugs in studio profiles

4

10

1

Correction of a set of small bugs and typos in the 200x edition (including SVC)

Std

Pt

Cor

Req

Short description

Std

Pt

Cor

Req

Short description

4

16

Std

Pt

Cor

Req

Short description

7

12

xxx

Std

Pt

Cor

Req

Short description

7

3

xxx

Std

Pt

Cor

Req

Short description

Std

Pt

Cor

Req

Short description

21

xxx

Std

Pt

Cor

Req

Short description

A

MPEG-A provides the framework such as a file format for integration of elements from several MPEG standards into a single specification that is suitable for specific but widely usable applications. Typically, MPEG-A specifies how to combine metadata with timed media information for a presentation in a well-defined format that facilitates interchange, management, editing, and presentation of the media.