Terms of Reference

1 Title

Coding of Moving Pictures and Audio

2 Area of work

Development of international standards for compression, decompression, processing, and coded representation of moving pictures, audio, and their combination, in order to satisfy a wide variety of applications.

3 Programme of work

Serve as responsible body within ISO/IEC for recommending a set of standards consistent with the Area of Work:

• Efficient coding and compression of digital representations of light and sound fields, e.g.:
  • Conventional moving pictures (natural and computer-generated),
  • Multiview moving pictures
  • Immersive moving pictures (e.g. volumetric, light field, holographic)
  • Static and dynamic graphic objects (e.g. surfaces, point clouds)
  • Conventional Mono/Stereo/Multichannel audio
  • Immersive audio (e.g. spatial and sound fields)
• Efficient coding and compression of other digital data e.g.:
  • Media-related metadata (e.g. for search and annotation applications)
  • Sensor and actuator data (e.g. Haptic, Olfactory)
  • Context data (e.g. user, environment)
  • Genomics data
  • Graphs (e.g. neural networks)
• Support to digital information coding and compression, e.g.:
  • Media synchronization mechanisms
  • Multimedia storage and transport
  • Media presentation
  • Interaction data (e.g. multimodal)
  • Support for content management and protection, and privacy
  • System configuration support
  • Application-specific media combinations
  • Quality of Experience evaluation protocols and metrics
  • System performance metrics

4 Projects

ISO#	JTC1.29#	MPEG#	Title
11172	05.01	1	Coding of moving pictures and associated audio at up to about 1.5 Mbit/s
13818	05.02	2	Generic coding of moving pictures and associated audio
14496	13	4	Coding of audio-visual objects
15938	15	7	Multimedia Content Description Interface
21000	17	21	Multimedia Framework
23000	18	A	Multimedia Application Formats
23001	21	B	MPEG Systems Technologies
23002	22	C	MPEG Video Technologies
23003	23	D	MPEG Audio Technologies
23004	24	E	MPEG Multimedia Middleware
23005	27	V	Media Context and Control
23006	29	M	Multimedia Service Platform Technologies
23007	30	U	MPEG Rich Media User Interface
23008	32	H	High Efficiency Coding and Media Delivery in Heterogeneous Environments
23009	31	DASH	Dynamic Adaptive Streaming over HTTP
23090		I	Coded representation of immersive media
23091		CICP	Coding-Independent Code-Points
23092		G	Genomic Information Representation
23092		IoMT	Internet of Media Things
18039		MAR	Mixed and Augmented Reality Reference Model
29216	25		Supplementary Media Technologies

5 Secretariat

UNINFO (Italy)

6 Structure

WG 11		Convenor	Leonardo Chiariglione	IT
	MPEG-Requirements	Chair	Jörn Ostermann	DE
	MPEG-Systems	Chair	Young-Kwon Lim	KR
	MPEG-Video	Chair	Lu Yu	CN
	MPEG-Audio	Chair	Schuyler Quackenbush	US
	MPEG-3DGC	Chair	Marius Preda	FR
	MPEG-Test	Chair	Vittorio Baroncini	IT
	MPEG-Communication	Chair	Kyuheon Kim	KR
	JCT on Video Coding	Chair	Jens-Rainer Ohm	DE
		Chair	Gary Sullivan	US
	Joint Video Experts Team (JVET)	Chair	Jens-Rainer Ohm	DE
		Chair	Gary Sullivan	US

7 Terms of Reference of Experts Groups

7.1 MPEG-Requirements

Name: Requirements

Title: Requirements studies for MPEG standards.

Area of work: Studies with the purpose of making sure that requirements coming from the prospective applications and application areas of the generic coding algorithms developed by WG11 are taken in due consideration in all phases of the work.

Programme of work

• Collect and organise requirements, generic as well as specifically coming from the different application fields
• Identify the need of technologies not currently being considered by WG11 subgroups
• Produce a requirement definition document prior to specification phase
• Constantly update requirements definitions following arising needs coming from application areas
• Monitor the conformance of the specifications under development with the requirements
• Develop profiling solutions to address relevant classes of applications for MPEG standards
• Assist in the development of MPEG standards
• Liaise with other standard bodies in the field of requirements

7.2 MPEG-Systems

Name: Systems

Title: Coded Representation of Delivery Protocols and Formats, of Presentation Information, and of Schemes for Declaring and Describing Multimedia Content Data Structures and Related Information

Area of Work

• Development of international standards enabling the carriage of multimedia content and related information on specific delivery mechanisms, jointly with the respective standards bodies that develop these delivery mechanisms such as:
  • Carriage on MPEG-2 Systems
  • Carriage over Internet Protocols
  • Carriage by ISO File Format
• Development of international standards enabling the presentation of a combination of coded media such as text, images, graphics, audio, moving images, immersive media and related information.
• Development of international standards for schemes that declare and describe digital items, multimedia content data structures and related information, enabling creation, exchange, distribution, transaction, storage, search, retrieval, browsing and filtering of digital items and multimedia content.
• Development of international standards enabling management of intellectual property rights and carriage of information related to it.
• Development of digital representation of common to all media types and media types does not belong to other groups

Programme of work:

• Serve as responsible body within ISO/IEC for recommending a set of standards consistent with the area of work;
• Consider requirements for its areas of work;
• Develop architecture within the scope of work to satisfy these requirements;
• Develop standards within the scope of work;
• Cooperate with other standardisation bodies dealing with similar applications;
• Test and validate the effective, efficient and extensible operation of the developed standards;
• Verify the overall end-to-end operation e.g., with walkthroughs to ensure consistency;
• Perform explorations w.r.t. new technology trend areas within the scope of work

7.3 MPEG-Video

Name: Video

Title: Coding of moving image information, evaluation of coding systems and content description schemes related to visual information, complexity and implementation feasibility analysis for visual information coding systems and content description schemes.

Area of Work

Development of international standards for coded digital representation of light fields and associated metadata. The evaluation of coding techniques and description schemes is performed based on their performance (both objectively and by formal subjective testing), efficiency with respect to software implementation, VLSI (programmable & dedicated) implementation and feasibility of systems architectures.

Programme of Work

• Serve as responsible body within ISO/IEC for recommending a set of standards consistent with the area of work;
• Cooperate with other standardisation bodies dealing with similar applications;
• Consider requirements for interworking with picture coding algorithms defined by other working groups of SC 29 and other standardisation bodies;
• Define relevant input moving image material and output moving image devices;
• Develop and test efficient coding-decoding algorithms;
• Propose standards for coded digital representation of light fields and associated metadata;
• Develop methods for the subjective assessment of moving pictures bearing in mind the related activities of other standards making bodies, and cooperating with them
• Define and produce test source material;
• Organize subjective assessment tests for the quality of moving pictures;
• Establish performance analysis criteria;
• Carry out performance analysis by core experimentation procedures;
• Establish complexity analysis criteria;
• Perform complexity analysis for representative sets of tools and algorithms;
• Solicit inputs from and engage in liaison with external bodies;
• Perform explorations w.r.t. new technology trend areas within the scope of work.

7.4 MPEG-Audio

Name: Audio

Title: Coding of Audio Information

Area of Work

Development of international standards for coded digital representation of sound fields and associated metadata.

Programme of Work

• Serve as responsible body within ISO/IEC for recommending a set of standards consistent with the area of work;
• Cooperate with other standardisation bodies dealing with similar applications;
• Define relevant input audio material;
• Develop efficient audio encoding-decoding algorithms;
• Identify metadata to describe properties of audio signals and algorithms to extract this metadata;
• Develop algorithms for and metadata to facilitate high-quality audio rendering for presentation;
• Propose standards for the coded representation of audio information;
• Propose standards for the coded representation of audio metadata;
• Propose standards for the coded representation of audio metadata and audio rendering information;
• Assess complexity of audio coding-decoding algorithms;
• Define, organize and conduct subjective assessment tests that assess the quality of audio coding-decoding algorithms;
• Solicit inputs from and engage in liaison with external bodies;
• Perform explorations of possible new technology within the scope of work.

7.5 MPEG-3DGC

Name: 3D Graphics Coding

Title: Coding of 3D graphics primitives for static and animated objects, coding of data for 3D graphics environments and integration of them with natural audio and video information.

Area of work

Development of standards for 3D Graphics Coding

Programme of work

• Serve as responsible body within ISO/IEC for recommending a set of standards consistent with the area of work;
• Cooperate with other standardisation bodies dealing with similar applications;
• Consider requirements for inter-working with other 3D graphics coding approaches defined by other working groups of ISO and other standardisation bodies;
• Develop and test efficient coding-decoding algorithms;
• Propose standards for the coded representation of 3D graphics information and associated metadata;
• Define relevant input 3D graphics material;
• Define and produce test source material;
• Provide source code implementation for proposed standards;
• Establishment of performance analysis criteria;
• Performance analysis by core experimentation procedures;
• Establishment of complexity analysis criteria;
• Perform complexity analysis for representative sets of tools and algorithms;
• Solicit inputs from and engage in liaison with external bodies :
  • Technology trend information sources,
  • Other "standards bodies " and consensus forming bodies;
• Perform explorations with respect to new technology trend areas within the scope of work. 

7.6 MPEG-Test

Name: Test

Title: Evaluation of Audio-Visual Information Coding.

Area of Work

Development of methods for and the execution of subjective assessment tests of the quality of coded audio and moving pictures both individually and combined.

Programme of work:

• Serve as responsible body within ISO/IEC for recommending standard test procedures consistent with the area of work;
• Cooperate with other standardisation bodies dealing with similar subjective tests;
• Consider requirements for interworking with telecommunication and broadcasting tests procedure;
• Develop methods for the subjective assessment of audio bearing in mind the related activities of other standards making bodies;
• Develop methods for the subjective assessment of moving pictures bearing in mind the related activities of other standards making bodies;
• Develop methods for the subjective assessment of combined audio and moving pictures bearing in mind the related activities of other standards making bodies;
• Define and produce test source material;
• Execute subjective assessment tests for the quality of audio in cooperation with other standards making bodies;
• Execute subjective assessment tests for the quality of moving pictures in cooperation with other standards making bodies;
• Execute subjective assessment tests for the quality of combined audio and moving pictures in cooperation with other standards making bodies.

7.7 MPEG-Communication

Name: Communication

Title: Communication of MPEG matters to the industry.

Area of Work

Communication of MPEG plans, activities and results to the industry and the standard user community.

Programme of work:

• Collaborate with MPEG subgroups in reviewing the general communication aspects of MPEG standards (e.g. Introduction, Scope, illustrative figures);
• Collaborate with MPEG subgroups in developing material that illustrates the motivations, the nature and the benefits from the adoption of MPEG standards;
• Collaborate with MPEG subgroups in producing description of MPEG standards activities;
• Identify and organise, in collaboration with MPEG subgroups, internal workshops and seminars designed to promote understanding of MPEG activities and standards;
• Identify opportunities for and coordinate the production of technical papers related to MPEG activities and standards for submission to journals and conferences.

7.8 Joint Collaborative Team on Video Coding

See N11112

7.9 Joint Video Experts Team (JVET) for Video Coding Standard Development

See N17282