MPEG-V Data formats for interaction devices
This Part of ISO/IEC 23005 specifies syntax and semantics of the data formats for interaction devices, i.e., Device Commands and Sensed Information, required for providing interoperability in controlling interaction devices and in sensing information from interaction devices in real as well as virtual world as depicted in Figure 1.
When this Part is used in the context of pure ISO/IEC 23005, the adaptation engine (RV or VR engine), which is not within the scope of standardization, performs bi-directional communications using data formats specified in this Part of the standard. The adaptation engine may also utilize other tools defined in ISO/IEC 23005-2, which are user’s sensory preferences, sensory devices capabilities, and sensor capabilities, for fine controls of devices in both real and virtual worlds.
On the other hand, the defined data formats (Sensed Information and Device Command) can be mapped to MPEG-U defined interfaces when this Part is utilized in the context of other standard such as MPEG-U Framework. For example, the interface shall be provided as ISO/IEC 23007-2 in the context of MPEG-U. Also defined Sensed Information can be used by scene representation specifications as input data formats for a scene. The Device Command data format can also be used as output data formats to communicate with outer world by mapping onto the interfaces defined in specific specifications.
This Part of the standard is composed as follows:
- A tool called Interaction Interface Description Language (IIDL) is defined to provide basic structure of the interface (or message) between a virtual world and devices (real world) using an XML schema;
- A set of tools called Device Command Vocabulary (DCV) is defined to provide interface for commanding devices (actuators) as part of IIDL;
- A set of tools called Sensed Information Vocabulary (SIV) is defined to provide interface for accepting information provided by sensors as part of IIDL.
Figure 1 — Scope of the Data formats for interaction devices