Immersive Media Group
Mission:
Quality assessment of immersive media, including virtual reality, augmented reality, stereoscopic 3DTV, and multiview.
Goals:
Baseline quality assessment of today’s systems
- Using repurposed traditional content for virtual reality
- New content captured specifically for virtual reality, including 360 cameras and light field cameras
- Virtual reality gaming
Subjective test methods, presentation requirements, and quality of experience guidelines
Technologies:
Light field processing also called plenoptic (e.g., interactive refocusing, changing point-of-view)
Systems with and without feedback (in response to the viewer's actions):
- Viewpoint responsive (e.g., can look around a tree, virtual reality gaming)
- View direction responsive (e.g., can move your head)
- Non viewpoint responsive (e.g., traditional stereoscopic 3DTV)
Displays ranging from small devices to theater screens
Multiview technologies, including full parallax
Projects:
1. VQEG Immersive Media Test Plan
The Immersive Media test is investigating the quality assessment of 360-degree video. The test plan can be found here.
2. Collaboration with ITU-T SG12, Question 13
A first draft of the proposal for collaboration between VQEG-IMG and ITU Q13/12: https://docs.google.com/document/d/1sJnb2ty1diOflXZgDSE-et9flSkctoTinNlJM9ZLuKQ/edit?usp=sharing
3. 3DTV Subjective Methods
Project lead: Marcus Barkowsky
The goal is to define suitable methodologies for subjective quality assessment of stereoscopic 3D video:
- A unique set of video sequences is being produced to conduct the experiments (GroTruQoE dataset).
- The first step will be to conduct a large-scale experiment using the pair-comparison methodology, as we are confident that subjects can provide easily a judgment of overall preference.
- Corresponding test plan is "Establishing a Ground Truth for Quality of Experience in 3D for assessment methodologies in 3D Video Quality Assessment" (GroTruQoE3D1). This document is available in the VQEG project archives.
- The second step will use the results of the pair-comparison testing as a groundtruth database to investigate which more time-efficient subjective testing methodology can be used to predict the results of the pair-comparison test.
This project was instrumental in the development of ITU Recommendations ITU-T Rec. P.914, P.915, and P.916.
Related Activity
MPEG AHG on Quality of Immersive Media
Mandates:
- Study existing solutions and solicit inputs related to the quality of immersive media.
- Review and document existing methods to assess human perception and reaction to immersive media stimuli.
- Study related activities within WG11 (e.g., OMAF, MIV, PCC, test/audio subgroup).
Chairmen: Christian Timmerer, Igor Curcio
Duration: Until the 131st MPEG meeting
Reflector(s): mpeg-i@lists.aau.at
Discussion on Gitlab
History:
The immersive media group is the successor to the 3DTV group.
Co-Chairs: Jesus Gutierrez and Zhenzhong Chen