Quality assessment of immersive media, including virtual reality, augmented reality, stereoscopic 3DTV, and multiview.
Baseline quality assessment of today’s systems
- Using repurposed traditional content for virtual reality
- New content captured specifically for virtual reality, including 360 cameras and light field cameras
- Virtual reality gaming
Subjective test methods, presentation requirements, and quality of experience guidelines
Light field processing also called plenoptic (e.g., interactive refocusing, changing point-of-view)
Systems with and without feedback (in response to the viewer's actions):
- Viewpoint responsive (e.g., can look around a tree, virtual reality gaming)
- View direction responsive (e.g., can move your head)
- Non viewpoint responsive (e.g., traditional stereoscopic 3DTV)
Displays ranging from small devices to theater screens
Multiview technologies, including full parallax
1. VQEG Immersive Media Test Plan
The Immersive Media test is investigating the quality assessment of 360-degree video. The test plan can be found here.
2. Collaboration with ITU-T SG12, Question 13
A first draft of the proposal for collaboration between VQEG-IMG and ITU Q13/12: https://docs.google.com/document/d/1sJnb2ty1diOflXZgDSE-et9flSkctoTinNlJM9ZLuKQ/edit?usp=sharing
3. 3DTV Subjective Methods
Project lead: Marcus Barkowsky
The goal is to define suitable methodologies for subjective quality assessment of stereoscopic 3D video:
- A unique set of video sequences is being produced to conduct the experiments (GroTruQoE dataset).
- The first step will be to conduct a large-scale experiment using the pair-comparison methodology, as we are confident that subjects can provide easily a judgment of overall preference.
- Corresponding test plan is "Establishing a Ground Truth for Quality of Experience in 3D for assessment methodologies in 3D Video Quality Assessment" (GroTruQoE3D1). This document is available in the VQEG project archives.
- The second step will use the results of the pair-comparison testing as a groundtruth database to investigate which more time-efficient subjective testing methodology can be used to predict the results of the pair-comparison test.
This project was instrumental in the development of ITU Recommendations ITU-T Rec. P.914, P.915, and P.916.
MPEG AHG on Quality of Immersive Media
- Study existing solutions and solicit inputs related to the quality of immersive media.
- Review and document existing methods to assess human perception and reaction to immersive media stimuli.
- Study related activities within WG11 (e.g., OMAF, MIV, PCC, test/audio subgroup).
Chairmen: Christian Timmerer, Igor Curcio
Duration: Until the 131st MPEG meeting
Discussion on Gitlab
The immersive media group is the successor to the 3DTV group.