Video Quality Experts Group (VQEG)

Audiovisual HD

Audiovisual HD Quality (AVHD)

The AVHD group investigates improved subjective and objective methods for analyzing commonly available video systems. AVHD examines both video-only and audiovisual quality. Currently work includes:

  • QoE Metrics for Live Video Streaming Applications (Live QoE)
  • Advanced Subjective Methods (AVHD-SUB)

Conference Calls

The AVHD audio call connection information and schedule appears on the VQEG home page.

#1) QoE Metrics for Live Video Streaming Applications (Live QoE)

The success of a live multimedia streaming session is defined by the experience of a participating audience. Both the content communicated by the media and the quality at which it is delivered matter - for the same content, the quality delivered to the viewer is a differentiating factor. Live media streaming systems undertake a lot of investment and operate under very tight service availability and latency constraints to support multimedia sessions for their audience. Both to measure the return on investment and to make sound investment decisions, it is paramount that we be able to measure the media quality offered by these systems.”.

The detailed project proposal is available here.

Minutes are available here.

Questions related to this sub-project should be sent to Shahid Satti and Rohit Puri.

#2) Advanced Subjective Methods (AVHD-SUB) Project

The AVHD group investigates improved audiovisual subjective quality testing methods. This effort may lead to a revision of ITU-T Rec. P.911. Presentations on this topic are encouraged at all VQEG meetings.

Novel Scene Experiment Design Validation 

The AVHD group has begun investigation into alternative experiment designs for subjective tests. This goal is to validate subjective testing of long video sequences that are only viewed once by each subject. Adaptive streaming requires the use of long video sequences (e.g., 5 min). This prohibits the traditional full matrix design where each source scene is viewed 10 to 25 times.

For more information, see:

Lucjan Janowski; Ludovic Malfait; Margaret H. Pinson, "Evaluating experiment design with unrepeated scenes for video quality subjective assessment," Quality and User Experience, 4, 2 (2019)

To get involved, contact Lucjan Janowski and Margaret Pinson.

Subjective Test Environment (finished)

The AVHD group conducted a joint investigation into the impact of environment on mean opinion scores (MOS). The results of that study were published in the following paper:

"The Influence of Subjects and Environment on Audiovisual Subjective Tests: An International Study," IEEE Journal of Selected Topics in Signal Processing, Vol. 6, No. 6, October 2012, pp. 640-651.

Margaret H. Pinson, Lucjan Janowski, Romuald Pépion, Quan Huynh-Thu, Christian Schmidmer, Phillip Corriveau, Audrey Younkin, Patrick Le Callet, Marcus Barkowsky, and William Ingram