VQEG Logo

Video Quality Experts Group (VQEG)

Publications and Software

VQEG Downloads

VQEG Tools and Subjective Labs Setup

The main goal of the VQEG Tools and Subjective Labs Setup support group is to provide the research community with a wide variety of software tools and guidance in order to facilitate video quality research.

Publications and Other Documents

Select this link to access other VQEG publications and files, or scroll down to the end of this section. Available files include old T1A1 Contributions and various VQEG files (i.e., eLetters, Progress Reports, project archives, and validation tests). If you have questions about these documents, please reach out to Margaret Pinson

VQEG Reports from Completed Validation Tests

VQEG has completed the following validation tests of objective video quality models. Each test involved a group of proponents who submitted models for evaluation. The independent lab group (ILG) implemented the test and ensured a fair and unbiased evaluation of models.

Where possible, the videos and individual subject ratings from these validation tests are made available on the Consumer Digital Video Library (CDVL, www.cdvl.org), for research and development purposes. Some VQEG datasets cannot be redistributed due to licensing restrictions on the source content.

  • AVHD-AS/P.NATS Phase 2 was a joint project of VQEG and ITU-T Study Group 12 Question 14. The goal was to develop a multitude of objective models, varying in terms of complexity/type of input/use-cases for the assessment of video quality in adaptive bitrate streaming services over reliable transport up to 4K. For more information, see the AVHD project page.
  • Hybrid Perceptual Bitstream (Hybrid) examined the performance of Hybrid models for VGA/WVGA and HDTV, using ACR-HR. Ten datasets were created. The test plan, final report, and status of ITU Recommendations are available on the Hybrid project page.
  • High Definition Television (HDTV) examined the performance of FR, RR and NR models for HDTV, using ACR-HR. Six datasets were created, five of which can be redistributed for research and development purposes. The test plan, final report, video sequences, and resulting ITU Recommendations are available on the HDTV Phase I project page.
  • Reduced Reference/No Reference Television (RRNR-TV) examined the performance of RR and NR models on standard definition video, using ACR-HR. Two datasets were created: 525-line (NTSC) and 625-line (PAL) video. The test plan, final report, and resulting ITU Recommendations are available on the RRNR-TV project page.
  • Multimedia (MM) Phase I examined the performance of FR, RR and NR models for VGA, CIF and QCIF video (no audio), using ACR-HR. 41 datasets were created, none of which can be redistributed. The test plan, final report and resulting ITU Recommendations are available on the Multimedia Phase I project page.
  • Full Reference Television (FRTV) Phase II examined the performance of FR and NR models on standard definition video, using the DSCQS methodology. Two datasets were created: 525-line (NTSC) and 625-line (PAL) video. The test plan, final report, and resulting ITU Recommendations are available on the FR-TV Phase II project page. The video sequences cannot be distributed due to licensing restrictions.
  • Full Reference Television (FRTV) Phase I examined the performance of FR and NR models on standard definition video, using the DSCQS methodology. Four datasets were created: high quality and medium quality, for both 525-line (NTSC) and 625-line (PAL) video. Models were difficult to distinguish due to the narrow range of quality in each dataset. The test plan, final report, and video sequences are available on the FR-TV Phase I project project page.