Video Quality Experts Group (VQEG)

Statistical Analysis Methods (SAM)


Improve analysis methods and understanding of subjective experiments.

Improve the statistical analysis of objective media quality predictors/models.

Working Methods

We have biweekly conference calls on Monday at 17:00 CET. The actions and minutes from those meetings can be found in this document. Please check the document to validate when is the next call and what software is used to call in. Zhi took the time to prepare a github repo where he deposited his code (in Python) - here is the link:



The SAM group addresses problems related to how to better analyze and improve data quality coming from subjective experiments and how to consider uncertainty in objective media quality predictors/models development.

The long-term goals are:

The mid-term goals are:

The short-term goals are:

Uniform JSON-based Subjective Data Format

Here is the repository with tools for the suJSON format. The format's name expands to "A Uniform JSON-based Subjective Data Format". Its main goal is to make it easier to store, exchange and analyze subjective data gathered in any type of subjective testing.

The repository contains a source code of a set of tools. All are aiming at automating some basic data conversion tasks (from and into suJSON). It is also a place for discussions so please do not hesitate to visit and leave a comment.

For a brief introduction to the concept, you are encouraged to go through this presentation.

VQEG is Co-Chaired by: Margaret Pinson, NTIA/ITS and Kjell Brunnström, RISE Research Institute of Sweden AB
The VQEG website is hosted by ITS.Click here to contact the VQEG webmaster.