Proponents' proposal of the bugfixing procedure ================================================= Prior to the bugfixing procedure described in the test plan, the following steps will be performed: 1. Proponents write a bugfix description: a) source code before and after (lines) b) a description of the bug and the solution c) HRC's or databases affected 2. Reasonable statistics of the scores before and after: * histogram of difference * scatterplot (before versus after) 3. Proponents meet and review the proposed fixes. They will report their agreement or disagreement. The above will be reported to the ILGs. The idea is that an agreement among the proponents will make the decision of the ILG to accept bugfixes easier. For the VQEG Hybrid project, proponents met and discussed their proposed fixes (12/07/2013). All proponents agreed based on the bugfix description (1), that all the proposed fixes should be considered as bug fixes with no algorithm changes and therefore should be allowed. Statistics about the scores before and after (2) will be provided to the ILGs as soon as possible.