Second ISCA/DEGA Tutorial and Research Workshop on Perceptual Quality of Systems

Berlin, Germany
September 4-6, 2006

Comparison and Analysis of Listening Test Methods for Development of Perceptual Speech Quality Assessment

Shi-Han Chen, Shun-Ju Chen, Chih-Chung Kuo

Advanced Technology Center, ICL, ITRI, Hsinchu, Taiwan

Reliability of the listening test design has a great influence on the performance of the quality estimation model. In this paper we compare four different listening test designs by Monte Carlo simulation. Three common problems of interval scale ratings are included in the simulation, and their influences on the performance of estimating the underlying true quality are investigated. It turns out that in these methods, randomly choosing partial trials for Scaled Comparison could be the most reliable way to perform listening test under the influences of interval scale ratings problems.

Full Paper

Bibliographic reference.  Chen, Shi-Han / Chen, Shun-Ju / Kuo, Chih-Chung (2006): "Comparison and analysis of listening test methods for development of perceptual speech quality assessment", In PQS-2006, 79-84.