Comparison of adaptive psychometric procedures motivated by the theory of optimal experiments: simulated and experimental results.

Abstract

The wide use of psychometric assessments and the time necessary to conduct comprehensive psychometric tests has motivated significant research into the development of psychometric testing procedures that will provide accurate and efficient estimates of the parameters of interest. One potential framework for developing adaptive psychometric procedures is the Theory of Optimal Experiments. The Theory of Optimal Experiments provides several metrics for determining informative stimulus values based on a model of the psychometric function to be provided by the investigator. In this study, two methods based on a previous implementation of the Theory of Optimal Experiments are presented for comparison to two fixed step size staircase methods and also an existing adaptive method that utilizes a Bayesian framework. The psychometric procedures were used to measure detection thresholds and discrimination limens on two separate psychoacoustic tasks with normal-hearing subjects. Computer simulations were performed based on the outcomes of the experimental psychoacoustic detection task to analyze performance over a large sample size in the case of known truth. Results suggest that the proposed stimulus selection rules motivated by the Theory of Optimal Experiments perform better than previous techniques and also extend estimation to multiple parameters.

DOI
10.1121/1.2816567
Year