Cilia L.M. Witteman (Radboud University, the Netherlands),
Silja Renooij (Utrecht University, the Netherlands),
Pieter Koele (University of Amsterdam, the Netherlands) (2007).
Medicine in words and numbers: A cross-sectional survey comparing
probability assessment scales
Background
In the complex domain of medical decision making, reasoning under uncertainty
can benefit from supporting tools. Automated tools such as decision support
systems often build upon mathematical models, such as Bayesian networks.
These networks require probabilities which often have to be assessed by
experts in the domain of application. Probability response scales can be
used to support the assessment process. We compare assessments obtained
with different types of response scale.
Methods
General practitioners (GPs) gave assessments on and preferences for three
different probability response scales: a numerical scale, a scale with only
verbal labels, and a combined verbal-numerical scale we had designed ourselves.
Standard analyses of variance were performed.
Results
No differences in assessments over the three response scales were found.
Preferences for type of scale differed: the young and less experienced GPs
preferred the verbal scale, the senior and most experienced preferred the
numerical scale, with the groups in between having a preference for the
combined verbal-numerical scale.
Conclusions
We conclude that any of the three response scales is equally suitable for
supporting probability assessment. We advise that the combined verbal-numerical
scale is a good choice for aiding the process, since it offers numerical
labels for those who prefer numbers, while also offering verbal labels to
those who prefer words.