3.2.2 Computing the Combined Score (1)

Course subject(s) Module 3. Performance-based weights and the Decision Maker

You learned during the previous video about the combined score of an expert, which takes into account the calibration score as well as the information score

CS(e)=Cal(e)*Inf(e)

Recall that the information score is the average over the information scores of all calibration questions.

Also, recall the ending discussion of the previous module, about the preference of the calibration score over the information score.

The combined score actually accounts for this preference! You can check it yourselves!  Consider

Expert 1,  for whom the assessments result in a very small calibration score, say 0.0003 and a sufficiently large information score, say 3.5.
Expert 2,  for whom the assessments result a high calibration score, say 0.82 and a small information score, say 0.5.

Creative Commons License
Decision Making Under Uncertainty: Introduction to Structured Expert Judgment by TU Delft OpenCourseWare is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Based on a work at https://online-learning.tudelft.nl/courses/decision-making-under-uncertainty-introduction-to-structured-expert-judgment//.
Back to top