2.3.5 Summary calibration score
Summary calibration score
You have now learned how to compute one objective measure which helps in evaluating experts’ assessments, that is the calibration score. The calibration score measures if experts’ assessments are statistically accurate. That is also why the calibration score is also referred to as statistical accuracy.
Note that the calibration score is computed based on all the calibration (seed) questions. The score will take values between 0 to 1, with 1 being the highest possible calibration score. The higher the calibration score, the better.
Decision Making Under Uncertainty: Introduction to Structured Expert Judgment by TU Delft OpenCourseWare is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Based on a work at https://online-learning.tudelft.nl/courses/decision-making-under-uncertainty-introduction-to-structured-expert-judgment//.