The word calibration might have lead you to think of “calibration of measuring instruments”. The calibration of a measuring instrument checks the accuracy of the instrument. The term accuracy is used to refer to the closeness of a measurement to a specific value.

“Measurement” by William A. Clark is licensed under CC BY-NC-SA 2.0

Now, you might wonder if there is, in fact, any difference between accuracy and statistical accuracy (or calibration score)?

The next example will clarify this aspect!

Expert 5 assessments seem more accurate, that is, the medians are closer to the true value.

But does that mean that Expert 5 is also more statistically accurate?