Important announcement

Dear visitor,

Please note that this OpenCourseWare platform will be replaced at the end of 2026 by a new platform (under the same url ocw.tudelft.nl).

Courses and their contents that are currently available the platform will partly be migrated. URL’s for this content will change and content might be unavailable for some time. In addition, some courses will not be available anymore.

If you are linking to specific courses on this platform (for instance for your students), please take timely measures to avoid problems with access. Possible actions are:

  • Download the materials to your local platform (laptop, server)
  • For educators only (including TU Delft lecturers): Contact us at ocw@tudelft.nl and inform us what course you are using in what context (institute, program, period of use, number of students). We will research (in collaboration with the authors of the course) and decide if we will migrate the course, and if yes, can supply you with a new url.

Thank you.

Home Courses Decision Making Under Uncertainty: Introduction to Structured Expert Judgment Course materials Readings 4.7.2 Learn more

4.7.2 Learn more

Course subject(s) Module 4. Data analysis using Excalibur and Validation

During this module you have learned to work with Excalibur, the software to analyze expert data.

You have also learned about validation methods for the combination of experts’ assessments. This is ongoing effort of many researchers in the field, and some of their work you can find in the references below.

“reading” by Terry Freedman is licensed under CC BY-NC-ND 2.0

Evaluation of DMs performance

  • Cooke, R. M., & Goossens, L. L. (2008). TU Delft expert judgment data base. Reliability Engineering & System Safety, 93(5), 657-674.

A copy of the first author can read here. (The copy is provided for non-commercial and education use.)

  • Colson, A. R., & Cooke, R. M. (2017). Cross validation for the classical model of structured expert judgment. Reliability Engineering & System Safety, 163, 109-120.
  • Roger’s website for updates on validation measures

CM studies

  • Again, Roger’s website contains many references to (recent) studies.
Previous
Next
Creative Commons License
Decision Making Under Uncertainty: Introduction to Structured Expert Judgment by TU Delft OpenCourseWare is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Based on a work at https://online-learning.tudelft.nl/courses/decision-making-under-uncertainty-introduction-to-structured-expert-judgment//.
Back to top
[sg_popup id=6]