In an increasingly data-driven world, data and its use aren’t always all it’s cracked up to be. This course aims to address the critical lack of any or appropriate data in many areas where complex decisions need to be made.
For instance, how can you predict volcano activity when no eruptions have been recorded over a long period of time? Or how can you predict how many people will be resistant to antibiotics in a country where there is no available data at national level? Or how about estimating the time needed to evacuate people in flood risk areas?
In situations like these, expert opinions are needed to address complex decision-making problems. This course, aimed at researchers and professionals from any academic background, will show you how expert opinion can be used for uncertainty quantification in a rigorous manner.
Various techniques are used in practice. They vary from the informal and undocumented opinion of one expert to a fully documented and formal elicitation of a panel of experts, whose uncertainty assessments can be aggregated to provide support for complex decision making.
In this course you will be introduced to state-of-the-art expert judgment methods, particularly the Classical Model (CM) or Cooke’s method, which is arguably the most rigorous method for performing Structured Expert Judgment.
CM, developed at TU Delft by Roger Cooke, has been successfully applied for over 30 years in areas as diverse as climate change, disaster management, epidemiology, public and global health, ecology, aeronautics/aerospace, nuclear safety, environment and ecology, engineering and many others.
By the end of the course all learners will be able to:
- Recognize and advise on when and in which settings to use the Classical Model (CM) for performing Structured Expert Judgment
- Account for uncertainty assessments in complex decision-making context when data pose issues
- Use the CM to analyze expert data and obtain answers to questions of interest
- Participate in an optional IDEA Protocol module, which uses a different method of performing Structured Expert Judgment.
- Module 0. Getting started with Structured Expert Judgement (SEJ)
- Module 1. When and how to use SEJ?
- Module 2. Calibration and Information score
- Module 3. Performance-based weights and the Decision Maker
- Module 4. Data analysis using Excalibur and Validation
- Module 5. Biases and the IDEA protocol
- Module 6. Applications of CM and practical matters
- Module 7. Extra material
- Module 8. Decision Making under Uncertainty – It’s a wrap!
Decision Making Under Uncertainty: Introduction to Structured Expert Judgment by TU Delft OpenCourseWare is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Based on a work at https://online-learning.tudelft.nl/courses/decision-making-under-uncertainty-introduction-to-structured-expert-judgment//.