Simulated vs. Actual Use Testing
Most human factors validation testing happens under simulated use conditions. Actual use validation is possible, and sometimes necessary, when simulated environments cannot replicate critical user int…
← All topics
Topic hub
Summative
Validation is where every earlier decision is tested. These pieces cover summative study design, simulated versus actual use, participant numbers, root cause analysis of use errors, and how to report results credibly.
Questions answered here
- Can a clinical trial replace human factors validation testing for medical devices?A clinical trial cannot automatically replace human factors validation. Clinical trials focus on therapeutic efficacy and clinical safety using tightly controlled conditions. In contrast, human factors validation requires representative users, realistic environments, and minimal investigator intervention to capture use errors. Blending them requires deliberately designing the protocol to meet specific human factors validation requirements.
- Why is a medical device summative evaluation not a pass or fail test?Summative evaluation is not based on error counts or numerical pass thresholds. Instead, it relies on investigating root causes to determine whether observed use errors are adequately controlled or indicate unresolved design issues. It acts as a confirmation that critical risks were properly understood, addressed, and supported with evidence throughout development.
Articles on summative
Why summative is not a pass fail activity
Continuing the “Basic Human Factors Concepts for Medical Devices” series, this time I want to talk about why summative evaluation is not a pass/fail activity. Thanks to @Andreas for suggesting the top…