Methodologies for Evaluation of Effects of CAD On Users
N Petrick*, U.S. Food and Drug Administration, Silver Spring, MDWE-E-217A-3 Wednesday 2:00:00 PM - 3:50:00 PM Room: 217A
CAD devices are specifically designed to aid the user in the diagnostic process. Therefore, the user (e.g., clinician) is an integral part of the CAD interpretation process and the impact of CAD on users needs to be accounted for in the assessment process. We use the term “reader performance assessment” to denote a test specifically designed to estimate the performance of the user (or reader) interpreting CAD as part of the diagnostic process. These reader assessment studies are generally more indicative of clinical performance compared with standalone testing.
In this course, we will update the audience on the latest approaches and metrics being used to assess the impact of CAD on user performance, and discuss the opinions of the AAPM CAD subcommittee on the evaluation methodologies,
The learning objectives for this course are:
(1) To review the most common reader performance assessment techniques and associated performance metrics including the multi-reader multi-case (MRMC) study design.
(2) To review the AAPM CAD subcommittee’s current thinking on best practices for performing and analyzing CAD reader performance assessment studies.
(3) To understand the importance and limitations of various reader performance assessment approaches and metrics for various classes of CAD devices.