Course Level: Intermediate
Format Requirements: The workshop will consist of brief didactic presentations followed by small groups solving and discussing illustrative problems based on studies of diagnostic tests. Among other tests, the problems will discuss: a rapid antigen detection test for influenza; CT and LP for subarachnoid hemorrhage; BNP for congestive heart failure; D-Dimer for venous thromboembolism; serum lactate for severe sepsis; and Troponin I for myocardial infarction. At the end of the session, we will hand out the answers to the problems. Participants should be comfortable with the basics of diagnostic testing such as the definitions of sensitivity, specificity and predictive value, and should also have some initial exposure to receiver operating characteristic (ROC) curves and likelihood ratios.
Background: This hands-on workshop is based on real studies of diagnostic tests. After this course, you will understand 1) the principles of diagnostic test assessment, including the calculation and use of interval likelihood ratios and the relationship between these likelihood ratios and the ROC curve; 2) how to go beyond the area under the curve to get the most out of published ROC curves; and 3) underappreciated flaws, biases, and limitations in studies of diagnostic test accuracy.
Description and Objectives: The brief didactic sessions will cover the following topics (examples):
1) Review of dichotomous tests, sensitivity, specificity, LR(+), LR(-), and the false negative rate confusion (rapid antigen testing for influenza)
2) Multilevel and continuous tests, interval likelihood ratios and the perils of making multi-level tests dichotomous (B-type natriuretic peptide for congestive heart failure, D-Dimer for VTE)
3) Going beyond the area under the ROC curve and getting the most out of published ROC curves (peripheral WBC count for meningitis in infants; serum lactate for severe sepsis)
4) Studies of diagnostic test accuracy -- beyond the check list: incorporation and spectrum biases (BNP revisited; using B-HCG levels in the diagnosis of ectopic pregnancy)
5) Studies of diagnostic test accuracy: verification and double gold standard biases (history and exam findings for appendicitis, hemorrhagic CVA, and elbow fracture)