Course Level: Intermediate
Course Limit: 25
Format Requirements: The workshop will consist of brief didactic presentations followed by small groups solving and discussing illustrative problems based on studies of diagnostic tests. Among other tests, the problems will discuss: a rapid antigen detection test for influenza; BNP for congestive heart failure; D-Dimer for venous thromboembolism; serum lactate for severe sepsis; and the JAMA “Rational Clinical Examination” papers on diagnosing appendicitis and UTI in children. At the end of the session, we will hand out the answers to the problems. Participants should be comfortable with the basics of diagnostic testing such as the definitions of sensitivity, specificity and predictive value, and should also have some initial exposure to receiver operating characteristic (ROC) curves and likelihood ratios.
Background: This hands-on workshop is based on real studies of diagnostic tests. After this course, you will understand 1) the principles of diagnostic test assessment, including the calculation and use of interval likelihood ratios and the relationship between these likelihood ratios and the ROC curve; 2) how to go beyond the area under the curve to get the most out of published ROC curves; 3) when odds ratios are preferable to likelihood ratios and vice versa; and 4) underappreciated flaws, biases, and limitations in studies of diagnostic test accuracy.
Description and Objectives: The brief didactic sessions will cover the following topics (examples):
1) Review of dichotomous tests, sensitivity, specificity, LR(+), LR(-), and the false negative rate confusion (rapid antigen testing for H1N1 influenza)
2) Multilevel and continuous tests, interval likelihood ratios and the perils of making multi-level tests dichotomous (B-type natriuretic peptide for congestive heart failure, D-Dimer for VTE)
3) Going beyond the area under the ROC curve and getting the most out of published ROC curves (peripheral WBC count for meningitis in infants; serum lactate for severe sepsis)
4) Studies of diagnostic test accuracy -- beyond the check list: incorporation and spectrum biases (BNP revisited; using B-HCG levels in the diagnosis of ectopic pregnancy)
5) Studies of diagnostic test accuracy: verification and double gold standard biases (JAMA Rational Clinical Examination: Does this Child Have Appendicitis?)
6) Odds ratios vs. likelihood ratios: Which to use? (JAMA Rational Clinical Examination: Does this Child Have a Urinary Tract Infection?)
We can adjust the schedule and material covered based on input from the participants at the beginning of the course.