Monday, October 19, 2015
Grand Ballroom EH (Hyatt Regency St. Louis at the Arch)
Poster Board # PS2-43

Gratianne Vaisson, MSc1, Michèle Dugas, BA1, Thierry Provencher1, Érik Breton, PhD1, Selma Chipenda Dansokho, PhD1, Heather Colquhoun, PhD2, Angela Fagerlin, PhD3, Anik Giguère, PhD1, Sholom Glouberman, PhD4, Lynne Haslett, RN, NP, MEd5, Aubri S. Hoffman, PhD6, Noah Ivers, MD, PhD, CCFP7, France Legare, MD, PhD, CCFP1, Jean Legare8, Carrie A. Levin, PhD9, Karli Lopez, AA10, Victor M. Montori, MD, MSc11, Jean-Sébastien Renaud, PhD1, Kerri Sparling, BA12, Dawn Stacey, RN, PhD, CON (C)13, Marie-Ève Trottier, BA1, Robert J. Volk, PhD14, William Witteman, MISt15 and Holly O. Witteman, PhD1, (1)Université Laval, Quebec City, QC, Canada, (2)University of Toronto, Toronto, ON, Canada, (3)VA Ann Arbor Healthcare System & University of Michigan, Ann Arbor, MI, (4)Patients Canada, Toronto, ON, Canada, (5)East End Community Health Centre, Toronto, ON, Canada, (6)Geisel School of Medicine at Dartmouth College, Lebanon, NH, (7)Women's College Hospital, Toronto, ON, Canada, (8)Arthritis Society, Quebec, QC, Canada, (9)Informed Medical Decision Foundation, Healthwise, Boston, MA, (10)Stone Soup Group, Anchorage, AK, (11)Knowledge and Evaluation Research Unit - Mayo Clinic, Rochester, MN, (12)Six Until Me, East Greenwich, RI, (13)University of Ottawa, Ottawa, ON, Canada, (14)The University of Texas MD Anderson Cancer Center, Houston, TX, (15)CHU de Québec, Québec, QC, Canada
Purpose: To describe the ways in which patients and other stakeholders have or have not been engaged in the development of patient decision aids, and to compare these approaches with user-centered design, an established development process used with other patient-centered tools.

Methods: Our interdisciplinary team of researchers, patients, caregivers, clinicians, and decision aid developers conducted a systematic review according to the Cochrane Handbook and PRISMA reporting guidelines. Two independent reviewers assessed each article’s eligibility. Eligible articles described either the development of a patient decision aid or the development of any patient-centered tool that had been explicitly developed through a process of user-centered design. We created a structured data extraction form, refined it by consulting with 15 domain experts outside our team, and conducted four rounds of pilot testing. Two independent reviewers extracted data into a predetermined matrix, discussing questions at regular team meetings and reconciling any differences in extracted data. We analyzed preliminary data from all articles for which data had been fully extracted and reconciled thus far, calculating descriptive frequencies and conducting exploratory tests (Chi-squared with Yates continuity corrections or Fisher’s exact) to compare frequencies of practices employed in the development of patient decision aids with frequencies of practices employed when applying user-centered design to the development of other patient-centered tools. 

Results: Within our preliminary data set of 121 articles, 100 (83%) described the development of a patient decision aid while 21 (17%) described a user-centered design process to develop another type of patient-centered tool. Descriptions of end user involvement within development practices differed between the two groups. For example, articles describing the development of a patient decision aid were less likely to describe involving end users in a content or format review prior to pilot testing (17/100=17%, 9/21=43%, Chi-squared(1)=8.5, p=.004), conducting pilot or usability testing with end users (48/100=48%, 18/21=86%, Fisher’s exact p=.017), and were also less likely to describe an iterative development process (43/100=43% , 21/21=100%, Chi-squared(1)=20.40, p<.001). 

Conclusions: Descriptions of end user engagement within the development of patient decision aids differ from descriptions of practices within user-centered design. Further research will determine whether such differences truly reflect differing practices or merely differing descriptions, as well as whether any differences in development are associated with differences in outcomes.