TR2-3 INTERNAL VALIDATION AND CALIBRATION OF A MODEL TO FORECAST HIV TREATMENT DEMAND AND CAPACITY IN HAITI

Monday, October 24, 2011: 11:06 AM
Grand Ballroom CD (Hyatt Regency Chicago)
(ESP) Applied Health Economics, Services, and Policy Research

Candidate for the Lee B. Lusted Student Prize Competition


April D. Kimmel, PhD1, Daniel W. Fitzgerald, MD1, Macarthur Charles, MD, PhD1, Alison Edwards, MStat1, Abdias Marcelin2, Jean W. Pape, MD3 and Bruce R. Schackman, PhD1, (1)Weill Cornell Medical College, New York, NY, (2)Les Centres GHESKIO, Port-au-Prince, Haiti, (3)Les Centres GHESKIO, Weill Cornell Medical College, New York, NY
  

Purpose: International guidelines recommend early HIV treatment initiation (i.e., at CD4 <350) for HIV-infected individuals in resource-limited settings. However, funding availability for early or deferred HIV treatment (i.e., at CD4 <200) in Haiti is uncertain. We aimed to internally validate and calibrate a user-friendly model of HIV disease in Haiti that will assist policy makers in forecasting treatment need and capacity.   

Methods: We used patient-level data from Haitian observational cohorts and a randomized trial conducted in Haiti to develop a computer-based, mathematical model of HIV disease. Incidence density analysis was used to derive model parameters for untreated HIV disease progression (HIV seroconverters cohort, n=41; asymptomatic HIV disease, n=436) and HIV treatment (early 1st-line treatment, n=408, deferred 1st-line treatment, n=910; deferred 2nd-line treatment, n=194). Model predictions were compared to observed data to assess internal validity. Goodness of fit measures included visual assessment of Kaplan-Meier survival curves, comparisons of 5-year event probability, and percentage deviation between the predicted estimates and observed data at discrete time points, averaged over time. When model predictions did not exhibit a good fit due to model structure simplifications that would enhance usability, an internal calibration algorithm was applied to improve goodness of fit between predicted and observed outcomes. The model was implemented in Microsoft Excel, and results evaluated over a 5-and 10-year policy time horizon.   

Results: For a cohort of newly HIV-infected individuals with no access to HIV treatment, the model predicts median AIDS-free survival of 9.0 years pre-calibration and 5.6 years post-calibration versus 5.8 years (95% CI 5.1, 7.0) observed (Figure 1). For a cohort of patients initiating deferred treatment, the model estimates 23.2% would die by 5 years (versus 23.5% in the observed data), 7.3% would be lost from care (versus 7.8%), and 11.7% would initiate a second treatment regimen (versus 10.8%). In 12 out of 14 comparisons assessing different natural history and treatment-related outcomes, mean percentage deviation between the model predictions and observed data does not exceed 5% over both 5 and 10 years.

  

Conclusions: Internal validation and calibration results were sufficient for 5- and10-year health policy decision making. Using local data in a model-building process can improve validity and acceptability of policy models in resource-limited settings.