- Open Access
Modeling AIDS survival after initiation of antiretroviral treatment by Weibull models with changepoints
© Yiannoutsos. 2009
- Received: 21 October 2008
- Accepted: 26 June 2009
- Published: 26 June 2009
Mortality of HIV-infected patients initiating antiretroviral therapy in the developing world is very high immediately after the start of ART therapy and drops sharply thereafter. It is necessary to use models of survival time that reflect this change.
In this endeavor, parametric models with changepoints such as Weibull models can be useful in order to explicitly model the underlying failure process, even in the case where abrupt changes in the mortality rate are present. Estimation of the temporal location of possible mortality changepoints has important implications on the effective management of these patients. We briefly describe these models and apply them to the case of estimating survival among HIV-infected patients who are initiating antiretroviral therapy in a care and treatment programme in sub-Saharan Africa.
As a first reported data-driven estimate of the existence and location of early mortality changepoints after antiretroviral therapy initiation, we show that there is an early change in risk of death at three months, followed by an intermediate risk period lasting up to 10 months after therapy.
By explicitly modelling the underlying abrupt changes in mortality risk after initiation of antiretroviral therapy we are able to estimate their number and location in a rigorous, data-driven manner. The existence of a high early risk of death after initiation of antiretroviral therapy and the determination of its duration has direct implications for the optimal management of patients initiating therapy in this setting.
- Akaike Information Criterion
- Bayesian Information Criterion
- Immune Reconstitution Inflammatory Syndrome
- Weibull Model
- Profile Likelihood
Death rate (per 100 person-years) after initiation of ART
< 3 months
Subjects at interval start
The Weibull model of patient survival
where s (x; γ) = γ 0 + γ 1 x with γ 0 = - ρ log λ, γ 1 = ρ and x = log t i . The Weibull model is a generalization of the common exponential survival model (having ρ = 1). It is more flexible for many real-world situations as, in contrast to the exponential model, it does not assume constant hazard of death.
Extensions of the Weibull model
As flexible as the Weibull model may be, it may not adequately reflect changes in the hazard over time such as in the case of very high mortality hazard early after the start of ART. We consider one such extension, which includes Weibull models with changepoints.
Weibull model with changepoints
where the changepoint indicators in (3) are, in the case of two changepoints, c 1 i = c i and c 2 i = (1 - c i ). The likelihood in (4) is called the log profile likelihood associated with a particular choice of changepoint a. The analysis proceeds by maximizing (4), with respect to ρ 1, ρ 2 and λ 1, for given candidate values of the changepoint a. Repeating this process over a number of candidate changepoints and maximizing the log profile likelihood for each one, we can determine the optimal changepoint a and the maximum profile likelihood estimates of the piece-wise Weibull distributions and with log a. For more details on the single-changepoint Weibull model, see .
is the log cumulative hazard, and δ i , c i 1, c i 2and c i 3= 1 - c i 1- c i 2are, respectively, the censoring and changepoint indicators. This profile likelihood can be maximized with respect to ρ 1, ρ 2, ρ 3 and λ 1, over a grid of candidate changepoint values a 1 and a 2 until the maximum profile likelihood is found. This results in the determination of the optimal changepoints a 1 and a 2 as well as the maximum profile likelihood estimates of the three piece-wise Weibull distributions, , and where log a 1 and log a 2 .
Inference on the changepoints
where m is the number of changepoints, is the 1 - α percentile of the chi-square distribution with m degrees of freedom, L (a) is the maximized log-likelihood function evaluated at changepoint a and L (â) is the maximized log-likelihood function evaluated at the optimal changepoint. The authors of the aforementioned references contend that these confidence intervals will perform well even if the underlying likelihood is not normal.
The first term on the right of equation (6) is the average of the variance of and the second is the variance of the average estimate of . Both the estimate of each and its variance are readily produced in the output of most statistical software packages used to implement the analysis
Selecting the optimum model among those with the same number of changepoints can be accomplished, by performing a grid search and evaluating the profile likelihood at a number of candidate changepoints and selecting the one that maximizes the likelihood.
Selecting the optimal model among models with different numbers of changepoints can be accomplished by comparing the Akaike or Bayesian Information Criterion (abbreviated as AIC and BIC respectively). Both of these include a penalty against over parametrization of the model. Thus, in both cases, the model with the lowest AIC or BIC is preferred. The AIC criterion is given by the relationship AIC = 2 m - 2 log(L), where m is the dimension of the model and -2 log(L) is minus 2 times the logarithm of the maximized likelihood at model convergence (also called the deviance because it is a measure of the deviation of the model from the data). The AIC is distributed according to a chi-square distribution for large samples. The BIC criterion is similar to the AIC in that it penalizes models with larger number of changepoints. The BIC is given by the general equation BIC = m log(n) - 2 log(L), where n is the number of observations in the model. This may not be correct in the special case of survival analysis where subjects provide varying amounts of data depending on whether they have been observed to die or they are censored as of the end of the study. We will follow the recommendation of Volinsky and Raftery  and substitute d, the number of deaths, for n, in the equation for the BIC. It should be noted that, by the definition of the AIC and the BIC, among models with the same dimension, the one maximizing the likelihood is the optimum model with respect to both the AIC and BIC.
All analyses involving Weibull models with changepoints were performed using the ml command in Stata version 9.2 (Stata Corporation, College Station, TX). The author will make the programme code available upon request.
The Home-based AIDS Care Programme
The Home-Based AIDS Care Programme (HBAC)  is a clinical trial examining three different monitoring strategies for HIV-infected patients receiving ART in rural Uganda. Aggregated data with no information on any of the three monitoring strategies were used for this analysis. The HBAC study was approved by the Science and Ethics Committee of the Uganda Virus Research Institute, the Institutional Review Boards of the Centers for Disease Control and Prevention and the University of California, San Francisco. In total, 1120 HIV-infected patients were administered antiretroviral medications as part of the study. The duration of follow-up in this patient cohort was as short as 10 days and as long as almost 33 months (median 26.9 months, inter-quartile range 23.9–29.9 months). One hundred and five subjects (cumulative mortality 9.38%) died in the study after initiation of ART. Mortality rates over various periods of the study are summarized in Table 1. Over the first two years of follow-up, 95 patients discontinued from the study (cumulative two-year dropout probability 7.6%). Because of the very low number of patients who were lost to follow-up during the study, these data are particularly useful as an illustration of these methods because they are not burdened by possible biases resulting from differential vital status assessment of the subjects in the research cohort. This is a serious problem with cohorts in the same context .
Weibull analysis of the Uganda mortality data
Reanalysis of the data by Weibull models with changepoints
The data can be re-analyzed by using more flexible Weibull models with one or more changepoints.
Weibull analysis with a single changepoint
To carry out this analysis, we maximize the log profile likelihood shown in equation (4) for a number of candidate early changepoints a. We considered, as candidate points, any month within the first year after initiation of ART. This was a deliberate choice since a single changepoint after the first year would be of limited utility for care purveyors.
The impression is that the fit, particularly in the period after the first three months, is particularly good, but the survival estimate still underestimates the mortality rate in the later period after initiation of ART. Another informative figure of the implication of the changepoint model is the hazard plot shown in the right panel of the Figure 2. This single-changepoint model reflects a situation of a very high hazard of death in the first three months after ART initiation, followed by a period of lower hazard. It is also worth noting that the construction of the model ensures that the individual cumulative hazard curves, and thus the survival curves before and after the changepoint, will meet resulting in a continuous survival curve. This, however, is not the case with the hazard curves that are discontinuous at the changepoint as a byproduct of the model construction.
Weibull analysis with two changepoints
To address the poor fit in the middle part of the follow-up period, we add one more changepoint to the Weibull model. To fit the two-changepoint model, we must maximize the profile likelihood from equation (5) presented in the Methods section, for given candidate changepoints a 1 and a 2 searching through various combinations of candidate changepoints. We considered, as candidate points, any month within the 18 months after initiation of ART for both the first and second changepoint.
Performing this analysis, the optimal two changepoints were found to be at a 1 = 3 and a 2 = 10 months after initiation of ART.
Comparing the two best Weibull models with a one and two changepoints via the Akaike Information Criterion (AIC) and the Bayesian Information Criterion (BIC) (see Methods section) produces AIC values of 1296.7 and 1293.3 for the one and two-changepoint models respectively and BIC values of 1304.6 and 1303.9 respectively. This means that the model with the two changepoints is superior according to both the AIC and BIC.
As an illustration of incorporating covariates into the Weibull models with changepoints, we present the analysis of the post-ART survival of male versus female patients. There were 815 women in the data set (72.8% of the study cohort) compared to 305 men. Maximizing the log profile likelihood in (5), with gender as the covariate, adds β, the associated survival regression coefficient, as an additional parameter for maximization. Performing this analysis, the optimal changepoint model is the one with two changepoints at a 1 = 3 and a 2 = 10 months post ART start. The estimate of the Weibull regression coefficient is = 0.411, which corresponds to a hazard ratio of 1.51 of male compared to female patients.
Following the conditional variance estimation approach in (6), we obtain var( ) = 0.0417. This in turn implies that a 95% confidence interval of the hazard ratio will be (1.01, 2.25). The Wald p value is p = 0.041 indicating an increase in the hazard of mortality among men compared to women. As it turned out in this application, . However, this will not be the case universally.
The main goal of this research is to establish, in a data-driven manner, the existence, temporal location and number of sharp changes in mortality risk (hazard of death) after initiation of ART in a care and treatment programme in sub-Saharan Africa. A number of investigations have reported that a high risk of death persists for some time after ART initiation compared to later periods [1–3]. Establishing the duration of this high risk period is significant for refining clinical care protocols to better manage these patients. For example, the frequency of patient visits can be intensified for high-risk individuals and patient counselling and outreach can also be considered over this crucial period.
The existence of a changepoint of risk has been empirically placed at some time during the first three to six months of therapy by a number of reports. To my knowledge however, there has never been an objective estimate of its location generated by rigorous data analysis. In this report I have attempted to use a data-driven approach, by extending the Weibull model, to account for sharp changes in the hazard of mortality. Using these extended Weibull models allowed an objective estimation of the possible location of changepoints in the risk of death of HIV-infected patients after they initiate antiretroviral therapy. These parametric models may be superior to semiparametric models (such as the Cox proportional hazards model) in this setting because they make explicit modelling of the underlying mortality risk (baseline hazard). As cited in , from a quote attributed to Hjort , a "parametric version [of the Cox model]... if found to be adequate, would lead to more precise estimation of survival probabilities and... concurrently contribute to a better understanding of the phenomenon under study". Using semiparametric models would have required a much more complex modelling exercise, where factors associated with the changepoints would have to be included among the model predictors.
These analyses show that an early changepoint is likely to exist at about three months after initiation of ART. The presence of this early changepoint is supported by a number of reports. Stringer and colleagues , describing the experience of the national antiretroviral therapy programme in Zambia, report that 71% of all deaths in their cohort happened during the first 90 days after initiation of ART. Braitstein and colleagues , in a large study of 2,725 HIV-infected persons in 18 antiretroviral programmes in Africa, Asia and South America, report that mortality rates were 14.7% and 10.6% in the first and second month after ART initiation respectively but dropped to 5.1% in months three to six, and then dropped further to 2.7% in months 6–12. These results are similar to our experience summarized in Table 1. The biological plausibility of an initially very high hazard of mortality that rapidly declines over the first few months after initiation of ART is supported by a number of factors. Since all patients involved in this study were treatment-naïve, early drug toxicity may have played a significant role in their ability to adhere to the new medication regimens. In addition, the rapid restoration of immune function immediately after initiation of therapy, may have led to an inflammatory response, what is called an Immune Reconstitution Inflammatory Syndrome (IRIS) that can be fatal for the patient. In a prospective study in South Africa, IRIS occurred in 10% of the patients at a median time 48 days after initiating ART , particularly among the most immunosuppressed patients. A number of authors have identified IRIS as having a significant burden in the context of rapid immunological reconstitution in the presence of latent co-infections, particularly in the developing world, where IRIS is "unmasking" a latent existing opportunistic infection or cancer. Given the burden of cryptococcosis deaths in the early period after ART initiation in this study, fatal IRIS-related to inflammatory immune response to this disease may have been present (see Moore et al., 14th CROI presentation http://www.retroconference.org/2007/Abstracts/28827.htm for more information). A relevant case report of fatal cryptococcosis-related IRIS can be found in Seddon and colleagues . The most explicit attribution of early excess death to IRIS is given in Celentano & Beyer  who cite a number of investigators discussing fatal cases of IRIS in the context of tuberculosis  and cryptococcal antigenemia . The median CD4+ T cell count at ART start (analysis not shown) was 128 cells/ml for this cohort with 25% of the patients having CD4 counts half of that level, implying significant immunosuppression. It has long been recognized that CD4 counts below 200 cells/ml expose HIV-infected patients to a very high risk for opportunistic infections and death, the main reason why therapy is started when CD4 count drops below that level. Given that, on average, patients gain about 100 cells/ml in the first six weeks of treatment and a further 60 cells/ml during the subsequent months of the first year of antiviral therapy [3, 18], it is likely that the majority of subjects in the present study reached CD4 counts above 200 cells/ml only after the first three months of starting ART. Consequently, co-infections and morbidities present at the start of ART or acquired in the first months of therapy likely continued to present a significant mortality risk during this period.
We also showed that these generalized Weibull models with changepoints can easily accommodate covariates. In the example provided, men experienced considerably higher mortality compared to women as implied by the 50% higher hazard of death. This has been consistently reported in both the developed and developing world setting [18, 19]. In our context, men tend to be more immunosuppressed than women when starting ART. This is because of a number of issues that are beyond the scope of this report. Men also exhibit higher levels of loss to follow-up compared to women . In our cohort, men had lower median CD4 count at ART start than women (analysis not shown).
Despite higher mortality rates among HIV-infected men, both men and women experience high mortality within the first few months after starting ART. This observation in turn implies that, along with gender, patient follow-up and outreach efforts should be directed towards patients that have recently been started on ART: see  for description of such a tiered patient outreach protocol.
The existence of a period of moderate mortality risk even past the three-month point, as suggested by the second changepoint, is not surprising given the deep immunosuppression of this study cohort. Nevertheless, persistence of risk up to the first year after starting ART has less clear precedent in the literature, although the mortality rates quoted in some of the aforementioned references suggest that mortality rates stabilize only after about one year from initiation of ART. Evidence from our models is equivocal on this issue. The AIC and BIC criteria applied to the Weibull models with changepoints did favour the model with two changepoints, but their values were close and, as mentioned in Royston and Parmar , in the context of a similar class of generalized Weibull models, they should not be used mechanically in selecting the best model. Thus, the evidence for a second changepoint of mortality risk remains weak at present. Additional analyses of similar data with longer follow-up are warranted to elucidate this issue.
Extensions of the Weibull model have been considered by a number of authors. Royston and Parmar  have presented a rich class of models that use cubic splines to approximate s (x; γ) in (1) by adding higher-order polynomial terms and one or more "knots" that add flexibility to the shape of the survival curve not available in the simple Weibull model. The methodology has been implemented in  and  in the STATA software (that also includes similar extensions to the log-logistic survival model). Analysis of the data in this paper (not shown) using the spline models produced virtually identical survival estimates as those generated by the Weibull models with changepoints. A significant advantage of the generalized class of Weibull models of Royston and Parmar is that the resulting hazard plot is continuous unlike the hazard curves produced by the models considered in this work, which have discontinuities at the changepoints. However, the number and placement of the spline knots does not have the same direct biological interpretation as the number and location of changepoints. Thus, the generalized models with splines are less suitable in an effort to estimate the number and location of possible abrupt changes in patient survival, which was the primary goal of this research.
The hazard of mortality is very high after ART initiation for up to three months, and may persist up to a year after start of treatment. This has strong implications for patient management and may be helpful in refining patient care protocols in this setting by intensifying follow-up of newly treated patients during this period and possibly extending the duration of intensified follow-up for up to one year after start of therapy. Further investigation and re-analysis of data from a number of ongoing studies will be important to authoritatively address this question. The flexibility afforded by these Weibull models will be useful in this endeavor.
The author would like to thank the informatics and laboratory team at CDC-Uganda and Ms Beverly Musick at Indiana University, who compiled the data for analysis. He would also like to acknowledge the support of the Ugandan Ministry of Health and The AIDS Support Organization to this study. HBAC is funded through the US President's Emergency Plan for AIDS Relief. The author was partially supported by the East Africa IeDEA Regional Consortium, grant U01 AI-69911 from the National Institutes of Health.
- Braitstein P, Brinkhof MW, Dabis F, Schechter M, Boulle A, Miotti P, Wood R, Laurent C, Sprinz E, Seyler C, Bangsberg DR, Balestre E, Sterne JA, May M, Egger M: Mortality of HIV-1-infected patients in the first year of antiretroviral therapy: comparison between low-income and high-income countries. Lancet 2006, 367: 817–824.View ArticlePubMedGoogle Scholar
- Egger M, May M, Chêne G, Phillips AN, Ledergerber B, Dabis F, Costagliola D, D'Arminio Monforte A, De Wolf F, Reiss P, Lundgren JD, Justice AC, Staszewski S, Leport C, Hogg RS, Sabin CA, Gill MJ, Salzberger B, Sterne JAC, the ART Cohort Collaboration: Prognosis of HIV-1-infected patients starting highly active antiretroviral therapy: a collaborative analysis of prospective studies. Lancet 2002, 360: 119–129.View ArticlePubMedGoogle Scholar
- Stringer JS, Zulu I, Levy J, Stringer EM, Mwango A, Chi BH, Mtonga V, Reid S, Cantrell RA, Bulterys M, Saag MS, Marlink RG, Mwinga A, Ellerbrock TV, Sinkala M: Rapid scale-up of antiretroviral therapy at primary care sites in Zambia: feasibility and early outcomes. JAMA 2006, 296: 782–793.View ArticlePubMedGoogle Scholar
- Royston P, Parmar MKB: Flexible parametric proportional-hazards and proportional-odds models for censored survival data, with application to prognostic modelling and estimation of treatment effects. Stat Med 2002, 21: 2175–2197.View ArticlePubMedGoogle Scholar
- Noura AA, Read KLQ: Proportional hazards changepoint models in survival analysis. Appl Statist 1990, 39: 241–253.View ArticleGoogle Scholar
- Jiwani LJ: Parametric changepoint survival model with application to coronary artery bypass graft surgery data. [http://www.stat.sfu.ca/people/alumni/Theses/Jiwani-2005.pdf] Master's thesis Simon Fraser University; 2007.Google Scholar
- McCullagh P, Nelder JA: Generalized Linear Models. 2nd edition. London: Chapman and Hall; 1991.Google Scholar
- Hall CB, Lipton RB, Sliwinski M, Stewart WF: A changepoint model for estimating the onset of cognitive decline in preclinical Alzheimer's disease. Stat Med 2000, 19: 1555–1566.View ArticlePubMedGoogle Scholar
- Volinsky CT, Raftery AE: Bayesian Information Criterion for censored survival models. Biometrics 2000, 56: 256–262.View ArticlePubMedGoogle Scholar
- Home-Based AIDS Care Project, NCT00119093 [http://clinicaltrials.gov/ct2/show/NCT00119093?spons=%22Ministry+of+Health%2C+Uganda%22&spons_ex=Y&rank=8]
- Rosen S, Fox MP, Gill CJ: Patient Retention in Antiretroviral Therapy Programs in Sub-Saharan Africa: A Systematic Review. PLoS Medicine 2007, 4: e298.View ArticlePubMedGoogle Scholar
- Hjort NL: On inference in parametric survival data models. Int Stat Rev 1992, 60: 355–387.View ArticleGoogle Scholar
- Murdoch DM, Venter WD, Feldman C, Van Rie A: Incidence and risk factors for the immune reconstitution inflammatory syndrome in HIV patients in South Africa: a prospective study. AIDS 2008, 22: 601–610.View ArticlePubMedGoogle Scholar
- Seddon J, Mangeya N, Miller RF, Corbett EL, Ferrand RA: Recurrence of cryptococcal meningitis in HIV-infected patients following immune reconstitution. Int J STD AIDS 2009, 20: 274–275.View ArticlePubMedGoogle Scholar
- Celentano DD, Beyer C, Eds: Public health aspects of HIV/AIDS in low and middle income countries. New York: Springer; 2008.Google Scholar
- Lawn SD, Myer L, Bekker LG, Wood R: Tuberculosis-associated immune reconstitution disease: incidence, risk factors and impact in an antiretroviral treatment service in South Africa. AIDS 2007, 21: 335–341.View ArticlePubMedGoogle Scholar
- Jarvis JN, Lawn SD, Vogt M, Bangani N, Wood R, Harrison TS: Screening for cryptococcal antigenemia in patients accessing an antiretroviral treatment program in South Africa. Clin Infect Dis 2009, 48: 856–862.View ArticlePubMedGoogle Scholar
- Wools-Kaloustian K, Kimaiyo S, Diero L, Siika A, Sidle J, Yiannoutsos CT, Musick B, Einterz R, Fife KH, Tierney WM: Viability and effectiveness of large-scale HIV treatment initiatives in sub-Saharan Africa: experience from western Kenya. AIDS 2006, 20: 41–48.View ArticlePubMedGoogle Scholar
- Donnelly CA, Bartley LM, Ghani A, Le Fevre AM, Kwong GP, Cowling BJ, Van Sighem AI, De Wolf F, Rode RA, Anderson RM: Gender difference in HIV-1 RNA viral loads. HIV Medicine 2005, 6: 170–178.View ArticlePubMedGoogle Scholar
- Yiannoutsos CT, An MW, Frangakis CE, Musick BS, Braitstein P, Wools-Kaloustian K, Ochieng D, Martin JN, Bacon MC, Ochieng V, Kimaiyo S: Sampling-based approaches to improve estimation of mortality among patient dropouts: Experience from a large PEPFAR-funded program in western Kenya. PLoS ONE 2008, 3: e3843.View ArticlePubMedGoogle Scholar
- Royston P: Flexible parametric alternatives to the Cox model, and more. [http://www.stata-journal.com/sjpdf.html?articlenum=st0001] Stata Journal 2001, 1: 1–28.Google Scholar
- Royston P: Flexible parametric alternatives to the Cox model: update. [http://www.stata-journal.com/article.html?article=st0001_2] Stata Journal 2004, 4: 98–101.Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.