#PAGE_PARAMS# #ADS_HEAD_SCRIPTS# #MICRODATA#

Cost-effectiveness of integrating postpartum antiretroviral therapy and infant care into maternal & child health services in South Africa


Authors: Caitlin M. Dugdale aff001;  Tamsin K. Phillips aff004;  Landon Myer aff004;  Emily P. Hyle aff001;  Kirsty Brittain aff004;  Kenneth A. Freedberg aff001;  Lucy Cunnama aff008;  Rochelle P. Walensky aff001;  Allison Zerbe aff009;  Milton C. Weinstein aff007;  Elaine J. Abrams aff009;  Andrea L. Ciaranello aff001
Authors place of work: Medical Practice Evaluation Center, Department of Medicine, Massachusetts General Hospital, Boston, MA, United States of America aff001;  Division of Infectious Diseases, Department of Medicine, Massachusetts General Hospital, Boston, MA, United States of America aff002;  Harvard Medical School, Boston, MA, United States of America aff003;  Division of Epidemiology and Biostatistics, School of Public Health & Family Medicine, University of Cape Town, Cape Town, South Africa aff004;  Centre for Infectious Diseases Epidemiology & Research, School of Public Health & Family Medicine, University of Cape Town, Cape Town, South Africa aff005;  Division of General Internal Medicine, Massachusetts General Hospital, Boston, MA, United States of America aff006;  Department of Health Policy and Management, Harvard T.H. Chan School of Public Health, Boston, MA, United States of America aff007;  Health Economics Unit, School of Public Health & Family Medicine, University of Cape Town, South Africa aff008;  ICAP at Columbia and the Mailman School of Public Health, Columbia University, New York, NY, United States of America aff009;  College of Physicians & Surgeons, Columbia University, New York, NY, United States of America aff010
Published in the journal: PLoS ONE 14(11)
Category: Research Article
doi: https://doi.org/10.1371/journal.pone.0225104

Summary

Background

Poor engagement in postpartum maternal HIV care is a challenge worldwide and contributes to adverse maternal outcomes and vertical transmission. Our objective was to project the clinical and economic impact of integrated postpartum maternal antiretroviral therapy (ART) and pediatric care in South Africa.

Methods

Using the CEPAC computer simulation models, parameterized with data from the Maternal and Child Health–Antiretroviral Therapy (MCH-ART) randomized controlled trial, we evaluated the cost-effectiveness of integrated postpartum care for women initiating ART in pregnancy and their children. We compared two strategies: 1) standard of care (SOC) referral to local clinics after delivery for separate standard ART services for women and pediatric care for infants, and 2) the MCH-ART intervention (MCH-ART) of co-located maternal/pediatric care integrated in Maternal and Child Health (MCH) services throughout breastfeeding. Trial-derived inputs included: 12-month maternal retention in care and virologic suppression (SOC: 49%, MCH-ART: 67%), breastfeeding duration (SOC: 6 months, MCH-ART: 8 months), and postpartum healthcare costs for mother-infant pairs (SOC: $50, MCH-ART: $69). Outcomes included pediatric HIV infections, maternal and infant life expectancy (LE), lifetime HIV-related per-person costs, and incremental cost-effectiveness ratios (ICERs; ICER <US$903/YLS considered “cost-effective”).

Results

Compared to SOC, MCH-ART increased maternal LE (SOC: 25.26 years, MCH-ART: 26.20 years) and lifetime costs (SOC: $9,912, MCH-ART: $10,207; discounted). Projected pediatric outcomes for all HIV-exposed children were similar between arms, although undiscounted LE for HIV-infected children was shorter in SOC (SOC: 23.13 years, MCH-ART: 23.40 years). Combining discounted maternal and pediatric outcomes, the ICER was $599/YLS.

Conclusion

Co-located maternal HIV and pediatric care, integrated in MCH services throughout breastfeeding, is a cost-effective strategy to improve maternal and pediatric outcomes and should be implemented in South Africa.

Keywords:

Pediatrics – South Africa – Cost-effectiveness analysis – Pediatric infections – Infants

Introduction

The postpartum period is a high-risk time for women with HIV and their children. Despite the scale-up of lifelong antiretroviral therapy (ART) for all pregnant and breastfeeding women, approximately 180,000 new pediatric HIV infections occurred worldwide in 2017, including 13,000 in South Africa [1]. High rates of postpartum loss to follow-up (LTFU) and ART non-adherence contribute to adverse maternal outcomes and HIV transmission to breastfeeding infants [24]. By 12 months postpartum, 20–30% of women with HIV are lost to follow-up, and only 75% of those in care are virologically suppressed [24]. Postpartum disengagement from care thus represents a substantial obstacle impeding the elimination of pediatric HIV infection and better overall maternal and child health (MCH).

In South Africa, most pregnant women with HIV receive HIV care and ART integrated into antenatal services in MCH clinics [5]. After delivery, HIV care is transferred to separate general ART services for women and routine pediatric care for children; this is a particularly vulnerable time for disengagement [5]. Integrating postpartum ART services for mothers and infant care into MCH services has been proposed to address this vulnerability [5, 6]. However, there are concerns that service integration could overburden providers, leading to reduced quality of care and/or increased downstream costs [6, 7].

To examine these potential tradeoffs, the Maternal and Child Health–Antiretroviral Therapy (MCH-ART) trial evaluated a novel platform of integrated postpartum care in South Africa [8]. The trial enrolled breastfeeding women who had started ART during pregnancy. The current standard of care was compared to the MCH-ART intervention of integrating concurrent and co-located maternal ART and pediatric care into the MCH clinic through the end of breastfeeding. The MCH-ART intervention increased the primary endpoint of combined maternal retention and virologic suppression (HIV RNA <50 copies/mL) at 12 months postpartum and extended breastfeeding duration [8]. Our objective was to project the long-term clinical outcomes and cost-effectiveness of the MCH-ART approach to integrated postpartum care, beyond the 12-month horizon of the randomized trial, for women with HIV and their children in South Africa.

Methods

Analytic overview

We used the Cost-effectiveness of Preventing AIDS Complications (CEPAC)-International and CEPAC-Pediatrics models to evaluate two strategies: standard of care (SOC) and the MCH-ART intervention (MCH-ART) [911]. We simulated a cohort of women who initiated ART during pregnancy and a cohort of their breastfed children from delivery through death. Maternal retention and virologic suppression through the first 12 months postpartum were calibrated to match MCH-ART trial results; clinical and economic outcomes for women and children beyond the 12 month trial period were modeled using input data from the published literature (Table 1, S1 Table) [8]. All simulated women and children face monthly risks of non-HIV-related mortality. Individuals with HIV face monthly risks of virologic failure, LTFU, opportunistic diseases (ODs), and HIV-related mortality. Full model specifications are available online [12].

Tab. 1. Selected model input parameters.
Selected model input parameters.

Using the CEPAC models, we projected pediatric HIV infections, 1-year mortality, undiscounted life expectancies, and undiscounted per-person HIV-related costs for women and children from a healthcare system perspective. We discounted costs and life expectancies at 3%/year to calculate an incremental cost-effectiveness ratio (ICER): the difference in lifetime HIV-related costs divided by the difference in life expectancy between the two strategies [33]. We defined a strategy as “cost-effective” if the ICER was <$903/YLS, the CEPAC-projected ICER of adding second-line ART, compared to first-line ART alone (S3 Table). Second-line ART is recommended by national guidelines in South Africa, so therefore provides a reasonable lower bound for willingness to pay [34, 35]. ICERs were reported to the nearest $1, and we performed extensive sensitivity analyses around key model parameters to evaluate the uncertainty around these estimates.

This study was approved by the Partners Healthcare Human Subjects Committee (2016P000492), Boston, MA, USA, the Institutional Review Board of Columbia University Medical Center, New York, NY, USA, and the University of Cape Town Faculty of Health Sciences Human Research Ethics Committee, Cape Town, South Africa. MCH-ART trial participants provided written informed consent.

MCH-ART trial, modeled strategies, and population

MCH-ART (ClinicalTrials.gov NCT01933477) was a randomized controlled trial conducted in a subdistrict of Cape Town, South Africa (2013–2016) that evaluated two approaches to postpartum care for women initiating ART antenatally and their breastfed children [8]. The trial enrolled women at least 18 years of age who were less than 6 weeks postpartum (median [IQR] days postpartum: 5 [4,8]) and who had started ART during their recently completed pregnancy. In order to be eligible for trial enrollment, women had to be breastfeeding their infants at the time of screening. Mother-infant pairs enrolled in the trial were randomized to one of two arms. Standard of care consisted of immediate postnatal referral to separate general ART clinics for women and routine pediatric care for children. The MCH-ART intervention continued comprehensive maternal-pediatric care, integrated into MCH services through the end of breastfeeding. Then, women and children were referred to local clinics, as in the standard of care. A detailed costing study using bottom-up methodology was performed alongside the MCH-ART trial (S1 Appendix).

In this modeling analysis, we simulated cohorts of women and children similar to MCH-ART participants [8]. We examined two strategies that mirrored the two MCH-ART trial arms: SOC and MCH-ART [8]. ART use, testing for early infant diagnosis (EID), and laboratory monitoring were simulated in accordance with South African 2015 national guidelines [35]. We populated the CEPAC models with MCH-ART trial data on maternal retention, virologic suppression, breastfeeding practices, and EID uptake at 6–10 weeks and 18 months (S1 Table). Modeled infants in both strategies also had the opportunity for birth EID testing, with equivalent uptake in both strategies. Some children in the MCH-ART trial did not undergo EID testing, so we modeled vertical transmission rates based on published data rather than calibrating to those observed in the trial [8].

Model structure

The CEPAC-International and CEPAC-Pediatric models are Monte Carlo state-transition models of HIV infection, diagnosis, and therapy. Their structures have previously been published and are detailed in the S1 Appendix [911]. Simulated women enter the CEPAC-International model with a specified distribution of age, CD4 count, and HIV RNA level. At the beginning of the simulation, women enroll in HIV care and initiate first-line ART. Individuals stop ART while lost to follow-up and resume if they return to care, either after an OD or through re-engagement. The probability of suppressing HIV RNA to <50 copies/mL by six months and the monthly risk of subsequent virologic failure are modeled relative to ART adherence; better adherence results in improved virologic outcomes.

Children are simulated in the CEPAC-Pediatrics model until age 13 and then transition to the CEPAC-International model [9, 11]. Peri- and postnatal transmission risks are based on maternal CD4 count, ART use, virologic suppression, and breastfeeding practices. Model users specify the timing and frequency of EID testing [11, 35]. Children may also receive an HIV diagnosis after presentation to care with an OD. HIV-infected children start ART immediately upon diagnosis and linkage to care.

Model calibration and validation

We calibrated and validated the CEPAC models to maternal retention and virologic suppression targets from MCH-ART trial data (1-year targets) and data from cohorts of postpartum women on lifelong ART in sub-Saharan Africa (3-year targets; S1 Appendix, S4 Table). Virologic suppression was calibrated by simulating an improvement in adherence in MCH-ART relative to SOC, and calibrating both retention and virologic suppression to match trial data at 12 months. This “adherence adjustment” expired after 12 months, reflecting the end of the intervention; we assumed no ongoing influence of the intervention on care-seeking behaviors or ART adherence beyond 12 months postpartum. Therefore, the overall proportion of women retained in care and virologically suppressed was modeled to gradually equalize between the two strategies following the expiration of the adherence adjustment. Using the validated CEPAC models, we then projected clinical and economic outcomes beyond the 12-month scope of the trial.

Input parameters

The simulated maternal cohort reflected MCH-ART trial participants, with mean age 28.6 years, median pre-ART CD4 count 354/μL, and 76% virologic suppression at delivery (Table 1) [8]. We simulated the proportions of women retained in care (SOC: 71%, MCH-ART: 81%) and women retained and virologically suppressed (SOC: 49%, MCH-ART: 67%) at 12 months based on MCH-ART trial data [8]. Monthly probabilities of virologic failure and LTFU after 12 months were derived from published studies (S1 Table). Data from the MCH-ART trial also informed the proportion of breastfeeding women who were virologically suppressed during each month postpartum, mean breastfeeding duration (SOC: 6 months, MCH-ART: 8 months), exclusive breastfeeding rates (SOC: 71%, MCH-ART: 77%), and 6–10 week EID uptake (SOC: 78%, MCH-ART: 82%) [8]. The probability of an infant undergoing EID testing at 18 months was assumed to be the same as the 12-month maternal retention in care that was observed in the MCH-ART trial (SOC: 71%, MCH-ART: 81%), and was varied widely in sensitivity analyses (S5 Table). We conservatively assumed no intervention-related impact on infant ART uptake, retention in care, or virologic suppression. Women who were lost to follow-up were assumed to have the same monthly probability of breastfeeding their infants as those who remained in care. For breastfeeding women lost to follow-up, we assumed no use of ART, and we applied postpartum transmission risks associated with untreated HIV. We assumed that breastfeeding did not improve infant survival, and we challenged this assumption in sensitivity analyses. Full input specifications are available in S1 Table. [1332]

While in HIV care, simulated individuals accumulate CD4-stratified monthly routine care costs (Table 1). For the first 12 months, routine care costs (exclusive of diagnostic and drug costs) were replaced by the cumulative postpartum healthcare costs for the mother-child pair (SOC: $50, MCH-ART: $69) observed in the MCH-ART costing study (S1 Appendix) [8]. Costs were adjusted using GDP deflators and converted to 2016 US dollars [36, 37]. There was no additional adjustment for purchasing power parity, because in the absence of microcosting data, we were unable to distinguish tradeable from non-tradeable goods.

Sensitivity analyses

We performed extensive one- and multi-way deterministic sensitivity analyses, consistent with International Society for Pharmacoeconomics and Outcomes Research-Society for Medical Decision Making (ISPOR-SMDM) guidelines [11, 38]. We investigated the impact of changes in cohort characteristics, maternal retention and virologic suppression, duration of the MCH-ART intervention, routine care costs, EID uptake, and breastfeeding practices (S1 and S2 Tables). We performed sensitivity analyses evaluating an increased risk of infant mortality with replacement feeding. We also varied MCH-ART postpartum healthcare costs to address concerns about the potential for longer clinic visits leading to increased staffing needs with the intervention at scale. To assess uncertainty in the durability of the effect of the MCH-ART intervention, we examined the cost-effectiveness of MCH-ART if the effect of the intervention waned more rapidly after the end of the intervention than in the base case. In this analysis, rates of maternal loss to follow-up and ART non-adherence between 12–24 months postpartum were modeled as higher in MCH-ART than in SOC, to simulate a situation in which the percent of women retained and virologically suppressed in this strategy equalized to SOC estimates by 12 months post-intervention (24 months postpartum). In multi-way analyses, we simultaneously varied combined maternal retention and virologic suppression at 12 months, breastfeeding duration, and postpartum healthcare costs.

Budget impact analysis

We conducted a budget impact analysis to assess the short-term financial implications of adopting the MCH-ART integrated care strategy for all postpartum women with HIV in South Africa. Using the healthcare system perspective, we calculated cumulative, undiscounted costs over 2- and 5- year periods for the estimated 250,000 women eligible for the MCH-ART intervention each year and their children [1].

Results

Base case results

Projected one-year maternal mortality was similar in both strategies (SOC: 1.7%; MCH-ART 1.6%; Fig 1 black checkered + gray grid sections), but diverged by 10 years (SOC: 21%; MCH-ART: 18%). In SOC, 27% of mothers were missing from care at 5 years postpartum, as 6% had died while lost to follow-up (gray grid section; 23% of missing) and 21% were alive and lost to follow-up (red diagonal section; 77% of missing). In MCH-ART, 22% of mothers were missing from care at 5 years postpartum, including 4% who had died while lost to follow-up (20% of missing) and 18% who were alive and lost to follow-up (80% of missing). The overall percent of women who were in care and virologically suppressed equalized at 6 years after the end of the intervention and remained equal through 10 years postpartum (green dotted section). By 10 years postpartum, among the 31% and 28% mothers missing from care in SOC and MCH-ART, 51% in SOC and 44% in MCH-ART had died while LTFU.

Fig. 1. Maternal care cascade through 10 years postpartum.
Maternal care cascade through 10 years postpartum.
Projected outcomes for the starting maternal cohort at 1, 5, and 10 years postpartum are shown for the standard of care (SOC; left bar) and MCH-ART (right bar) strategies. Cumulative maternal mortality at each time point is demonstrated by the checkered black (while lost to follow-up) and gray grid (while in care) sections. Among mothers alive at 1 year, 5 years, and 10 years, those lost to follow-up (red, diagonal lines), in care and not virologically suppressed (solid yellow), and in care and virologically suppressed (green, dotted) are depicted.

Maternal undiscounted life expectancy from delivery was projected to be 25.26 years in SOC and 26.20 years in MCH-ART (Table 2). Modeled rates of pediatric HIV infection were similar in both strategies (SOC: 2.08%, MCH-ART: 2.06%). For the cohort of all HIV-exposed children, life expectancies were also similar between strategies (SOC: 62.23 years, MCH-ART: 62.25 years), which resulted in similar projected HIV-free survival in both strategies. Life expectancy for HIV-infected children was slightly lower in SOC (23.13 years) compared to MCH-ART (23.40 years) due to slightly higher EID uptake, leading to faster linkage to care and HIV treatment initiation in MCH-ART. Overall discounted HIV-related cost per mother-child pair was $10,173 with SOC and $10,487 with MCH-ART. With discounted, combined maternal and pediatric LE and costs, MCH-ART was cost-effective compared to SOC, with an ICER of $599/YLS.

Tab. 2. Base case results.
Base case results.

One-way sensitivity analyses

In one-way sensitivity analyses, conclusions were sensitive to changes in two key parameters (Fig 2). First, if the mean breastfeeding duration in MCH-ART increased to 14 months (base case: 8 months), without changing the mean breastfeeding duration in SOC (base case: 6 months), MCH-ART was no longer cost-effective due to more pediatric HIV infections from breastfeeding. However, the longer breastfeeding duration in MCH-ART offered a mortality benefit in sensitivity analyses with increased relative risk of infant mortality with replacement feeding (S3 Fig). Second, MCH-ART was also no longer cost-effective if the proportion of mothers retained in care and virologically suppressed at 12 months in MCH-ART was less than 58% (base case: 67%, compared to 49% in SOC). MCH-ART remained cost-effective despite wide variations in all other input parameters, including the duration of the intervention, routine care costs, postpartum healthcare costs, maternal LTFU after 12 months, rates of long-term maternal re-engagement in care, EID uptake at all timepoints, and maternal pre-ART CD4 count (Fig 2; S5 Table). Notably, MCH-ART remained cost-effective even when the effect of the intervention waned completely over 1 year, resulting in equivalent proportions of women retained and virologically suppressed at 1 year post-intervention (base case: outcomes equalize at 6 years), with no lingering benefit from the intervention after 1 year.

Fig. 2. Tornado diagram of one-way sensitivity analyses.
Tornado diagram of one-way sensitivity analyses.
Results of one-way sensitivity analyses of 8 key model input parameters (vertical axis) are shown. The ICER ($/YLS) of MCH-ART compared to SOC is displayed along the horizontal axis. Base case inputs for each varied parameter are listed prior to the semicolon; after the semicolon is the range examined with the first value indicating the value of the left-most part of the bar. Parameters were varied through the range listed (S2 Table details rationale for ranges), with the input that contributes to the lowest ICER for the range listed first. The thick black vertical line marks the base case ICER (9/YLS). The dotted line represents the cost-effectiveness threshold (3/YLS; see text). Numbers in white reflect the value at which parameters crossed the cost-effectiveness threshold. ICER: incremental cost-effectiveness ratio; ART: antiretroviral therapy; LTFU: loss to follow-up; YLS: year of life saved.

Multi-way sensitivity analyses

In multi-way analyses, we simultaneously varied maternal retention at 12 months postpartum in MCH-ART (base case: MCH-ART: 81%, SOC: 71%), virologic suppression among mothers retained in care (base case: MCH-ART: 80%, SOC: 68%), and MCH-ART postpartum healthcare costs (base case: MCH-ART: $69, SOC: $50), holding all other parameters equal to the base case (Fig 3). Increasing retention in MCH-ART without increasing virologic suppression resulted in ICERs >$903/YLS. With both base case ($69, Fig 3A) and 2x base case ($138, Fig 3B) MCH-ART postpartum healthcare costs, no level of retention achieved in MCH-ART was cost-effective compared to the SOC base case if only 60% of mothers in care had virologic suppression. As virologic suppression among those in care improved, MCH-ART became increasingly cost-effective.

Fig. 3. Multi-way sensitivity analyses.
Multi-way sensitivity analyses.
In panels A and B, the proportion of mothers retained in care at 12-months in MCH-ART is demonstrated on the vertical axis and the proportion of virologically suppressed mothers among those retained in care in MCH-ART is shown on the horizontal axis. Without commensurate improvements in suppression, increasing retention alone results in MCH-ART being no longer cost-effective (yellow). MCH-ART was cost-effective at a wider range of combinations of maternal retention and virologic suppression among mothers retained in care with MCH-ART postpartum healthcare costs at (A, base case costs) compared to 8 (B, 2x base case costs). ICER: incremental cost-effectiveness ratio; SOC: standard of care; YLS: year of life saved.

Budget impact analysis

For the approximately 250,000 women with HIV in South Africa becoming pregnant each year (1.25 million women over five years), providing HIV-related care for both mothers and children led to estimated costs of $384 million ($1,032/mother-child pair) over two years and $1.94 billion ($2,603/pair) over five years. The MCH-ART intervention increased costs to $392 million ($1,071/pair) over two years and $1.99 billion ($2,683/pair) over five years. Widespread uptake of the MCH-ART platform would require a 2.0% increase in the total 2-year budget for these postpartum women with HIV and their children, and a 2.3% increase in the 5-year budget. We projected 1,710 maternal and 60 child deaths averted by the MCH-ART intervention at 2 years and 10,900 maternal and 230 child deaths averted by 5 years.

Discussion

We evaluated integrated postpartum maternal ART and pediatric care using a detailed microsimulation model of HIV disease, populated with data from the MCH-ART trial. The MCH-ART trial demonstrated improved maternal engagement and virologic suppression with the MCH-ART intervention compared to the standard of care [8]. Other studies have demonstrated a similar, positive effect of integrated services on retention, but to our knowledge, MCH-ART is the first to show improvement in both retention and virologic suppression [39, 40]. Our results demonstrate that, in addition to being clinically effective, the MCH-ART intervention is cost-effective, with an ICER of $599/YLS. The MCH-ART approach to integrated postpartum care is projected to require a modest increase in resources over 5 years, increasing costs by $44 million (2.3%) while averting over 11,000 deaths among 1.25 million postpartum mothers with HIV and their children, and offers excellent value in South Africa given a wide range of clinical and cost assumptions.

Our findings highlight the substantial adverse impact of maternal disengagement from care on long-term maternal and pediatric health outcomes. By 5 and 10 years postpartum, approximately 25% and 50% of mothers with HIV who were lost to follow-up were projected to have died. These estimates are consistent with data from observational cohorts of adults with HIV in sub-Saharan Africa, although these studies are not specific to postpartum women who may have higher rates of re-engagement in ART care through subsequent pregnancies [41, 42]. However, fundamental conclusions about the cost-effectiveness of integrated care did not change in sensitivity analyses that explored higher rates of re-engagement in care over time. Adverse maternal outcomes are also associated with increased pediatric morbidity and mortality [43]. While increasing maternal retention in care in the first year postpartum improves maternal and pediatric clinical outcomes, our results suggest that the cost-effectiveness of a retention intervention may be compromised without corresponding improvement in virologic suppression among those retained. These findings support placing emphasis on the whole care cascade, e.g., maternal retention in care, ART adherence, and virologic suppression, when evaluating interventions aiming to improve maternal and child health.

With the breastfeeding duration observed in the MCH-ART trial, we found that pediatric outcomes are most strongly related to maternal care engagement in the first year postpartum. During this window, postnatal HIV transmission risks are highest, and EID is critical to promoting early pediatric ART initiation. Using the 6–10 week EID uptake observed in the MCH-ART trial, we found that integrated care may result in slightly better survival among HIV-infected infants due to earlier HIV detection and ART initiation. However, with the recent increase in EID testing at birth in South Africa, the small difference in 6–10 week EID uptake observed in the MCH-ART trial may no longer be clinically relevant [44]. As the burden of new pediatric infections continues to shift postpartum, maternal and infant retention in care through completion of the EID cascade, e.g. completion of pediatric HIV testing at the end of the breastfeeding period, will become increasingly important [1].

Breastfeeding is an important factor in overall infant health and survival, though its benefits can be offset by extended risks of postnatal transmission if mothers are not virologically suppressed [43]. In both arms of the MCH-ART trial, the median duration of breastfeeding was lower than the World Health Organization-recommended 12 months of breastfeeding for women with HIV in resource-limited settings who are supported on ART [45]. With this relatively short window of risk for HIV transmission and high proportion of women who were virologically suppressed in the early postpartum period, we projected low overall postnatal transmission with both MCH-ART and SOC, similar to the risks reported for other cohorts of women taking three-drug ART during breastfeeding [15, 46, 47]. Under the base case assumption that breastfeeding offered no health benefit to infants, the longer window of potential postnatal transmission in MCH-ART was almost exactly offset by lower transmission risks from improved maternal virologic suppression. Thus, projected HIV-free child survival in both strategies was similar. However, in many resource-limited settings, particularly settings where water supplies are unsafe or quantities of formula are nutritionally inadequate, breastfeeding reduces risks for bacterial infections, malnutrition, and mortality relative to replacement feeding [43]. Services that improve postpartum engagement in care while also supporting safe breastfeeding practices in these settings are critical to promoting healthy, HIV-free child survival.

As there is no consensus on the best cost-effectiveness threshold to use in economic evaluations in resource-limited settings, we used the CEPAC models to determine a cost-effectiveness threshold based on the benchmark intervention of second-line ART in South Africa [34, 4850]. In the absence of robust pediatric health utility data from sub-Saharan Africa, we reported results in life years saved rather than quality-adjusted life years (QALYs) saved or disability-adjusted life-years (DALYs) averted. However, conclusions about the cost-effectiveness of integrated postpartum care are unlikely to change with use of health-related quality of life metrics, as quality of life would not be expected to differ substantially between strategies for this population of women healthy enough to become pregnant [51]. Our cost-effectiveness threshold of $903/YLS is similar to the threshold range identified in the South African HIV Investment Case (ICER: $547-$872/YLS), which explored the optimal combination of HIV-related interventions to improve health outcomes given budgetary constraints in South Africa [50]. The ICER of MCH-ART versus SOC (ICER: $599/YLS) compares favorably to that of other HIV-related MCH interventions in South Africa, including a rapid ART initiation program in pregnancy (ICER: $1,160/quality-adjusted life year saved) and infant birth EID testing (ICER: $2,206-$2,900/YLS) [50, 52, 53]. Published ICERs of infant birth EID testing, which is widely implemented in South Africa, are also higher than our cost-effectiveness threshold of $903/YLS, which suggests that this threshold is conservative; true willingness to pay for the health of HIV-exposed infants may be higher in South Africa. Our findings suggest that, regardless of the approach used to determine the cost-effectiveness threshold, integrated postpartum care is likely to offer good value relative to other health interventions in South Africa.

Prior modeling analyses have demonstrated the cost-effectiveness of integrating HIV care with family planning services, cervical cancer screening, and tuberculosis screening [6, 54]. Integration of these services may increase the efficiency of service delivery while also improving patient satisfaction [6]. However, concerns have been raised that service integration could increase workload among clinic personnel, leading to accelerated provider burnout, reduced quality of care, and prolonged patient waiting times, any of which could undermine clinical- and cost-effectiveness at scale [6, 7]. We performed a multi-way sensitivity analysis of postpartum healthcare costs in MCH-ART and maternal retention and virologic suppression to assess the potential impact of increased costs related to longer patient visit times and/or increased personnel needs with larger patient volumes at scale. With the level of maternal engagement in care observed in the MCH-ART trial, the integrated care intervention remained cost-effective even with postpartum healthcare costs 2-fold higher than measured in the MCH-ART costing study [8].

The durability of impact from integrated care interventions like MCH-ART in the long run remains unclear. We conservatively assumed no improvement in care engagement from the MCH-ART intervention after 12 months postpartum, which resulted in the gradual equalization of outcomes by 6 years after the end of the intervention. If the intervention proves more lasting in promoting continued care engagement, then we may have underestimated its value. Conversely, the MCH-ART intervention may only delay “inevitable” post-breastfeeding attrition after the intervention ends. We evaluated this possibility in our sensitivity analysis of the durability of the intervention, which showed that MCH-ART remained cost-effective, even if any improvement in overall engagement in care had completely faded by 1 year after the end of the intervention. Over a lifetime time horizon, the absolute projected clinical benefit from the 12-month MCH-ART intervention was small, but the intervention still offered good value at relatively low cost. While innovative integrated service delivery platforms are implemented and scaled up in resource-limited settings, further research is needed to assess tradeoffs in costs, provider workload, patient satisfaction, and quality of care, as well as the durability of impact on patient outcomes over time.

Our analysis has several limitations. First, as with any model-based analysis, uncertainty is inherent in long-term projections. Few data exist to inform patterns of long-term retention and ART adherence among women who initiate ART during pregnancy, and retention is variably defined [55]. However, we calibrated our model to the best available data for up to three years postpartum. Longitudinal observational studies are needed to confirm the long-term clinical outcomes and cost-effectiveness of integrated postpartum care in a “real-world” context. Second, we did not account for subsequent pregnancies that may attenuate budget impact or prompt re-engagement in care. Keeping women engaged and virologically suppressed on ART as they enter a second pregnancy may have important impacts on maternal health, obstetric outcomes, and perinatal HIV transmission, and could improve the value of the intervention [56]. Third, to reflect the MCH-ART trial, we simulated only breastfeeding women who were not already taking ART at the beginning of pregnancy. Women whose infants are formula-fed or who are on ART at conception (approximately 37% of the population screened for the MCH-ART trial), may have retention and adherence behaviors that would be affected differently by integrated services [8]. However, a recent study from South Africa found that women who conceived while on ART had higher rates of postpartum virologic failure than those who started ART during pregnancy, and thus may also benefit from interventions to improve care engagement and ART adherence [57]. Finally, our model input data and assumptions are informed by the South African healthcare system. Nonetheless, model outcomes may still be generalizable outside of this context, as the results were robust to wide variations in maternal characteristics, timing of antenatal ART initiation, EID uptake, and routine care costs, all relevant to a range of other resource-limited settings.

Conclusions

The MCH-ART trial showed that integrating postpartum maternal ART and pediatric care into MCH services improves clinical outcomes at one year. We found that this intervention is likely to lead to improved life expectancy among mothers and HIV-infected infants and is cost-effective in South Africa. This approach to integrated postpartum care should be more widely implemented to improve maternal and child health.

Supporting information

S1 Checklist [docx]
Consolidated health economic evaluation reporting standards (CHEERS) checklist.

S1 Appendix [docx]
Provides further detail regarding modeling methods, CEPAC structure, model calibration, and methods for sensitivity and scenario analyses.

S1 Fig [tiff]
Cohort size estimation.

S2 Fig [tiff]
One-way sensitivity analysis of pediatric HIV infection and breastfeeding duration.

S3 Fig [tiff]
One-way sensitivity analysis of five-year HIV-free child survival with increased relative risk of non-AIDS mortality with replacement feeding (RR-RF).

S1 Table [docx]
Input parameters for a simulation model of women with HIV and their children in South Africa.

S2 Table [docx]
Sources of data and ranges for sensitivity analyses.

S3 Table [docx]
Model output used to determine the cost-effectiveness threshold.

S4 Table [docx]
Model calibration and validation of maternal engagement in care.

S5 Table [docx]
Results of selected one-way sensitivity analyses.


Zdroje

1. UNAIDS. AIDSInfo [cited 2019 August 26]. Available from: http://aidsinfo.unaids.org/.

2. Knettel BA, Cichowitz C, Ngocho JS, Knippler ET, Chumba LN, Mmbaga BT, et al. Retention in HIV care during pregnancy and the postpartum period in the option B+ era: A systematic review and meta-analysis of studies in Africa. J Acquir Immune Defic Syndr. 2017. doi: 10.1097/QAI.0000000000001616 29287029

3. Chetty T, Newell ML, Thorne C, Coutsoudis A. Viraemia before, during and after pregnancy in HIV-infected women on antiretroviral therapy in rural KwaZulu-Natal, South Africa, 2010–2015. Trop Med Int Health. 2018;23(1):79–91. doi: 10.1111/tmi.13001 29121445

4. Haas AD, Tenthani L, Msukwa MT, Tal K, Jahn A, Gadabu OJ, et al. Retention in care during the first 3 years of antiretroviral therapy for women in Malawi's option B+ programme: an observational cohort study. Lancet HIV. 2016;3(4):e175–82. doi: 10.1016/S2352-3018(16)00008-4 27036993

5. Phillips T, Thebus E, Bekker LG, McIntyre J, Abrams EJ, Myer L. Disengagement of HIV-positive pregnant and postpartum women from antiretroviral therapy services: a cohort study. J Int AIDS Soc. 2014;17:19242. doi: 10.7448/IAS.17.1.19242 25301494

6. Kiragu K, Collins L, Von Zinkernagel D, Mushavi A. Integrating PMTCT Into maternal, newborn, and child health and related services: experiences from the global plan priority countries. J Acquir Immune Defic Syndr. 2017;75 Supplem(1):S36–S42.

7. Winestone LE, Bukusi EA, Cohen CR, Kwaro D, Schmidt NC, Turan JM. Acceptability and feasibility of integration of HIV care services into antenatal clinics in rural Kenya: a qualitative provider interview study. Glob Public Health. 2012;7(2):149–63. doi: 10.1080/17441692.2011.621964 22043837

8. Myer L, Phillips TK, Zerbe A, Brittain K, Lesosky M, Hsiao NY, et al. Integration of postpartum healthcare services for HIV-infected women and their infants in South Africa: A randomised controlled trial. PLoS Med. 2018;15(3):e1002547. doi: 10.1371/journal.pmed.1002547 29601570

9. Ciaranello AL, Morris BL, Walensky RP, Weinstein MC, Ayaya S, Doherty K, et al. Validation and calibration of a computer simulation model of pediatric HIV infection. PLoS One. 2013;8(12):e83389. doi: 10.1371/journal.pone.0083389 24349503

10. Walensky RP, Ross EL, Kumarasamy N, Wood R, Noubary F, Paltiel AD, et al. Cost-effectiveness of HIV treatment as prevention in serodiscordant couples. N Engl J Med. 2013;369(18):1715–25. doi: 10.1056/NEJMsa1214720 24171517

11. Dunning L, Francke JA, Mallampati D, MacLean RL, Penazzato M, Hou T, et al. The value of confirmatory testing in early infant HIV diagnosis programmes in South Africa: A cost-effectiveness analysis. PLoS Med. 2017;14(11):e1002446. Detailed description of how CEPAC follows ISPOR guidelines for analyzing and reporting the impact of uncertainty are in the online Table S2 accompanying this manuscript. doi: 10.1371/journal.pmed.1002446 29161262

12. Massachusetts General Hospital Medical Practice Evaluation Center. Cost-Effectiveness of Preventing AIDS Complications (CEPAC) Model [cited 2018 November 30]. Available from: http://www.massgeneral.org/mpec/cepac/.

13. Mandelbrot L, Tubiana R, Le Chenadec J, Dollfus C, Faye A, Pannier E, et al. No perinatal HIV-1 transmission from women with effective antiretroviral therapy starting before conception. Clin Infect Dis. 2015;61(11):1715–25. doi: 10.1093/cid/civ578 26197844

14. Myer L, Phillips TK, McIntyre JA, Hsiao NY, Petro G, Zerbe A, et al. HIV viraemia and mother-to-child transmission risk after antiretroviral therapy initiation in pregnancy in Cape Town, South Africa. HIV Med. 2017;18(2):80–8. doi: 10.1111/hiv.12397 27353189

15. Shapiro RL, Hughes MD, Ogwu A, Kitch D, Lockman S, Moffat C, et al. Antiretroviral regimens in pregnancy and breast-feeding in Botswana. N Engl J Med. 2010;362(24):2282–94. doi: 10.1056/NEJMoa0907736 20554983

16. Perry ME, Taylor GP, Sabin CA, Conway K, Flanagan S, Dwyer E, et al. Lopinavir and atazanavir in pregnancy: comparable infant outcomes, virological efficacies and preterm delivery rates. HIV Med. 2016;17(1):28–35. doi: 10.1111/hiv.12277 26200570

17. Kesho Bora Study Group. Triple antiretroviral compared with zidovudine and single-dose nevirapine prophylaxis during pregnancy and breastfeeding for prevention of mother-to-child transmission of HIV-1 (Kesho Bora study): a randomised controlled trial. Lancet Infect Dis. 2011;11(3):171–80. doi: 10.1016/S1473-3099(10)70288-7 21237718

18. Cohan D, Natureeba P, Koss CA, Plenty A, Luwedde F, Mwesigwa J, et al. Efficacy and safety of lopinavir/ritonavir versus efavirenz-based antiretroviral therapy in HIV-infected pregnant Ugandan women. AIDS. 2015;29(2):183–91. doi: 10.1097/QAD.0000000000000531 25426808

19. Peltier CA, Ndayisaba GF, Lepage P, van Griensven J, Leroy V, Pharm CO, et al. Breastfeeding with maternal antiretroviral therapy or formula feeding to prevent HIV postnatal mother-to-child transmission in Rwanda. AIDS. 2009;23(18):2415–23. doi: 10.1097/QAD.0b013e32832ec20d 19730349

20. Ngoma MS, Misir A, Mutale W, Rampakakis E, Sampalis JS, Elong A, et al. Efficacy of WHO recommendation for continued breastfeeding and maternal cART for prevention of perinatal and postnatal HIV transmission in Zambia. J Int AIDS Soc. 2015;18:19352. doi: 10.7448/IAS.18.1.19352 26140453

21. Kilewo C, Karlsson K, Massawe A, Lyamuya E, Swai A, Mhalu F, et al. Prevention of mother-to-child transmission of HIV-1 through breast-feeding by treating infants prophylactically with lamivudine in Dar es Salaam, Tanzania: the Mitra Study. J Acquir Immune Defic Syndr. 2008;48(3):315–23. doi: 10.1097/QAI.0b013e31816e395c 18344879

22. Thomas TK, Masaba R, Borkowf CB, Ndivo R, Zeh C, Misore A, et al. Triple-antiretroviral prophylaxis to prevent mother-to-child HIV transmission through breastfeeding—the Kisumu Breastfeeding Study, Kenya: a clinical trial. PLoS Med. 2011;8(3):e1001015. doi: 10.1371/journal.pmed.1001015 21468300

23. Chigwedere P, Seage GR, Lee TH, Essex M. Efficacy of antiretroviral drugs in reducing mother-to-child transmission of HIV in Africa: a meta-analysis of published clinical trials. AIDS Res Hum Retroviruses. 2008;24(6):827–37. doi: 10.1089/aid.2007.0291 18544018

24. Iliff PJ, Piwoz EG, Tavengwa NV, Zunguza CD, Marinda ET, Nathoo KJ, et al. Early exclusive breastfeeding reduces the risk of postnatal HIV-1 transmission and increases HIV-free survival. AIDS. 2005;19(7):699–708. doi: 10.1097/01.aids.0000166093.16446.c9 15821396

25. Fawzi W, Msamanga G, Spiegelman D, Renjifo B, Bang H, Kapiga S, et al. Transmission of HIV-1 through breastfeeding among women in Dar es Salaam, Tanzania. J Acquir Immune Defic Syndr. 2002;31(3):331–8. doi: 10.1097/00126334-200211010-00010 12439210

26. Petra Study Team. Efficacy of three short-course regimens of zidovudine and lamivudine in preventing early and late transmission of HIV-1 from mother to child in Tanzania, South Africa, and Uganda (Petra study): a randomised, double-blind, placebo-controlled trial. The Lancet. 2002;359(9313):1178–86. doi: 10.1016/s0140-6736(02)08214-4

27. Leroy V, Karon JM, Alioum A, Ekpini ER, Meda N, Greenberg AE, et al. Twenty-four month efficacy of a maternal short-course zidovudine regimen to prevent mother-to-child transmission of HIV-1 in West Africa. AIDS. 2002;16(4):631–41. doi: 10.1097/00002030-200203080-00016 11873008

28. Dabis F, Bequet L, Ekouevi DK, Viho I, Rouet F, Horo A, et al. Field efficacy of zidovudine, lamivudine and single-dose nevirapine to prevent peripartum HIV transmission. AIDS. 2005;19(3):309–18. 15718842

29. Thior I, Lockman S, Smeaton LM, Shapiro RL, Wester C, Heymann SJ, et al. Breastfeeding plus infant zidovudine prophylaxis for 6 months vs formula feeding plus infant zidovudine for 1 month to reduce mother-to-child HIV transmission in Botswana: a randomized trial: the Mashi Study. JAMA. 2006;296(7):794–805. doi: 10.1001/jama.296.7.794 16905785

30. Kuhn L, Aldrovandi GM, Sinkala M, Kankasa C, Semrau K, Mwiya M, et al. Effects of early, abrupt weaning on HIV-free survival of children in Zambia. N Engl J Med. 2008;359(2):130–41. doi: 10.1056/NEJMoa073788 18525036

31. Clinton Health Access Initiative. Antiretroviral CHAI reference price list 2016 [cited 2019 August 26]. Available from: https://clintonhealthaccess.org/content/uploads/2016/11/2016-CHAI-ARV-Reference-Price-List_FINAL.pdf.

32. Cleary S, Chitha W, Jikwana S, Okorafor OA, Boulle A. Health systems trust: South African health review. 2005.

33. Sanders GD, Neumann PJ, Basu A, Brock DW, Feeny D, Krahn M, et al. Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analyses: Second panel on cost-effectiveness in health and medicine. JAMA. 2016;316(10):1093–103. doi: 10.1001/jama.2016.12195 27623463

34. Marseille E, Larson B, Kazi DS, Kahn JG, Rosen S. Thresholds for the cost-effectiveness of interventions: alternative approaches. Bull World Health Organ. 2015;93(2):118–24. doi: 10.2471/BLT.14.138206 25883405

35. South Africa Department of Health. National consolidated guidelines for the prevention of mother-to-child transmission of HIV (PMTCT) and the management of HIV in children, adolescents, and adults. 2015. [cited: 26 August 2019]. Available from: http://www.sahivsoc.org/Files/ART%20Guidelines%2015052015.pdf.

36. International Monetary Fund. World Economic Outlook Database, April 2017 Edition [cited 2019 August 26]. Available from: https://www.imf.org/external/pubs/ft/weo/2017/02/weodata/index.aspx.

37. Oanda. Historical Exchange Rates, Period Average [cited 2019 August 26]. Available from: http://www.oanda.com/currency/historical-rates/.

38. Briggs AH, Weinstein MC, Fenwick EA, Karnon J, Sculpher MJ, Paltiel AD, et al. Model parameter estimation and uncertainty analysis: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force Working Group-6. Med Decis Making. 2012;32(5):722–32. doi: 10.1177/0272989X12458348 22990087

39. Aliyu MH, Blevins M, Audet CM, Kalish M, Gebi UI, Onwujekwe O, et al. Integrated prevention of mother-to-child HIV transmission services, antiretroviral therapy initiation, and maternal and infant retention in care in rural north-central Nigeria: a cluster-randomised controlled trial. Lancet HIV. 2016;3(5):e202–11. doi: 10.1016/S2352-3018(16)00018-7 27126487

40. Guillaine N, Mwizerwa W, Odhiambo J, Hedt-Gauthier BL, Hirschhorn LR, Mugwaneza P, et al. A novel combined mother-infant clinic to optimize post-partum maternal retention, service utilization, and linkage to services in HIV care in rural Rwanda. Int J MCH AIDS. 2017;6(1):36–45. doi: 10.21106/ijma.186 28798892

41. Haas AD, Zaniewski E, Anderegg N, Ford N, Fox MP, Vinikoor M, et al. Retention and mortality on antiretroviral therapy in sub-Saharan Africa: collaborative analyses of HIV treatment programmes. J Int AIDS Soc. 2018;21(2). doi: 10.1002/jia2.25084 29479867

42. Chammartin F, Zurcher K, Keiser O, Weigel R, Chu K, Kiragga AN, et al. Outcomes of Patients Lost to Follow-up in African Antiretroviral Therapy Programs: Individual Patient Data Meta-analysis. Clin Infect Dis. 2018;67(11):1643–52. doi: 10.1093/cid/ciy347 29889240

43. Arikawa S, Rollins N, Jourdain G, Humphrey J, Kourtis AP, Hoffman I, et al. Contribution of maternal ART and breastfeeding to 24-month survival in HIV-exposed uninfected children: an individual pooled analysis of African and Asian studies. Clin Infect Dis. 2017. doi: 10.1093/cid/cix1102 29272387

44. Kalk E, Kroon M, Boulle A, Osler M, Euvrard J, Stinson K, et al. Neonatal and infant diagnostic HIV-PCR uptake and associations during three sequential policy periods in Cape Town, South Africa: a longitudinal analysis. J Int AIDS Soc. 2018;21(11):e25212. doi: 10.1002/jia2.25212 30480373

45. World Health Organization. Updates on HIV and infant feeding. Geneva, Switzerland 2016. [cited: July 17, 2019]. Available from: https://apps.who.int/iris/bitstream/handle/10665/246260/9789241549707-eng.pdf;jsessionid=723C97C531D5147D5B72B3514C35213E?sequence=1.

46. Flynn PM, Taha TE, Cababasay M, Fowler MG, Mofenson LM, Owor M, et al. Prevention of HIV-1 transmission through breastfeeding: efficacy and safety of maternal antiretroviral therapy versus infant nevirapine prophylaxis for duration of breastfeeding in HIV-1-infected women with high CD4 cell count (IMPAACT PROMISE): a randomized, open-label, clinical trial. J Acquir Immune Defic Syndr. 2018;77(4):383–92. doi: 10.1097/QAI.0000000000001612 29239901

47. Goga AE, Jackson DJ, Lombard C, Ramokolo V, Ngandu N, Sherman G, et al. Highest risk of mother to child transmission of HIV or death in the first 6 months postpartum: results from 18 month follow-up of an HIV-exposed national cohort, South Africa. AIDS; Durban, South Africa, 2016. [cited: 2019 August 25]. Available from: http://programme.aids2016.org/Programme/Session/992.

48. Woods B, Revill P, Sculpher M, and Claxton K. Country-level cost-effectiveness thresholds: Initial estimates and the need for further research. Centre for Health Economics, University of York, UK, 2015.].

49. Robinson LA, Hammitt JK, Chang AY, Resch S. Understanding and improving the one and three times GDP per capita cost-effectiveness thresholds. Health Policy Plan. 2017;32(1):141–5. doi: 10.1093/heapol/czw096 27452949

50. Meyer-Rath G, van Rensburg C, Larson B, Jamieson L, Rosen S. Revealed willingness-to-pay versus standard cost-effectiveness thresholds: Evidence from the South African HIV Investment Case. PLoS One. 2017;12(10):e0186496. doi: 10.1371/journal.pone.0186496 29073167

51. Chapman RH, Berger M, Weinstein MC, Weeks JC, Goldie S, Neumann PJ. When does quality-adjusting life-years matter in cost-effectiveness analysis? Health Econ. 2004;13(5):429–36. doi: 10.1002/hec.853 15127423

52. Francke JA, Penazzato M, Hou T, Abrams EJ, MacLean RL, Myer L, et al. Clinical impact and cost-effectiveness of diagnosing HIV infection during early infancy in South Africa: test timing and frequency. The Journal of infectious diseases. 2016;214(9):1319–28. doi: 10.1093/infdis/jiw379 27540110

53. Zulliger R, Black S, Holtgrave DR, Ciaranello AL, Bekker LG, Myer L. Cost-effectiveness of a package of interventions for expedited antiretroviral therapy initiation during pregnancy in Cape Town, South Africa. AIDS and behavior. 2014;18(4):697–705. doi: 10.1007/s10461-013-0641-7 24122044

54. Andrews JR, Lawn SD, Rusu C, Wood R, Noubary F, Bender MA, et al. The cost-effectiveness of routine tuberculosis screening with Xpert MTB/RIF prior to initiation of antiretroviral therapy: a model-based analysis. AIDS. 2012;26(8):987–95. doi: 10.1097/QAD.0b013e3283522d47 22333751

55. Grimsrud AT, Cornell M, Egger M, Boulle A, Myer L. Impact of definitions of loss to follow-up (LTFU) in antiretroviral therapy program evaluation: variation in the definition can have an appreciable impact on estimated proportions of LTFU. J Clin Epidemiol. 2013;66(9):1006–13. doi: 10.1016/j.jclinepi.2013.03.013 23774112

56. Stewart RD, Wells CE, Roberts SW, Rogers VL, McElwee BS, McIntire DD, et al. Benefit of interpregnancy HIV viral load suppression on subsequent maternal and infant outcomes. Am J Obstet Gynecol. 2014;211(3):297 e1–6. doi: 10.1016/j.ajog.2014.04.020 24746998

57. Onoya D, Sineke T, Brennan AT, Long L, Fox MP. Timing of pregnancy, postpartum risk of virologic failure and loss to follow-up among HIV-positive women. AIDS. 2017;31(11):1593–602. doi: 10.1097/QAD.0000000000001517 28463877


Článek vyšel v časopise

PLOS One


2019 Číslo 11
Nejčtenější tento týden
Nejčtenější v tomto čísle
Kurzy

Zvyšte si kvalifikaci online z pohodlí domova

plice
INSIGHTS from European Respiratory Congress
nový kurz

Současné pohledy na riziko v parodontologii
Autoři: MUDr. Ladislav Korábek, CSc., MBA

Svět praktické medicíny 3/2024 (znalostní test z časopisu)

Kardiologické projevy hypereozinofilií
Autoři: prof. MUDr. Petr Němec, Ph.D.

Střevní příprava před kolonoskopií
Autoři: MUDr. Klára Kmochová, Ph.D.

Všechny kurzy
Kurzy Podcasty Doporučená témata Časopisy
Přihlášení
Zapomenuté heslo

Zadejte e-mailovou adresu, se kterou jste vytvářel(a) účet, budou Vám na ni zaslány informace k nastavení nového hesla.

Přihlášení

Nemáte účet?  Registrujte se

#ADS_BOTTOM_SCRIPTS#