- Open Access
The effect of national antenatal care guidelines and provider training on obstetric danger sign counselling: a propensity score matching analysis of the 2014 Ethiopia service provision assessment plus survey
Reproductive Health volume 19, Article number: 132 (2022)
Most pregnant women in low and lower-middle-income countries do not receive all components of antenatal care (ANC), including counselling on obstetric danger signs. Facility-level ANC guidelines and provider in-service training are major factors influencing ANC counselling. In Ethiopia, little is known about the extent to which guidelines and provider in-service training can increase the quality of ANC counselling.
We examined the effect of national ANC guidelines and ANC provider in-service training on obstetric danger sign counselling for pregnant women receiving ANC using the 2014 Ethiopian service provision assessment plus (ESPA +) survey data. We created two analysis samples by applying a propensity score matching method. The first sample consisted of women who received ANC at health facilities with guidelines matched with those who received ANC at health facilities without guidelines. The second sample consisted of women who received ANC from the providers who had undertaken in-service training in the last 24 months matched with women who received ANC from untrained providers. The outcome variable was the number of obstetric danger signs described during ANC counselling, ranging from zero to eight. The covariates included women’s socio-demographic characteristics, obstetric history, health facility characteristics, and ANC provider characteristics.
We found that counselling women about obstetric danger signs during their ANC session varied according to the availability of ANC guidelines (61% to 70%) and provider training (62% to 68%). After matching the study participants by the measured covariates, the availability of ANC guidelines at the facility level significantly increased the average number of obstetric danger signs women received during counselling by 24% (95% CI: 12–35%). Similarly, providing refresher training for ANC providers increased the average number of obstetric danger signs described during counselling by 37% (95% CI: 26–48%).
The findings suggest that the quality of ANC counselling in Ethiopia needs strengthening by ensuring that ANC guidelines are available at every health facility and that the providers receive regular ANC related in-service training.
Plain language summary
Maternal death from preventable pregnancy-related complications remains a global health challenge. In 2017, there were 295,000 maternal deaths worldwide, and about two-thirds of these deaths were from Sub-Saharan Africa. Ethiopia is a Sub-Saharan African country with 401 maternal deaths per 100,000 live births in 2017, and this rate is higher than the target indicated in sustainable development goals. Most maternal deaths are due to obstetric complications and could have been averted through early detection and treatment. Providing antenatal care counselling about obstetric danger signs enhances women’s awareness of obstetric complications and encourages women to seek treatment from a skilled care provider. However, most women from low-income settings, including Ethiopia, do not receive counselling about obstetric danger signs. Facility-level antenatal care guidelines and provider in-service training improve antenatal care counselling. In Ethiopia, little is known to what extent antenatal care guidelines and provider training increase counselling on obstetric danger signs. The present study used the 2014 Ethiopian service provision assessment data and estimated the effect of antenatal care guidelines and provider training on counselling about obstetric danger signs. The analysis involved a propensity score matching method and included 1725 pregnant women. The study found that antenatal care guidelines at health facilities and antenatal care provider in-service training significantly increase counselling on obstetric danger signs by 24% and 37%, respectively. The finding suggests improving the quality of antenatal care counselling in Ethiopia needs antenatal care guidelines at each antenatal care clinic and refresher training for the providers.
Maternal death, the death of a woman while pregnant, during childbirth, or within 42 completed days of termination of pregnancy , remains a global health challenge [2, 3]. It has a negative effect on infant and child survival, the well-being of the family and society, and the country's socio-economic development by increasing health costs and reducing productivity [4,5,6]. As a result, improving maternal health and reducing maternal mortality is key to achieving sustainable development goals (SDGs). Sustainable development goal target 3 includes reducing the maternal mortality ratio to less than 70 per 100,000 live birth by 2030 [7,8,9].
Between 2000 and 2017, there was a 38% decline in the global maternal mortality ratio (MMR). In 2017 there were 295,000 maternal deaths, with an estimated 211 maternal deaths per 100,000 live births. This rate is higher than the SDG target. About 94% of these maternal deaths were from low-income countries. Sub-Saharan Africa (SSA) alone had 196,000 maternal deaths, accounting for nearly two-thirds of the global maternal deaths [2, 3, 8]. Ethiopia is an SSA country where maternal deaths have remained very high, particularly between 2000 and 2011. There were 871, 673 and 676 maternal deaths per 100,000 live births in 2000, 2005 and 2011, respectively [10,11,12]. As a result, the Ethiopian Ministry of Health has prioritised maternal health. The Ministry of Health launched the health sector development program (HSTP) in 2015 that outlined strategies to provide quality healthcare . The main focus of the HSTP is to ensure universal health coverage by strengthening primary healthcare , including training and deploying community health extension workers . As a result, the country has made remarkable progress in reducing MMR from 676 in 2011 to 412 in 2016 . A recent report indicated that MMR in Ethiopia was 401 in 2017 , which has declined by slightly more than half compared to 871 in 2000 . However, the current MMR in Ethiopia is considerably high as it surpasses the SDGs target of no more than 140 maternal deaths per 100,000 live births, and interventions need to be scaled up to avert preventable maternal deaths [7, 8].
Most maternal deaths are preventable through quality healthcare services, such as antenatal care (ANC) . For example, up to half of all maternal deaths can be prevented through ANC that provides comprehensive counselling on obstetric danger signs and facilitates the early detection and timely management of pregnancy-related complications and other pre-existing health problems [3, 16,17,18,19]. Improving pregnancy outcomes requires a pregnant woman to commence her first ANC contact at or before 16 weeks of gestation and to receive the recommended components of care, including ANC counselling on obstetric danger signs that enhance risk identification [20,21,22]. Antenatal care counselling on obstetric danger signs enhances a woman’s awareness of obstetric complications and encourages treatment-seeking from a skilled care provider during pregnancy, childbirth and postpartum .
Studies showed that ANC counselling, an interaction between the ANC provider and a woman and her family involving the exchange of information providing support , regarding pregnancy-related topics, such as obstetric danger signs, improves maternal health literacy about obstetric complications contributing to a women’s decision to seek timely treatment ( Under review), skilled birth attendance  and postpartum family planning [27, 28]. An example of an interactive ANC counselling approach is group ANC (GANC), a method of pregnancy care that provides eight to 12 women the opportunity to share their pregnancy and childbirth life experiences and learn from peers and the care provider. GANC has been found to enhance a woman’s awareness of obstetric danger signs [29,30,31]. However, most women do not receive ANC counselling on obstetric danger signs [17, 32,33,34,35]. ANC counselling in some low and lower-middle-income countries is as low as 13% ( Under review). In Ethiopia, only 45% of women who received ANC were counselled on obstetric danger signs .
Factors relating to a woman’s demand for health care and the supply of health services can influence the quality of ANC counselling. Examples of demand-related factors include a woman’s educational level  and the number of ANC contacts she has [16, 35, 37]. Supply related factors are primarily human and material resources [20, 23, 38,39,40]. However, the lion’s share of factors influencing quality ANC counselling are facility-level ANC guidelines and ANC provider uptake of in-service training [29, 41,42,43].
The importance of ANC guidelines and provider in-service training in improving ANC counselling on obstetric danger has been reported in studies from Benin , Guatemala  and Tanzania . In Ethiopia, however, little is known to what extent guidelines and in-service training increase ANC counselling on obstetric danger signs. Therefore, the present study aimed to answer the research question “Does the availability of national ANC guidelines at the facility level and ANC in-service training in the last 24 months affect antenatal counselling on obstetric danger signs?”. The study estimates the extent to which the availability of facility-level national ANC service guidelines and trained ANC providers can increase ANC counselling on obstetric danger signs in Ethiopia.
Study design and data source
This is a cross-sectional study based on the 2014 Ethiopian service provision assessment plus (ESPA +) survey data . The 2014 ESPA + was the first nationally representative facility-based survey on the performance of health facilities in Ethiopia. The 2014 ESPA + survey utilised four data collection instruments: facility inventory questionnaires, provider interview questionnaires, client exit interviews, and observation checklists of client-provider interactions. Facility inventory questionnaires were used to collect data on the availability of services, medicines, infrastructures, and supplies. The provider interview questionnaires were used to collect data on the service environment and the healthcare provider’s practices and perspectives (experiences and qualifications). Observation checklists were used to assess the extent to which the provider applied the accepted standards of care. The client exit interview questionnaires were used to collect data on the quality of client-provider interaction .
Sample size and selection process
The 2014 ESPA + survey data involved 1902 women receiving ANC at 1327 health facilities . We excluded 177 women from the analysis for the following reasons (see Fig. 1). Forty-nine women refused to participate in the client-exit interview. Twenty-five women attended health posts, the lowest health facilities at the primary healthcare level staffed with health extension workers  who are not skilled attendants, as defined by the World Health Organization (WHO) . Two women were not observed receiving ANC counselling on obstetric danger signs. One hundred one women had missing values in one or more study variables. Finally, we included 1725 women in this analysis.
To illustrate the relationship between ANC guidelines and ANC provider training, quality counselling and its outcome, we constructed a conceptual framework (see Fig. 2) based on a review of available literature [46, 47]. The improvement of ANC counselling in quantity and quality positively influences a woman’s ability to recognise obstetric danger signs early and seek timely care [16, 29]. We defined quality ANC counselling in this study as the conversation an ANC provider has with a woman concerning problems that could arise during pregnancy, childbirth and the postpartum period, as recommended by WHO , and what the woman should do if she experiences these. This includes counselling each woman on obstetric danger signs, the importance of nutrition during pregnancy and following childbirth, childcare and breastfeeding, and family planning. While the quantity of ANC can be defined in terms of timing and the number of visits, it can vary depending on contextual differences . For example, the 2016 WHO ANC guideline recommends a minimum of eight antenatal care contacts , whereas the recommended minimum number of ANC visits in Ethiopia is four . It is beyond the scope of the present study to focus on the quantity of ANC. The present study only focuses on the relationship between ANC counselling and the availability ANC guidelines and provider training. The relationship between ANC counselling, maternal health literacy and women’s decision to give birth at a health facility is addressed in another study (the results not provided). Guidelines can be defined as “systematically developed statements to assist practitioner and patient decisions about appropriate healthcare for specific clinical circumstances” . ANC guidelines are protocols that included details on managing common problems during pregnancy.
Counselling on obstetric danger signs for pregnant women during ANC was an outcome variable measured using data from an observation checklist that recorded if the ANC provider counselled each pregnant woman on each obstetric danger. The 2014 ESPA + survey observation checklist included seven obstetric danger signs (vaginal bleeding, fever, blurred vision and severe headache, swollen hands and face, reduced or absence of foetal movement, difficulty breathing, and convulsion/ loss of consciousness). In addition, the checklist used the statement “Any other symptoms or problems the client thinks might be related to this pregnancy” to address if each pregnant woman received counselling on any other pregnancy-related problems. A score of “1” was assigned to each obstetric danger sign if a woman was counselled; otherwise “, 0”. Thus, the counselling score ranges from 0 to 8. The score represents the number of obstetric danger signs counselled for a woman . Facility-level availability of ANC guideline (defined as 1 if it was available, otherwise 0) and ANC providers’ uptake of in-service/a refreshment training on ANC in the last 24 months preceding the 2014 ESPA + survey (defined as 1 if ANC provider took training, otherwise 0) are treatment variables. The covariates included women’s age, educational level and obstetric history (gestational age, number of ANC visits a woman had, and the number of lifetime pregnancy); health facility characteristics (health facility type, managing authority, and location); and healthcare provider characteristics (gender and profession) (Table 1).
Given the non-experimental nature of the 2014 ESPA + survey data, the analysis involved a propensity score matching (PSM) method . Introduced in the early 1980s, the propensity score matching method is an approach to analyse the effect of an intervention in observational studies. Its use in observational studies mimics a randomised controlled trial, creating a sample of units or study population that received the treatment and comparable on all observed characteristics with a sample of units that did not receive the treatment. Its purpose is to balance the distribution of observed baseline characteristics between the treated or exposed and untreated or unexposed group [51, 52], and therefore to reduce bias due to confounding. This method allowed us to construct treatment and control group of pregnant women who are matched by their observed baseline characteristics for each treatment variable (i.e., (1) national ANC guidelines and (2) ANC providers’ in-service training). Then we estimated the effect of each treatment variable on the outcome variable (number of obstetric danger signs addressed in counselling) [50, 52].
Steps involved in estimating propensity scores and the treatment effect
We calculated propensity scores for each treatment variable using Stata user-written command (psmatch2) . We used the logit model for each treatment variable to identify the probability of the study participants receiving treatment conditional on the observed covariates (the propensity score) .
Firstly, we identified the covariates to estimate the propensity score. The covariates included in the propensity score model were grouped into four categories: women’s socio-demographic characteristics,  obstetric history,  health facility characteristics, and ANC provider characteristics (Table 1). The selection of these covariates was based on their relationship with the outcome variable (counselling on obstetric danger signs) . Including the covariates that are related to the outcome variable and those that may or may not be related to the exposure variable provides a precise estimation of effect size . For example, women’s age and educational level influence women’s reception of counselling but do not influence the availability of national ANC guideline at a health facility . Likewise, some healthcare provider characteristics such as the type of profession may affect the ANC provider’s reception of training and the performance in counselling but do not influence the availability of ANC guidelines [33, 35]. On the other hand, the characteristics of the health facility, such as being a public or a private health facility, may be related to the availability of national ANC guidelines and staff training . We identified the covariates through a systematic review of literature on ANC counselling and maternal health literacy in low and lower-middle-income countries (25 Under review). We iteratively included the covariates in the propensity score model until we achieved an acceptable level of balance [51, 55] and excluded variables that showed unsatisfactory balanced property and variables which could be affected by the treatment [55, 57, 58].
Secondly, we calculated the standardised difference in proportions and means to assess whether propensity score matching has removed the differences in observed baseline characteristics between treated and control groups . We chose a maximum of 10% standardised differences in the means and proportions as criteria to define covariates are balanced between the treated and control study participants .
Lastly, to determine the effects of treatment variables on the outcome variable, we chose the nearest neighbour one-to-one matching without replacement. The caliper distance of the propensity scores between the treated and control groups was set to be 0.01 and 0.002 for national ANC guideline and ANC provider training, respectively. While there is no consensus on the value of caliper distance , we decided on the width of the caliper by observing that the kernel density plots between the treated and control study participants are closely similar after matching (see figures in Additional file 1) while retaining the optimum sample . The smaller the width of the caliper, the closer the match between the treated and control groups despite an increased drop in the sample . The results are reported according to reporting guidelines on PSM .
Of the 1725 pregnant women included in the analysis, 713 (41.5%) attended ANC at health facilities with national ANC guidelines, and 815 (47.3%) received ANC service from a provider who took ANC related in-service training in the last 24 months preceding the ESPA + survey 2014.
National ANC guideline and ANC counselling
Table 2 shows that most study participants were aged between 21 and 25 years and were in the third trimester. About two-thirds of the study participants attended school. Slightly more than one-third were pregnant for the first time, about 58% were in the third trimester, and less than half of them attended ANC for the first time.
The nearest one-to-one matching without replacement yielded 1,274 samples comprised of 637 women who received ANC at health facilities with national ANC guidelines (treated) and 637 women who received ANC at health facilities with no national ANC guideline (control).
We found that the absolute value of the calculated standardised difference in means and proportions of each variable after matching is less than 10%, indicating the presence of a balanced match on the observed baseline characteristics between treated and control groups.
Figure 3 presents the frequency of counselling on each obstetric danger sign for pregnant women who received ANC at health facilities with national ANC guidelines compared to those who received ANC at health facilities without guidelines. The number of pregnant women who received ANC counselling on each obstetric danger sign differs by the facility-level availability of the national ANC guidelines. The frequency of counselling on most obstetric danger signs was higher at health facilities with ANC guidelines than without guidelines. Vaginal bleeding was the most counselled obstetric danger sign in the treatment group (46.3%). In contrast, headache or blurred vision was the most counselled obstetric danger sign in the control group (39.1%). On the contrary, cough or difficulty breathing was the least counselled obstetric danger sign for pregnant women in the treatment (4.7%) and control (8.2%) groups. Thirty per cent of women in the treatment group and 38.2% of women in the control group did not receive counselling on any obstetric danger sign.
After matching the study participants by the observed baseline characteristics, we found that facility-level ANC guidelines increased the average number of obstetric danger signs included in counselling women by 24% (95% CI: 12%—35%) (Table 3). A Wilcoxon signed-rank test for matched pairs  also indicated that the observed difference in obstetric danger sign counselling related to the availability of guidelines is statistically significant (z = -2.301, p = 0.021).
ANC providers’ uptake of training and ANC counselling
The second treatment variable in this study was the ANC provider’s reception of ANC related in-service training in the last 24 months preceding the ESPA + survey 2014. Matching yielded thirteen hundred and sixty-eight pregnant women, in which 684 women received ANC from trained providers, other 684 women received ANC from untrained providers.
Table 4 shows that the mean age of the study participants was 25 years. About 70% of the women had attended school. The average gestational age of the study participants was 27 weeks. One-third of the study participants were pregnant for the first time.
Figure 4 shows that headache or blurred vision was the most counselled obstetric danger sign for pregnant women in the treatment group (44.0%). In contrast, the most counselled obstetric danger sign for pregnant women in the control group was vaginal bleeding (37.6%). The least counselled obstetric danger sign was cough or difficulty breathing in both the treatment (7.8%) and control (5.6%) groups. Thirty-two point eight per cent of women in the treatment group and 37.7% of women in the control group did not receive counselling on any obstetric danger sign.
Table 5 shows that ANC providers’ uptake of ANC related in-service training in the last 24 months increased the mean number of obstetric danger signs included in counselling pregnant women by 37% (95% CI: 26%—48%). This increment was statistically significant in the Wilcoxon signed-rank test for paired sample (z = -3.212, p = 0.001).
This PSM study using the ESPA + 2014 data showed that the availability of national ANC guidelines at the facility level significantly increased the average number of obstetric danger signs discussed with pregnant women during ANC counselling by 24%. Similarly, providing ANC related in-service training for the ANC providers significantly increased the average number of obstetric danger signs discussed with women received during ANC counselling by 37%. While some women received no counselling on any danger signs, others received no counselling on a particular danger sign. Cough or difficulty breathing were found to be the least discussed danger signs. These danger signs are very relevant in the context of the current COVID-19 pandemic. A cough or difficulty breathing can signify both pregnancy-related complications and COVID-19 infection. Our study shows that a higher percentage of counselling sessions on most obstetric danger signs were at health facilities with guidelines and trained providers. The findings demonstrate the importance of the national ANC guidelines and in-service training for the ANC providers in counselling each pregnant woman on every obstetric danger sign.
The results are consistent with study findings from other countries that have shown an increase in counselling on obstetric danger signs due to guidelines or job aids and provider training [41,42,43]. The use of ANC counselling job aids in Benin resulted in a 26% increase in counselling on obstetric danger signs . Similarly, in Tanzania, more women in the intervention group involving ANC counselling job aids reported counselling reception on obstetric danger signs than women in control (no job aid intervention) . In Guatemala, there was a 15% increase in women who received counselling on obstetric danger signs following the use of counselling guidelines .
ANC guidelines increase counselling on obstetric danger signs by enhancing provider-recipient communication for effective counselling on obstetric danger signs. This is attributed to the printed information on the ANC guidelines outlining clear instructions that support ANC providers approaching pregnant women and discussing pregnancy-related topics [24, 65]. Guidelines also contain a list of pregnancy-related complications and danger signs to be discussed with a woman. Providers can discuss each of the danger signs with each pregnant woman based on the instructions in the guideline and let them know what to do if the danger signs occur [35, 38]. ANC guidelines are also essential to reduce the time that the providers would typically spend thinking about the types of prenatal healthcare that should be provided to the expectant mother. As a result, this maximises the probability of counselling on each obstetric danger sign [41,42,43, 66].
In the GANC model, ANC guidelines consist of a list of instructions on a range of pregnancy-related topics, including danger signs, that can be used to facilitate communication between the provider and recipients [29,30,31]. The implementation of GANC involves developing country-context guidelines and training facilitators (the ANC providers) on how to use these guidelines to facilitate women’s discussion in a group setting. The provider uses these guidelines to promote discussion that encourages women to share their experiences and learn from each other [29,30,31, 67, 68]. While this model may be useful to improve the ANC counselling on danger signs, implementing GANC might be challenging in the context of the coronavirus pandemic due to the increased risk of COVID-19 infection in a group setting . Thus, the traditional one-to-one ANC would be preferred to apply physical distancing in reducing COVID-19 transmission . One-to-one ANC counselling could be as effective as GANC in achieving successful counselling on obstetric danger signs if guidelines are in place for use by trained providers [42, 43].
Another facility-level factor influencing ANC counselling that we examined in this study is ANC provider uptake of ANC related in-service training. Consistent with the findings of other studies [42, 71, 72], our study findings showed that women have a 37% increased chance of receiving counselling on obstetric danger signs if the providers had ANC related in-service training in the last 24 months.
Appropriate and acceptable care tailored to the pregnant woman’s socio-cultural context requires providers to be clinically competent, motivated and available [73, 74]. Training, mentoring, and supportive supervision are among the strategies that make the ANC provider capable and motivated [66, 75]. Provider training includes pre-service training and in-service training. In-service training is a low-cost option to refresh provider knowledge and skills [76, 77], ensuring their competencies are up-to-date [38, 66]. Moreover, in-service ANC-related training is vital to address the emerging healthcare needs of pregnant women and to take their socio-cultural context into account . With up-to-date knowledge and skills on ANC, providers can communicate effectively with pregnant women and understand their needs, beliefs, and values. These skills and understanding of the socio-cultural context of women enable providers to assess and identify problems and assist women in making informed decisions. Ethiopia is the home of people with multiple socio-cultural characteristics that play an important role in healthcare provision . Provider in-service training helps the provider understand and respect these socio-cultural attributes of women to establish interactive communication . Interactive provider–client communication that takes social and cultural norms into account gives pregnant women an extra opportunity to discuss a range of pregnancy-related topics, including how to recognise danger signs and how and where to seek treatment [24, 81]. In-service training also increases providers’ motivation (Momanyi et al. 2016) and confidence . A motivated and confident ANC provider makes informed clinical decisions  and takes professional responsibility and accountability to provide the highest possible quality care .
Other interventions that could improve the quality of ANC counselling include systematic quality improvements at the facility level (e.g., audits and feedback), support to enhance quality infrastructure, and community participation [75, 81, 85]. A study in Malawi found that providers felt happier and motivated, and patient satisfaction increased after implementing monthly supportive staff meetings. The monthly meetings involved sharing stories that involved identifying best practices and developing plans to implement these . These facility-level quality improvement strategies could also be supported by community-based interventions , such as implementing social and behavioural change communication. Involving community leaders, such as religious leaders, in disseminating health messages regarding pregnancy, childbirth, postnatal and newborn care, has been shown to increase women’s knowledge of obstetric danger signs and maternal healthcare service reception [43, 85].
Strength and limitations
Applying the PSM method in an observational data (the 2014 ESPA + survey data) enabled us to estimate the unconfounded treatment effects of ANC guidelines and provider in-service training on the provision of counselling on obstetric danger signs. However, this study has some limitations. The PSM method only adjusts for measured covariates. Therefore, this study does not guarantee the elimination of bias due to unmeasured covariates. The PSM also excluded unmatched samples that may be systematically different from the matched samples, which could affect the representativeness of the study population. We acknowledge the findings in this study may or may not directly represent the current ANC counselling practice in Ethiopia because the 2014 ESPA + survey was undertaken seven years ago as of 2021. Thus, care should be taken to interpret the results. However, as the 2014 ESPA + survey is a national representative data, the findings of this study are comprehensive to provide policymakers with quality insights to improve ANC quality. Additionally, the providers’ uptake of in-service training was self-reported, which might have been affected by the recall and social desirability biases. Similarly, this study did not examine whether ANC providers consistently used the ANC guidelines during ANC counselling.
Conclusion and recommendations
We found that counselling pregnant women about obstetric danger signs during their ANC contacts is not universally practised. Nearly one in three women do not receive counselling on any obstetric danger sign. The availability of facility-level national ANC guidelines and in-service training for the ANC providers are positively and significantly associated with the number of obstetric danger signs discussed with women during ANC counselling. Decision-makers need to prioritise funding and policy to build supportive environments to ensure each health facility has guidelines and continuous in-service training programs are available for every ANC provider. Further research is required to understand whether ANC guidelines are consistently used during ANC service provision and examine whether this is associated with the quality of ANC counselling.
Availability of data and materials
All data related to the study findings are incorporated into the article and its online Additional file 1. Access to the 2014 ESPA + survey data requires permission from the EPHI.
Average treatment in treated
Ethiopian Public Health Institute
- ESPA +:
Ethiopian Service Provision Assessment Plus
Group antenatal care
Health Sector Transformation Plan
Health management information system
Maternal mortality ratio
Propensity score matching
Sustainable development goals
University of Technology Sydney
World Health Organization
WHO. WHO: recommended definitions, terminology and format for statistical tables related to the perinatal period and use of a new certificate for cause of perinatal deaths. Modifications recommended by FIGO as amended October 14, 1976. Acta Obstet Gynecol Scand. 1977;56(3):247-53.
WHO. Trends in maternal mortality 2000 to 2017: estimates by WHO, UNICEF, UNFPA, World Bank Group and the United Nations Population Division: executive summary.; 2019.
WHO. World Health Statistics 2020. Geneva: WHO; 2021.
Zhou H, Zhang L, Ye F, Wang H-J, Huntington D, Huang Y, et al. The effect of maternal death on the health of the husband and children in a rural area of China: a prospective cohort study. PLoS ONE. 2016;11:6.
Moucheraud C, Worku A, Molla M, Finlay JE, Leaning J, Yamin AE. Consequences of maternal mortality on infant and child survival: a 25-year longitudinal analysis in Butajira Ethiopia (1987–2011). Reprod Health. 2015. https://doi.org/10.1186/1742-4755-12-S1-S4.
Machiyama K, Hirose A, Cresswell JA, Barreix M, Chou D, Kostanjsek N, et al. Consequences of maternal morbidity on health-related functioning: a systematic scoping review. BMJ Open. 2017;7:6.
WHO. Strategies toward ending preventable maternal mortality (EPMM). WHO Department of Reproductive Health and Research; 2015.
UN. The Sustainable Development Goals Report 2017. New York: United Nations; 2017.
WHO. SEVENTY-SECONDWORLD HEALTH ASSEMBLY: A72/11 Rev.1 Provisional agenda item 11.4. Geneva: WHO; 2019.
CSA [Ethiopia], ORC Macro. Ethiopia demographic and health survey 2000. Addis Ababa: Central Statistical Authority [Ethiopia] and ORC Macro; 2001.
CSA [Ethiopia], ORC Macro. Ethiopia demographic and health survey 2005. Central Statistical Agency and ORC Macro; 2006.
CSA [Ethiopia], ICF International. Ethiopia Demographic and Health Survey 2011. Addis Ababa, Ethiopia: Central Statistical Agency and ICF International; 2012.
FMOH. HSTP : Health Sector Transformation Plan : 2015/16–2019/20 (2008-2012 EFY): Federal Democratic Republic of Ethiopia Ministry of Health; 2015.
Assefa Y, Gelaw YA, Hill PS, Taye BW, Van Damme W. Community health extension program of Ethiopia, 2003–2018: successes and challenges toward universal coverage for primary healthcare services. Global Health. 2019;15:24.
CSA/Ethiopia, ICF. Ethiopia Demographic and Health Survey 2016. Addis Ababa, Ethiopia: CSA and ICF; 2017.
Assaf S. Counseling and Knowledge of Danger Signs of Pregnancy Complications in Haiti, Malawi, and Senegal. Matern Child Health J. 2018;22(11):1659–67.
Sarker M, Schmid G, Larsson E, Kirenga S, De Allegri M, Neuhann F, et al. Quality of antenatal care in rural southern Tanzania: a reality check. BMC Res Notes. 2010;3:209.
Rosado C, Callaghan-Koru JA, Estifanos AS, Sheferaw E, Shay T, De Graft-Johnson J, et al. Effect of birth preparedness on institutional delivery in semiurban ethiopia: a cross-sectional study. Ann Global Health. 2019;85(1):44.
Kruk ME, Gage AD, Arsenault C, Jordan K, Leslie HH, Roder-DeWan S, et al. High-quality health systems in the Sustainable Development Goals era: time for a revolution. Lancet Global Health. 2018;6(11):e1196–252.
World Health Organization. WHO recommendations on antenatal care for a positive pregnancy experience. Geneva: World Health Organization; 2016.
Hodgins S, D’Agostino A. The quality-coverage gap in antenatal care: toward better measurement of effective coverage. Global Health Sci Pract. 2014;2(2):173–81.
Lattof SR, Moran AC, Kidula N, Moller A-B, Jayathilaka CA, Diaz T, et al. Implementation of the new WHO antenatal care model for a positive pregnancy experience: a monitoring framework. BMJ Glob Health. 2020;5:6.
World Health Organization. Standards for maternal and neonatal care. Geneva: World Health Organization; 2007.
World Health Organizatio. Counselling for maternal and newborn health care: a handbook for building skills. Geneva: World Health Organization; 2013.
Yeneabat T, Hayen A, Dawson A. Does antenatal care counselling affect maternal health literacy on obstetric danger signs in low and lower-middle-income countries? A Systematic Review. Under review. [Review research manuscript]. In press 2022.
Soubeiga D, Sia D, Gauvin L. Increasing institutional deliveries among antenatal clients: effect of birth preparedness counselling. Health Policy Plan. 2014;29(8):1061–70.
Tafere TE, Afework MF, Yalew AW. Counseling on family planning during ANC service increases the likelihood of postpartum family planning use in Bahir Dar City Administration, Northwest Ethiopia: a prospective follow up study. Contracept Reprod Med. 2018;3:28.
Adanikin AI, Onwudiegwu U, Loto OM. Influence of multiple antenatal counselling sessions on modern contraceptive uptake in Nigeria. Eur J Contracept Reprod Health Care. 2013;18(5):381–7.
Lori JR, Ofosu-Darkwah H, Boyd CJ, Banerjee T, Adanu RMK. Improving health literacy through group antenatal care: a prospective cohort study. BMC Pregnancy Childbirth. 2017;17:228.
Patil CL, Abrams ET, Klima C, et al. CenteringPregnancy-Africa: a pilot of group antenatal care to address Millennium development goals. Midwifery. 2013;29(10):1190–8.
Patil CL, Klima CS, Leshabari SC, Steffen AD, Pauls H, McGown M, et al. Randomized controlled pilot of a group antenatal care model and the sociodemographic factors associated with pregnancy-related empowerment in sub-Saharan Africa. BMC Pregnancy Childbirth. 2017;17:336.
Timša L, Marrone G, Ekirapa E, Waiswa P. Strategies for helping families prepare for birth: experiences from eastern central Uganda. Glob Health Action. 2015;8:1.
Pembe AB, Carlstedt A, Urassa DP, Lindmark G, Nystrom L, Darj E. Quality of antenatal care in rural Tanzania: counselling on pregnancy danger signs. BMC Pregnancy Childbirth. 2010;10:35.
Phommachanh S, Essink DR, Wright EP, Broerse JEW, Mayxay M. Do health care providers give sufficient information and good counseling during ante-natal care in Lao PDR?: an observational study. BMC Health Serv Res. 2019;19:449.
Duysburgh E, Ye M, Williams A, Massawe S, Sié A, Williams J, et al. Counselling on and women’s awareness of pregnancy danger signs in selected rural health facilities in Burkina Faso, Ghana and Tanzania. Trop Med Int Health. 2013;18(12):1498–509.
Okawa S, Win HH, Nanishi K, Shibanuma A, Aye PP, Saw TN, et al. Advice on healthy pregnancy, delivery, motherhood and information on non-communicable diseases in the maternal care programme in Myanmar: a cross-sectional study. BMJ Open. 2019;9(3): e025186.
Anya SE, Hydara A, Jaiteh LES. Antenatal care in The Gambia: Missed opportunity for information, education and communication. BMC Pregnancy Childbirth. 2008. https://doi.org/10.1186/1471-2393-8-9.
Phommachanh S, Essink DR, Jansen M, Broerse JEW, Wright P, Mayxay M. Improvement of Quality of Antenatal Care (ANC) service provision at the public health facilities in lao PDR: perspective and experiences of supply and demand sides. BMC Pregnancy Childbirth. 2019;19:255.
Leslie HH, Malata A, Ndiaye Y, Kruk ME. Effective coverage of primary care services in eight high-mortality countries. BMJ Glob Health. 2017;2(3): e000424.
Defar A, Getachew T, Taye G, Tadele T, Getnet M, Shumet T, et al. Quality antenatal care services delivery at health facilities of Ethiopia, assessment of the structure/input of care setting. BMC Health Serv Res. 2020;20:485.
Oka M, Horiuchi S, Shimpuku Y, Madeni F, Leshabari S. Effects of a job aid-supported intervention during antenatal care visit in rural Tanzania. Int J Africa Nurs Sci. 2019;10:31–7.
Jennings L, Yebadokpo AS, Affo J, Agbogbe M. Antenatal counseling in maternal and newborn care: use of job aids to improve health worker performance and maternal understanding in Benin. BMC Pregnancy Childbirth. 2010;10:75.
Perreira KM, Bailey PE, de Bocaletti E, Hurtado E, Recinos de Villagrán S, Matute J. Increasing awareness of danger signs in pregnancy through community- and clinic-based education in Guatemala. Mater Child Health J. 2002;6(1):19–28.
EPHI, FMoH, ICF. Ethiopia service provision assessment plus survey 2014. Addis Ababa: The Ethiopian Public Health Institute; 2014.
World Health Organization. Defining competent maternal and newborn health professionals: background document to the 2018 joint statement by WHO, UNFPA, UNICEF, ICM, ICN, FIGO and IPA: definition of skilled health personnel providing care during childbirth. Geneva: World Health Organization; 2018.
Villadsen SF, Negussie D, GebreMariam A, Tilahun A, Friis H, Rasch V. Antenatal care strengthening for improved quality of care in Jimma, Ethiopia: an effectiveness study. BMC Public Health. 2015;15:360.
World Health Organization. Standards for improving quality of maternal and newborn care in health facilities. Geneva: World Health Organization; 2016.
Rowe S, Karkhaneh Z, MacDonald I, Chambers T, Amjad S, Osornio-Vargas A, et al. Systematic review of the measurement properties of indices of prenatal care utilization. BMC Pregnancy Childbirth. 2020;20:171.
IOM. Clinical practice guidelines: directions for a new program. In: Field MJ, Lohr KN, editors. Clinical practice guidelines: directions for a new program. 4th ed. Washington: National Academies Press; 1990.
Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika. 1983;70(1):41–55.
Austin PC. An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivariate Behav Res. 2011;46(3):399–424.
Rubin DB. Using propensity scores to help design observational studies: application to the tobacco litigation. Health Serv Outcomes Res Method. 2001;2(3):169–88.
Leuven E, Sianesi B. PSMATCH2: Stata module to perform full Mahalanobis and propensity score matching, common support graphing, and covariate imbalance testing. Statistical Software Components: Boston College Department of Economics; 2003.
Caliendo M, Kopeinig S. Some practical guidance for the implementation of propensity score matching: IZA Discussion Paper No. 1588. IZA. 2008;22(1):31-72.
Garrido MM, Kelley AS, Paris J, Roza K, Meier DE, Morrison RS, et al. Methods for constructing and assessing propensity scores. Health Serv Res. 2014;49(5):1701–20.
Bergstra SA, Sepriano A, Ramiro S, Landewé R. Three handy tips and a practical guide to improve your propensity score models. RMD Open. 2019;5(1): e000953.
Brookhart MA, Schneeweiss S, Rothman KJ, Glynn RJ, Avorn J, Sturmer T. Variable selection for propensity score models. Am J Epidemiol. 2006;163(12):1149–56.
Ali MS, Prieto-Alhambra D, Lopes LC, Ramos D, Bispo N, Ichihara MY, et al. Propensity score methods in health technology assessment: principles, extended applications, and recent advances. Front Pharmacol. 2019;10:973.
Austin PC. Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples. Stat Med. 2009;28(25):3083–107.
Allan V, Ramagopalan SV, Mardekian J, Jenkins A, Li X, Pan X, et al. Propensity score matching and inverse probability of treatment weighting to address confounding by indication in comparative effectiveness research of oral anticoagulants. J Comp Eff Res. 2020;9(9):603–14.
West SG, Cham H, Thoemmes F, Renneberg B, Schulze J, Weiler M. Propensity scores as a basis for equating groups: basic principles and application in clinical treatment outcome research. J Consult Clin Psychol. 2014;82(5):906–19.
Choi J, Dekkers OM, le Cessie S. A comparison of different methods to handle missing data in the context of propensity score analysis. Eur J Epidemiol. 2019;34(1):23–36.
Yao XI, Wang X, Speicher PJ, Hwang ES, Cheng P, Harpole DH, et al. Reporting and guidelines in propensity score analysis: a systematic review of cancer and cancer surgical studies. J Natl Cancer Inst. 2017. https://doi.org/10.1093/jnci/djw323.
Siegel S. Nonparametric statistics for the behavioral sciences. 1st ed. USA: McGraw-Hill Book Company; 1956.
Rowe AK, Rowe SY, Peters DH, Holloway KA, Chalker J, Ross-Degnan D. Effectiveness of strategies to improve health-care provider practices in low-income and middle-income countries: a systematic review. Lancet Global Health. 2018;6(11):1163–75.
Seyoum T, Alemayehu M, Christensson K, Lindgren H. Provider-perceived benefits and constraints of complete adherence to antenatal care guideline among public health facilities, Ethiopia: a qualitative study. PLoS ONE. 2021. https://doi.org/10.1371/journal.pone.0255297.
Rising SS. Centering pregnancy. An interdisciplinary model of empowerment. J Nurse Midwifery. 1998;43(1):46–54.
Rising SS, Kennedy HP, Klima CS. Redesigning prenatal care through CenteringPregnancy. J Midwifery Womens Health. 2004;49(5):398–404.
Larki M, Sharifi F, Roudsari RL. Models of maternity care for pregnant women during the COVID-19 pandemic. East Mediterr Health J. 2020;26(9):994–8.
Benski C, Di Filippo D, Taraschi G, Reich MR. Guidelines for pregnancy management during the COVID-19 pandemic: a public health conundrum. Int J Environ Res Public Health. 2020. https://doi.org/10.3390/ijerph17218277.
Vickers KS, Kircher KJ, Smith MD, Petersen LR, Rasmussen NH. Health behavior counseling in primary care: provider-reported rate and confidence. Fam Med. 2007;39(10):730–5.
Leslie HH, Gage A, Nsona H, Hirschhorn LR, Kruk ME. Training and supervision did not meaningfully improve quality of care for pregnant women or sick children in sub-Saharan Africa. Global Health Affairs. 2016;35(9):1716–24.
Gross K, Schellenberg JA, Kessy F, Pfeiffer C, Obrist B. Antenatal care in practice: an exploratory study in antenatal care clinics in the Kilombero Valley, south-eastern Tanzania. BMC Pregnancy Childbirth. 2011. https://doi.org/10.1186/1471-2393-11-36.
WHO, Organisation for Economic Co-operation Development, The World Bank. Delivering quality health services: a global imperative for universal health coverage. Geneva: WHO; 2018.
Goyet S, Broch-Alvarez V, Becker C. Quality improvement in maternal and newborn healthcare: lessons from programmes supported by the German development organisation in Africa and Asia. BMJ Glob Health. 2019;4(5): e001562.
Kurzawa Z, Cotton CS, Mazurkewich N, Verney A, Busch-Hallen J, Kashi B. Training healthcare workers increases IFA use and adherence: evidence and cost-effectiveness analysis from Bangladesh. Matern Child Nutr. 2021. https://doi.org/10.1111/mcn.13124.
de la Perrelle L, Radisic G, Cations M, Kaambwa B, Barbery G, Laver K. Costs and economic evaluations of Quality Improvement Collaboratives in healthcare: a systematic review. BMC Health Serv Res. 2020;20:155.
BahriKhomami M, Walker R, Kilpatrick M, de Jersey S, Skouteris H, Moran LJ. The role of midwives and obstetrical nurses in the promotion of healthy lifestyle during pregnancy. Ther Adv Reprod Health. 2021;15:1–12.
Kaba M, Bulto T, Tafesse Z, Lingerh W, Ali I. Sociocultural determinants of home delivery in Ethiopia: a qualitative study. Int J Womens Health. 2016;8:93–102. https://doi.org/10.2147/IJWH.S98722.
Heinonen K. Strengthening antenatal care towards a salutogenic approach: a meta-ethnography. Int J Environ Res Public Health. 2021;18(10):5168.
Mian NU, Alvi MA, Malik MZ, Iqbal S, Zakar R, Zakar MZ, et al. Approaches towards improving the quality of maternal and newborn health services in South Asia: challenges and opportunities for healthcare systems. Global Health. 2018. https://doi.org/10.1186/s12992-018-0338-9.
Austin A, Gulema H, Belizan M, Colaci DS, Kendall T, Tebeka M, et al. Barriers to providing quality emergency obstetric care in Addis Ababa, Ethiopia: Healthcare providers’ perspectives on training, referrals and supervision, a mixed methods study. BMC Pregnancy Childbirth. 2015. https://doi.org/10.1186/s12884-015-0493-4.
ThiHoai Thu N, Wilson A, McDonald F. Motivation or demotivation of health workers providing maternal health services in rural areas in Vietnam: findings from a mixed-methods study. Hum Resour Health. 2015. https://doi.org/10.1186/s12960-015-0092-5.
Farahani MA, Mohammadi E, Ahmadi F, Mohammadi N. Factors influencing the patient education: a qualitative research. Iran J Nurs Midwifery Res. 2013;18(2):133–9.
Saaka M, Aryee P, Kuganab-lem R, Ali M, Masahudu AR. The effect of social behavior change communication package on maternal knowledge in obstetric danger signs among mothers in East Mamprusi District of Ghana. Global Health. 2017. https://doi.org/10.1186/s12992-017-0243-7.
Merriel A, Dembo Z, Hussein J, Larkin M, McHenga A, Tobias A, et al. Assessing the impact of a motivational intervention to improve the working lives of maternity healthcare workers: a quantitative and qualitative evaluation of a feasibility study in Malawi. Pilot Feasibility Stud. 2021. https://doi.org/10.1186/s40814-021-0.
We wish to acknowledge the EPHI for undertaking the ethical review and allowing us to access the 2014 ESPA+ survey data. We thank UTS for providing a scholarship for the principal investigator of this research study.
No funding was required for this study. The University of Technology Sydney (UTS) provided a scholarship for the principal investigator.
Ethics approval and consent to participate
Consent to participate in the present study was not required as the study was based on the 2014 ESPA + survey data analysis. Access to the 2014 ESPA + survey data was granted after obtaining ethical clearance letters from the Ethiopian Public Health Institute (EPHI 6.13/895) dated 22 October 2020 and from the University of Technology Sydney (UTS) Human Research Ethics Committee (ETH194127).
Consent for publication
The authors have declared no conflict of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original online version of this article was revised: in the section ‘Sample size and selection process’ in the first sentence, the number ‘1237’ should have read ‘1327’. Moreover, reference  should have been replaced by . References [54–87] were renumbered.
Figures illustrating the presence of match onobserved covariates between treated and control groupsbefore and aftermatching for both treatment variables (ANC guidelines andANC providers’training).
About this article
Cite this article
Yeneabat, T., Hayen, A., Getachew, T. et al. The effect of national antenatal care guidelines and provider training on obstetric danger sign counselling: a propensity score matching analysis of the 2014 Ethiopia service provision assessment plus survey. Reprod Health 19, 132 (2022). https://doi.org/10.1186/s12978-022-01442-6
- Antenatal care
- Obstetric danger signs