Skip to main content
Download PDF

Assessing quality of maternity care in Hungary: expert validation and testing of the mother-centered prenatal care (MCPC) survey instrument

Reproductive Health volume 14, Article number: 152 (2017) Cite this article

Abstract

Background

Instruments to assess quality of maternity care in Central and Eastern European (CEE) region are scarce, despite reports of poor doctor-patient communication, non-evidence-based care, and informal cash payments. We validated and tested an online questionnaire to study maternity care experiences among Hungarian women.

Methods

Following literature review, we collated validated items and scales from two previous English-language surveys and adapted them to the Hungarian context. An expert panel assessed items for clarity and relevance on a 4-point ordinal scale. We calculated item-level Content Validation Index (CVI) scores. We designed 9 new items concerning informal cash payments, as well as 7 new “model of care” categories based on mode of payment. The final questionnaire (N = 111 items) was tested in two samples of Hungarian women, representative (N = 600) and convenience (N = 657). We conducted bivariate analysis and thematic analysis of open-ended responses.

Results

Experts rated pre-existing English-language items as clear and relevant to Hungarian women’s maternity care experiences with an average CVI for included questions of 0.97. Significant differences emerged across the model of care categories in terms of informal payments, informed consent practices, and women’s perceptions of autonomy. Thematic analysis (N = 1015) of women’s responses identified 13 priority areas of the maternity care experience, 9 of which were addressed by the questionnaire.

Conclusions

We developed and validated a comprehensive questionnaire that can be used to evaluate respectful maternity care, evidence-based practice, and informal cash payments in CEE region and beyond.

Peer Review reports

Plain English summary

Women in Hungary and in the CEE region report negative experiences with pregnancy care. It is unknown how common these experiences are. High numbers of women pay their obstetricians with informal cash payments, sometimes called “tips”, in order to obtain higher quality care. We don’t know if, when women pay informally, they actually get higher quality care.

In order to quantitatively explore the experience of quality maternity care in Hungary, we assembled a multi-disciplinary expert panel to adapt English-language maternity care surveys to the Hungarian context. We instructed the experts to think broadly about all aspects of care that may be important to women.

Generally, the experts found that English-language surveys could be easily adapted, and they helped us narrow the number of survey questions from 155 to 117. Because the informal payment, or “tip” system, is specific to Hungary, the experts developed new questions using Hungarian words to represent this practice. We then tested all questions on two groups of post-partum Hungarian women who use the internet: a random, representative sample and another group recruited from online maternity care forums.

We found that the new questions about informal cash payments made sense to women and that women reported more positive experiences with care when they paid informally. Women’s responses to an open-ended question revealed that we addressed the majority of care dimensions that mattered to them.

In conclusion, we developed a survey to comprehensively explore the maternity care experience in Hungary. Our survey process and questions may be useful to explore the maternity systems of surrounding countries.

Article summary

Strengths

We used a rigorous process to develop and validate a patient survey instrument that can evaluate women’s experiences in the Hungarian maternity care system.

No other survey has explored the connection between informal cash payments and quality of maternity care in the CEE region.

Limitations

Survey development could have employed more active users of the maternity system. Some care dimensions important to women were not addressed by the survey.

Background

Person-centered care has been associated with engendering the most optimal relationship between patient and provider in all medical specialties [1]. Balanced sharing of information, individualized care plans, and continuous emotional support are elements that have been shown to improve birth care outcomes and increase satisfaction with the birth experience [2, 3]. The World Health Organization’s (WHO) vision for quality of care for pregnant women and newborns mandates both the provision of evidence-based medical services and curation of the maternal experience [4, 5]. However, in a systematic review of 65 studies across 34 countries Bohren and colleagues confirmed that few tools exist to measure the experience of respect or mistreatment in maternity care [6].

While the CEE region demonstrates generally favorable maternal health indicators [7], Miteniece et al.’s systematic review of 20 investigations into the region’s quality of maternity care confirmed the need to also assess the professional, technical, and informational aspects of maternity care [8]. Birth care providers are often trained with outdated curricula [9], resulting in overapplication of non-evidence-based techniques. Doctor-patient communication is often poor, with providers lacking the skills to interpret what mothers need during pregnancy care [10, 11]. Women themselves play an important role in the doctor-patient interaction during pregnancy, including uptake of information, optimizing health behaviors, and adherence to care. However, there is scarce information about whether women in the CEE region have autonomy over their childbearing experiences. Mitenice et al. conclude that the evidence on these and other aspects of quality maternity care in the CEE region are derived in large part from qualitative designs, and few studies provide nationally representative data [8].

To date, there have been conflicting quantitative investigations of the quality of maternity care in Hungary. In a 1998 survey of academic obstetric departments, Hagymasy found high levels of “family-centered obstetrics”, defined as involvement of fathers, an upright birthing position, and skin-to-skin to contact [12]. In contrast, a 2004 “birth guide”, compiled by surveying a convenience sample of women and hospital staff, revealed significant variations in the quality of information provided to pregnant women and in respectful treatment from staff [13].

Neither of these previous surveys explored the effects of informal cash payments, even though in Hungary more than 60% of pregnant women pay informally for birth care [14]. Informal and formal cash payments may affect quality of maternity care in terms of affordability and accessibility of services. As with fee-for-service official payment schemes, informal payments may generate unnecessary use of services with “doctors recommending procedures in order to increase their income rather than for therapeutic benefit [15, 16].” Even though quantitative data is lacking, qualitative studies from Serbia and the Ukraine found that women pay informally to have a “chosen” obstetrician attend their births, and that they perceive many benefits to this continuity relationship—mainly, receiving more respectful care [10, 17]. However, given the lack of representative data to measure and monitor the quality of maternity care, the extent to which women actually benefit from these payments is unknown.

Investigators in the United States and in Canada have used cross-sectional surveys to assess women’s experiences of quality maternity care, addressing issues of evidence-based care, doctor-patient communication, and the process of decision-making in birth. The American survey Listening to Mothers 3 (LTM3) has been administered three times to a representative cohort of U.S. women [18]. Changing Childbirth in British Columbia (CCinBC) incorporated items from LTM3 but also used community-based participatory research methods to develop new items pertaining to women’s maternity care preferences, their decision-making, and perceptions of autonomy and respect [19, 20]. Given the existence of high-quality, English-language survey items, we decided to adapt and content validate these items for use in the Hungarian context with the primary aim of creating a comprehensive questionnaire to explore quality maternity care. Specifically, we examined quality care according to the rates of obstetric procedures, several measures of the experience of care, as well as the prevalence of informal cash payments.

Methods

Survey construction

To create the first version of the questionnaire, we combined the LTM3 and the CCinBC surveys. Duplicate items and those specific to foreign systems (e.g., American health insurance) were excluded. We added a validated scale to measure women’s role and ability to participate in decision-making, the Mothers Autonomy in Decision Making scale (MADM) developed by Vedam and colleagues [19]. We adapted informal payment questions from a cross-country survey on general inpatients [21].

The Hungarian maternity care system has similarities to Canada and the United States. A national health insurance scheme covers Hungarian maternity services (as in Canada), and a Hungarian woman has her choice of private or public prenatal providers (as in Canada and the U.S.). Like North America, providers are not required to be present for the births of their prenatal patients, in which case the “on-call” provider attends the birth. Unlike North America, in Hungary a pregnant woman who desires to have her “chosen” prenatal provider present at her birth will informally “contract” with her physician for the “extra” service of attending the birth [22].

Informal cash payments pose several challenges to quantitative exploration. First, informal cash payments are usually unregistered, and no government data source exists [23]. Second, Stepurko et al. found that respondents frequently refuse to answer questions about informal payments [24]. Finally, a woman typically pays after her delivery, making it challenging to explore associations with prenatal and birth outcomes that necessarily happen prior to the payment [17]. Thus, we needed to develop survey items that would be both culturally acceptable and—at least in concept—precede in time the outcomes of interest.

Content validation

When designing instruments it is common to undertake a validation process to provide evidence that the instrument is relevant to the regional context. One approach is to have experts judge the relationship between the survey items and the theory on which the instrument is based [25, 26]. We invited 31 lay and professional maternity care content experts—including active users of the system—to validate the comprehensiveness and regional specificity of our questionnaire [27]. Experts were identified through purposive sampling of research, professional, and birth-advocacy networks to maximize non-overlapping expertise [28]. Those experts who accepted our invitation were instructed on how to review the survey items in light of the concept of “women-centered care”, focusing on issues of continuity of care, doctor-patient communication, care preferences, and the use of evidence-based techniques [3, 29]. We required all experts to be bilingual in English and Hungarian.

The final survey instrument, “The Mother-Centered Pregnancy Care Survey”, consisted of 111 items: 5 screening, 16 prenatal care, 35 birth care, 12 postpartum care, 22 care preferences, 11 informal payments, 8 MADM scale items, 2 open-ended questions that inquired about the best and worst aspects of the experience of care. Among these, a total of 75 questions collected information on elements of women-centered care and were woven across the above domains.

The final questionnaire then underwent 5-way independent translation, as has been first previously used in Hungarian research, consisting of 3 independent translators who worked in parallel, followed by 1 translator who reconciled and assembled these parallel versions, and concluded by 1 final back translation of the reconciled Hungarian version into English [30]. The final back translation was checked for accuracy by an author who is a native English speaker (NR). Four Hungarian maternity care users beta-tested the survey for language, length, clarity, and functionality.

Survey administration

With the help of mostly international private donors without vested interests, a sum of $4300 US dollars was raised to retain the survey firm Ipsos. Ipsos maintains a panel of more than 70,000 members who are representative of Hungarian internet users for age, sex, and geographical location. We selected women between the ages of 18–45 with children under the age of 5 as the “target” population (total available N = 7762).

Sample

Ipsos administered the survey to the target population using a quota system to ensure a representative distribution regarding age, marital status, household size, education level, monthly income, settlement, and marital status. Balancing the resources available with the sample size needed to conduct a robust analysis, Ipsos stopped the invitations once a representative sample of 600 women was achieved. Ipsos also managed data collection for a convenience sample (N = 657) obtained via social media networks of birth and parenting organizations. Recruitment lasted for the month of October 2014. All respondents gave informed consent prior to initiating the survey.

Analysis

The research team reviewed all numeric and qualitative data supplied by the expert panel. We assessed inter-rater agreement by using the content validity index (CVI), summing the number of experts who rated an item as highly relevant and clear (level 3 or 4) and dividing by the total experts. We then averaged these scores to generate an item-level CVI (I-CVI). We considered items to be relevant and clear with an I-CVI score greater than 0.8 [26]. We reviewed all comments with equal attention, giving extra weight to repeat themes. Revisions were done carefully in dialogue between a native English speaker (NR) and a native Hungarian speaker (IS) in order to maintain clarity.

We compared demographic characteristics with two-tailed z tests (for dummy variables) or Pearson Chi2 test (for categorical variables). We then compared the amount of informal payments across groups by two-tailed t or z tests (ANOVA). We employed STATA version 14.1 for all statistical calculations. Responses to an open-ended question “What was the worst thing about the care you received during your recent birth?” underwent thematic analysis [31]. Two authors (ZS and ES) read through all the responses, categorized the content, and then coded the content by hand in order to determine the frequency of different themes.

The Regional Ethics Committee of Semmelweis University, Budapest (ref. number: 99/2014) approved this study. Because participation in the study was voluntary and preserved the anonymity of the participants with no invasive sampling techniques, the ethics committee did not require a formal consent process. Nonetheless, the survey opened with a discussion of risks, benefits, and potential harms, and then stated that by starting the survey a woman consented to participate. Our research was conducted in full accordance with the World Medical Association Declaration of Helsinki.

Results

Eleven of the 31 invited multi-disciplinary experts completed the entire validation process. The final panel consisted of: research and a clinical psychologists [2]; obstetrician-gynecologists [2]; a lawyer expert in birth issues [1]; directors of non-governmental organizations [2]; a midwife [1]; a doula [1]; an epidemiologist [1]; a mother [1]. One of the psychologists runs a support group for new mothers, and the NGO directors lead initiatives on expanding pregnancy and birth options. The doula herself is a mother and has supported birthing mothers in Hungary. Thus, 6 of the 11 experts had personal experiences as, or close relationships with active users of Hungarian maternity care.

Figure 1 summarizes the survey development and validation process. Only 3 items scored below the commonly used I-CVI cut off at or below 0.8. The LTM3 question “Is your baby during this time period living?” received an I-CVI of 0.8. Experts felt this question used harsh language and might turn women away. Another question from LTM3, “Did you get your first prenatal visit as early in your pregnancy as you wanted?” scored 0.76; experts felt this question was not relevant to a socialized health system. As a group the informal payment questions received scores (I-CVI 0.93) above the cut off for inclusion. However, experts consistently commented on the lack of relevance to the intrapartum context of questions developed for general inpatients. Table 1 lists the nine new informal payment questions that we developed with expert input.

Fig. 1
figure 1

Survey development process

Full size image
Table 1 Nine new informal cash payment questions
Full size table

After the informal payment questions the next most challenging group of items referred to the overlap between payments and the model of care (doctor, midwife). Experts decided that the process of paying a provider informally hinged on the model that the majority of women select prior to delivery. In accordance with previous research and their own system knowledge, experts then decided to use the word “chosen” (választott) to refer to the continuity prenatal relationship that women pay for informally. The word “chosen” was then applied to the private and public models of care to yield three models of chosen doctor care and one model of chosen (hospital) midwifery care. Two models of “not chosen” care represented the default model provided by the state insurance system. Independent home birth midwifery was its own category. These linguistic results are shown in Table 2.

Table 2 Model of care categories with linguistic results
Full size table

Ipsos field tested the survey and confirmed that the duration of participant engagement required approximately 30 min. Altogether, Ipsos sent 892 e-mail invitations to their panel with a response rate of 67%. Reasons for drop out were: 14 (1.6%) quota full, 115 (12.9%) screened out, 163 (18.3%) terminated the survey. In addition, 657 completed surveys were obtained through convenience internet sampling. Table 3 shows demographic indicators for the sample with the corresponding most recent census data listed below the table. Overall, the representative sample compared well to recent census data. Pearson Chi2 statistics show that the convenience sample was statistically significantly more highly educated women (Chi2 = 341.8, p < 0.0001), lived in the capital (Chi2 = 128.2, p < 0.0001), and had higher average net incomes (t = −16.02, p < 0.0001).

Table 3 Social demographic indicators
Full size table

Table 4 reveals the informal payment practices in the representative sample according to the model of care categories. Excluding the categories with fewer than five respondents, we see that the response percentages to the informal payment question ranged between 75 and 86%. Pearson Chi2 statistics showed that the share of women who paid informally was significantly different across the groups (Chi2 = 183.6; p < 0.0001). ANOVA test shows that the amount of informal payment is also significantly different across groups (F = 6.73, p < 0.0001).

Table 4 Informal payments by provider type, representative sample
Full size table

Regarding informed consent practices, Table 5 shows the responses from the representative sample as to whether a woman’s permission was obtained prior to undergoing a cesarean (N = 244) or an episiotomy (N = 257). Pearson Chi2 statistics showed that the permission practices were significantly different across provider types for cesarean section (Chi2 = 39.2, p = 0.003) but were not significantly different for episiotomy (Chi2 = 18.6, p = 0.414). MADM scores were significantly different across permission categories (ANOVA results for caesarean: F = 14.50, p < 0.0001, for episiotomy: F = 10.34 p < 0.0001).

Table 5 Permission for cesarean (N = 244) or episiotomy (N = 257), representative sample
Full size table

Table 6 shows the coded results from an open-ended question from LTM3. Thematic analysis of the open-ended responses (N = 1015) from the entire sample identified 13 priority areas of the maternity care experience, 9 of which were addressed by the questionnaire.

Table 6 Thematic analysis of responses to open-ended question: What was the worst thing about the care you received during your recent birth? (N = 1015)
Full size table

Discussion

We used a standardized and rigorous methodology to develop and validate a survey instrument that comprehensively examined maternity care experiences in Hungary, thus filling an important gap where no government-sponsored data exists. The process included collating validated items from the international literature, adapting them to the Hungarian context by expert panel, designing region-specific new items, and validating the content. To the best of our knowledge, no other group has undertaken this task. We found that existing English-language survey items concerning the experience of maternity care were clear and relevant to the Hungarian context. This is likely due to the fact that many of the issues related to excessive obstetric procedures, poor communication, and the lack of maternal autonomy that we found in Hungary are also common in the United States and Canada [8, 18, 19].

Our expert process proved effective at identifying survey domains that required additional adaptation. For example, our maternity care experts identified that informal payment questions developed for general inpatients required adaptation. Our expert panel integrated linguistic, system, and user expertise to develop new survey items specific to the CEE region. We believe this was a result of the collaboration across our diverse panel. Some argue that content experts should have significant research or clinical experience. However, inclusion of “lay” experts has been found to be appropriate in many situations [27] and is consistent with the principles of patient-centered research [32].

To test reliability, we administered the survey to two samples of service users: a randomly selected representative sample and a parallel convenience sample. The instrument performed well in both groups: it was user friendly, feasible to distribute in an online format, and captured information on several domains relevant to maternal experience of care during pregnancy and childbirth.

In our 30-min survey 67% of the items addressed issues of person-centered care. We found that the extent of informed consent and autonomy (MADM scores) varied significantly across the model of care categories. We also found lower MADM scores in the women who had cesareans and episiotomies performed without their consent. Lack of consent for procedures was a common theme in the responses to the open-ended question. These findings are discussed in detail in a separate paper [33] and are supported by qualitative studies that show that women pay informally to receive care that they perceive to be more respectful [10, 17]. Analysis of our model of care categories showed extensive overlap between informal payments and the use of the word “chosen”. Women who went to their local clinic without choosing a doctor paid informally 17% of the time—the lowest frequency of all the models of care. We believe the statistically significant different distribution of informal payments across the care categories validates these categories for future research in Hungary and the CEE region. Because informal payments may distort health care services in ways that require policy intervention [21], reliable survey items are necessary to evaluate their effects [23].

Limitations

Because we chose an expert validation process without extensive community involvement, we may not have addressed additional elements of mother-centered care in this population. For example, responses to the open-ended questions indicate additional items could have addressed the physical state of the maternity and newborn wards, newborn care in general, and home birth. Additionally, internet users may not be representative of the Hungarian general population; a more representative sample would require telephone or face-to-face interviewing. Finally, given the challenges of surveying the broad preferences and outcomes of the entire maternity system, ideal distribution of our survey would capture more pathways, especially for ethnic/minority and poor women.

Conclusion

We developed a reliable and relevant survey instrument to evaluate evidence-based care and maternal experiences in Hungary. This survey instrument can be easily adapted for use in other Central and Eastern European countries, where informal payments, the variable application of evidence, and concerns with respectful provider-patient relationships are similar. We plan to utilize the data resulting from this survey to inform interprofessional education and elucidate determinants of high quality maternity care in Hungary. A survey similar to ours could be used to regularly monitor trends in Hungarian maternity care as well as for cross-country comparisons in the CEE region, where representative data on quality maternity care is lacking.

Abbreviations

CCinBC:

Changing Childbirth in British Columbia

CEE Region:

Central and Eastern European Region

CVI:

Content Validity Index

LTM3:

Listening to Mothers 3

MADM:

Mothers Autonomy in birth Decision Making scale

References

  1. Rao JK, Anderson L, Inui T, Frankel RM. Communication interventions make a difference in conversations between physicians and patients: a systematic review of the evidence. Med Care. 2007;45(4):340–9.

  2. Hodnett ED, Gates S, Hofmeyr G, Sakala C. Continuous support for women during childbirth. Cochrane Database Syst Rev. 2013;7:CD003766. doi:10.1002/14651858.CD003766.pub5.

  3. Iida M, Horiuchi S, Porter SE, Pope R, Graham L, Patel S. The relationship between women-centred care and women's birth experiences: a comparison between birth centres, clinics, and hospitals in Japan. Midwifery. 2012;28(4):398–405.

    Article  PubMed  Google Scholar 

  4. Tuncalp O, Were WM, MacLennan C, Oladapo OT, Gulmezoglu AM, Bahl R, et al. Quality of care for pregnant women and newborns-the WHO vision. BJOG. 2015;122(8):1045–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Miller S, Lalonde A. The global epidemic of abuse and disrespect during childbirth: history, evidence, interventions, and FIGO’s mother-baby friendly birthing facilities initiative. Int J Gynaecol Obstet. Feb 2015;123(2):93–4.

    Google Scholar 

  6. Bohren MA, Vogel JP, Hunter EC, Lutsiv O, Makh SK, Souza JP, et al. The mistreatment of women during childbirth in health facilities globally: a mixed-methods systematic review. PLoS Med. 2015;12(6):e1001847. doi:10.1371/journal.pmed.1001847.

  7. Wang H, Liddell CA, Coates MM, Mooney MD, Levitz CE, Schumacher AE, et al. Global, regional, and national levels of neonatal, infant, and under-5 mortality during 1990-2013: a systematic analysis for the global burden of disease study 2013. Lancet. Sep 2014;384(9947):957–79.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Miteniece E, Pavlova M, Rechel B, Groot W. Barriers to accessing adequate maternal care in central and eastern European countries: a systematic literature review. Soc Sci Med. 2017;177:1–8.

    Article  PubMed  Google Scholar 

  9. Danichevski K, McKee M, Balabanova D. Prescribing in maternity care in Russia: the legacy of soviet medicine. Health Policy. 2008;85(2):242–51.

    Article  PubMed  Google Scholar 

  10. Arsenijevic J, Pavlova M, Groot W. Shortcomings of maternity care in Serbia. Birth. 2014;41(1):14–25.

    Article  PubMed  Google Scholar 

  11. Colombini M, Rechel B, Mayhew SH. Access of Roma to sexual and reproductive health services: qualitative findings from Albania, Bulgaria and Macedonia. Glob Public Health. 2012;7(5):522–34.

    Article  PubMed  Google Scholar 

  12. Hagymasy L, Gaal J. A comparative study of vertical and horizontal deliveries in the presence and with the assistance of the woman’s partner. J Psychosom Obstet Gynaecol. 1998;19(2):98–103.

    Article  CAS  PubMed  Google Scholar 

  13. Farkasne S, Velkei E. “Birth Guide: About the Hungarian Birth Services” (Születéskalauz: a magyarorszagi szuleszeti intezmenyek szolgaltatasairol). First ed. Budapest: Merce Egyesulet; 2001. 265 p.

  14. ASSPRO. The price of a childbirth: out-of-pocket payments for maternity care in central and eastern europe. Maastricht, the Netherlands: Maastricht University; 2013.

  15. Falkingham J. Poverty, out-of-pocket payments and access to health care: evidence from Tajikistan. Soc Sci Med. 2004;58:247–58.

    Article  PubMed  Google Scholar 

  16. Cohen N. Informal payments for health care--the phenomenon and its context. Health Econ Policy Law. 2012;7(3):285–308.

    Article  PubMed  Google Scholar 

  17. Stepurko T, Pavlova M, Levenets O, Gryga I, Groot W. Informal patient payments in maternity hospitals in Kiev Ukraine. Int J Health Plann Manag. 2013;28(2):169–87.

    Article  Google Scholar 

  18. Declercq ER, Sakala C, Corry MP, Applebaum S, Herrlich A. Major survey findings of listening to mothers (SM) III: pregnancy and birth: report of the third National U.S. survey of Women's childbearing experiences. J Perinat Educ. 2014;23(1):9–16.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Vedam S, Stoll K, Martin K, Rubashkin N, Partridge S, Thordarson D, et al. The Mother's autonomy in decision making (MADM) scale: patient-led development and psychometric testing of a new instrument to evaluate experience of maternity care. PLoS One. 2017;12(2):e0171804. doi:10.1371/journal.pone.0171804.

  20. Vedam S, Stoll K, Rubashkin N, Martin K, Miller-Vedam Z, Hayes-Klein H, et al. The mothers on respect (MOR) index: measuring quality, safety, and human rights in childbirth. . Social science and medicine. PopulHealth. 2017; In press, January 2017

  21. Baji P, Pavlova M, Gulacsi L, Groot W. Exploring consumers’ attitudes towards informal patient payments using the combined method of cluster and multinomial regression analysis the case of Hungary. BMC Health Serv Res. 2013;13:62. doi:10.1186/1472-6963-13-62.

  22. Szende A, Culyer AJ. The inequity of informal payments for health care: the case of Hungary. Health Policy. 2006;75(3):262–71.

    Article  PubMed  Google Scholar 

  23. Gaal P, McKee M. Informal payments for health care and the theory of ‘INXIT. Int J Health Plann Manag. 2004;19(2):163–78.

    Article  Google Scholar 

  24. Stepurko T, Pavlova M, Gryga I, Groot W. Empirical studies on informal patient payments for health care services: a systematic and critical review of research methods and instruments. BMC Health Serv Res. 2010;19(10):273.

    Article  Google Scholar 

  25. Slocumb E, Cole FL. A practical approach to content validation. Appl Nurs Res. 1991;4(4):192–5.

    Article  CAS  PubMed  Google Scholar 

  26. Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35(6):382–5.

    Article  CAS  PubMed  Google Scholar 

  27. Schilling LS, Dixon J, Knafl K, Grey M, Ives B, Lynn MR. Determining content validity of a self-report instrument for adolescents using a heterogeneous expert panel. Nurs Res. 2007;56(5):361–6.

    Article  PubMed  Google Scholar 

  28. Adler NE, Stewart J. Using team science to address health disparities: MacArthur network as case example. Ann N Y Acad Sci. 2010;1186:252–60.

    Article  PubMed  Google Scholar 

  29. Sandall J, Soltani H, Gates S, Shennan A, Devane D. Midwife-led continuity models versus other models of care for childbearing women. Cochrane Database of Syst Rev. 2016;4:CD004667. doi:10.1002/14651858.CD004667.pub5.

  30. Saito S, Nomura N, Noguchi Y, Tezuka I. Translatability of family concepts into the Japanese culture: using the family environment scale. Fam Process. 1996;35(2):239–57.

    Article  CAS  PubMed  Google Scholar 

  31. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.

    Article  Google Scholar 

  32. Frank L, Forsythe L, Ellis L, Schrandt S, Sheridan S, Gerson J, et al. Conceptual and practical foundations of patient engagement in research at the patient-centered outcomes research institute. Qual Life Res. 2015;24(5):1033–41.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Baji P, Rubashkin N, Szebik I, Stoll K, Vedam S. Informal cash payments for birth in Hungary: are women paying to secure a known provider, respect, or quality of care? Soc Sci Med. 2017;189:86–95.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We would like to acknowledge our expert panel and translators, without whom this research would not have been possible: Experts: Balazs Balint, Agnes Czovek, Agnes Geréb, Nora Schimcsig, Katalin Varga, Erika Schmidt, Stefania Kapronczay, Linda Roszik, Peter Lobmayer, Anna Iványi, Zuzana Kriskova. Translators: János Hanák; Frigyes Tarján, Erika Solyom, Zsofia Goreczky. Pilot testers: Anna Ternovszky, Zsuzsana Kertesz, Irén Móré and Klára Ecsedi.

Funding

Funding for data collection was obtained through “crowd sourcing” via the internet website Crowdrise.com. A proposal was posted on the website, and individual private donors contributed funds. To mitigate conflict of interest, we asked that no women who planned to participate in the study contribute to the fund. These privately raised funds were used to retain the survey firm Ipsos (Thaly Kalman utca 39, Budapest Hungary). Petra Baji’s research was supported by the Hungarian Scientific Research Fund OTKA (PD 112499). Nicholas Rubashkin’s research was supported by a Fulbright research scholar grant.

Open access

The authors agree to make the supporting data available.

Author information

Authors and Affiliations

  1. Departments of Global Health Sciences and Obstetrics, Gynecology, and Reproductive Sciences, University of California at San Francisco, Mission Hall, Box 1224, 550 16th Street, Third Floor, San Francisco, California, 94158, USA

    Nicholas Rubashkin

  2. Institute of Behavioral Sciences, Semmelweis University, VIII. Nagyvárad tér 4. XX. Em, Budapest, H-1089, Hungary

    Imre Szebik, Zsuzsa Szántó & Éva Susánszky

  3. Department of Health Economics, Corvinus University of Budapest, Fővám tér 8. Main Building Room E113, Budapest, 1093, Hungary

    Petra Baji

  4. The Birth Place Lab, Faculty of Medicine, The University of British Columbia, Vancouver, Canada

    Saraswathi Vedam

  5. Midwifery Program | Department of Family Practice, Suite 320 - 5950 University Boulevard, Vancouver, BC, V6T 1Z3, Canada

    Saraswathi Vedam

Authors
  1. Nicholas Rubashkin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Imre Szebik
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Petra Baji
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zsuzsa Szántó
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Éva Susánszky
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Saraswathi Vedam
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

NR and IS were co-investigators during the entire survey validation and analysis process. Dr. R drafted this paper and thus is first author. PB contributed an economic perspective with survey items concerning informal payments and analysis of the informal payments. She also conducted statistical tests for the data contained herein. ZS and ÉS consulted on survey sampling techniques and conducted the thematic analysis of the responses to one of the open-ended questions. SV performed the role of supervising researcher, working closely with Dr. R throughout the entire survey validation and analysis process. She also edited drafts and approved the final manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Nicholas Rubashkin.

Ethics declarations

Ethics approval and consent to participate

The Regional Ethics Committee of Semmelweis University, Budapest (ref. number: 99/2014) approved this study. Because participation in the study was voluntary and preserved the anonymity of the participants with no invasive sampling techniques, the ethics committee did not require a formal consent process. Nonetheless, the survey opened with a discussion of risks, benefits, and potential harms and then stated that by starting the survey a woman consented to participate. Our research was conducted in full accordance with the World Medical Association Declaration of Helsinki.

Consent for publication

All authors consent to this article’s publication.

Competing interests

The authors alone are responsible for the content and writing of this paper. We declare no financial, political, intellectual, or religious interests in this research.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rubashkin, N., Szebik, I., Baji, P. et al. Assessing quality of maternity care in Hungary: expert validation and testing of the mother-centered prenatal care (MCPC) survey instrument. Reprod Health 14, 152 (2017). https://doi.org/10.1186/s12978-017-0413-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12978-017-0413-3

Keywords

Reproductive Health

ISSN: 1742-4755