Skip to main content
Download PDF

Measuring adolescent friendly health services in India: A scoping review of evaluations

Reproductive Health volume 13, Article number: 137 (2016) Cite this article

An Erratum to this article was published on 16 March 2017

Abstract

Background

Initiatives to promote adolescent friendly health services (AFHS) have been taking place in India and many low- and middle-income countries for nearly two decades. Evaluations of these initiatives have been placed in the public arena from time to time, but little is known about what they say about the overall situation on AFHS in India. This study aimed to describe how efforts to provide AFHS in India have been evaluated, how well they have been evaluated, and what their findings and implications are.

Methods

We conducted a scoping review of evaluations of AFHS initiatives in India from 2000 to 2014. An electronic search was carried out in Medline and EMBASE. A manual search of grey literature was also performed, and experts were contacted in order to obtain additional manuscripts and reports.

Results

Thirty evaluation reports were identified representing a broad geographic distribution. Evaluations have focused on government-sponsored AFHS programmes or independent non-governmental organization (NGO) initiatives to strengthen government services. The evaluations primarily measured programme outputs (e.g. quality and service utilization) and health behavioural outcomes (e.g. condom use). Study designs were commonly descriptive or quasi-experimental. Most evaluations found improvement in quality and utilization of services, and some demonstrated an increase in adolescent knowledge or health behaviours. Few measured positive project/programme results such as older age at first pregnancy. Strengths of evaluations were clear objectives, frequent use of multiple data sources, and assessment of programmatic outputs as well as health outcomes. Weaknesses were lack of consistency and quality.

Conclusions

Our findings confirm that a number of evaluations of AFHS initiatives in India have been carried out. They point to service quality and in behavioural improvements in adolescents. However, their lack of consistency hinders comparison across sites, and their uneven quality means that their findings need to be interpreted with caution.

Peer Review reports

Plain English summary

Adolescents make up one-fifth of India’s population. India’s government has prioritized efforts to make health services more adolescent friendly. A number of individual studies and evaluations have been carried out and published, but little is known about what they say as a whole. The purpose of our study was to explore the range and results of evaluations of adolescent friendly health services in India.

We conducted a review of publicly-available evaluations of adolescent friendly health service programmes or projects in India from 2000 to 2014. We found thirty evaluations describing initiatives led by government agencies and non-governmental organizations. We summarized the methods and findings of these evaluations using a standard framework. We learned that evaluations were highly variable in measuring programme processes, outputs, or health impacts. Most evaluations found improvement in quality of services and some showed an increased in adolescents’ knowledge and sexual health behaviours.

Our study concluded that evaluations of adolescent friendly initiatives are taking place in India and demonstrating positive health benefits for adolescents. We recommend that evaluation methods be standardized to ensure quality and comparability.

Background

Improving the reproductive and sexual health (RSH) of adolescents is a key component of India’s National Health Mission [1, 2]. This paper examines evaluations of government and non-government organization (NGO) initiatives to increase access to quality RSH services by adolescents and young people in India.

Adolescents constitute over 20% of India’s population. These young people face a number of RSH problems, such as risk for early and unplanned pregnancy and vulnerability to sexually transmitted infections, including HIV [3, 4]. India’s Ministry of Health and Family Welfare (hereafter called “the Ministry”) addressed these problems in 2005 by formulating its national Adolescent Reproductive and Sexual Health (Adolescent RSH) policy and guidelines within the context of the National Health Mission [5]. Measures were subsequently taken to support their implementation [1]. Officials in some states and union territories began applying the Adolescent RSH policy and guidelines, and NGOs escalated their efforts as well.

A growing body of reports and articles have documented efforts to make RSH services more equitable, available, acceptable, appropriate, and effective-all characteristics of adolescent friendly health services (AFHS) as defined by the World Health Organization (WHO) [6]. In its implementation guide for ARSH, the Ministry enumerated seven standards for providing AFHS (Table 1) [1]. In 2014, the Ministry launched Rashtriya Kishor Swasthya Karyakram, the National Adolescent Health Programme), which expanded the scope of adolescent health programming beyond RSH but maintains AFHS in clinics as a key element of its list of programme components [7]. To date, there is limited knowledge of how these policies and programmes to increase access to quality RSH services have been evaluated and what lessons have been learned thus far.

Table 1 Standards from Government of India Implementation Guide for Adolescent Friendly Health Services a
Full size table

Our study examined how these expanded efforts to promote AFHS have been evaluated in order to map efforts thus far and identify strategies to perform these evaluations. Specifically, we sought to answer the following questions:

  • Where and when have evaluations/studies of AHFS initiatives been carried out?

  • Who has conducted these evaluations/studies?

  • For what purpose have these evaluations/studies been conducted?

  • What design and methods have been used to carry out these evaluations/studies?

  • What was the nature and extent of facilities and clients included in these evaluations/studies?

  • What were the main findings of these evaluations/studies?

Our goal is to improve the quality and impact of population-based AFHS efforts and to gain knowledge for implementation in other settings.

Methods

Literature search

We conducted a systematic search of publicly available peer-reviewed articles and reports from January 1, 2000 to August 1, 2014. We searched Medline and EMBASE electronic databases using medical subject heading (MeSH) terms “adolescent health services” or adolescent and young adult age-limited “health services,” “preventive health services,” or “school health services.” We restricted our search to peer-reviewed studies and evaluations performed in India. Detailed search strategies are in Appendices 1 and 2. We used the same key words to search websites of organizations engaged in adolescent health service activities in India, including United Nations agencies, international and indigenous NGOs, bilateral agencies, and foundations. In addition, we searched the websites of professional associations and the Ministry at national and state/district levels for relevant publications. Finally, we reviewed the reference lists of articles and reports obtained to identify any additional publications that may have been missed.

Inclusion and exclusion criteria

We established inclusion criteria as any report that described an evaluation of an initiative to improve health services for adolescents in India. We included initiatives in all types of health facilities-including those for all ages and those dedicated to adolescents and those operated by government or NGOs. Our primary focus was on facility-based initiatives directed at individuals ten to nineteen years, and on health service provision (i.e. the provision of preventive, curative and rehabilitative services by a trained health worker). We defined evaluation as “the systematic collection of information about the activities, characteristics, and outcomes of programmes [for adolescents] to make judgments about the program, improve program effectiveness, and/or inform decisions about future program development” [7]. We defined research as “the scientific investigation of how social factors, financing systems, organizational structures and processes, health technologies and personal behaviours affect adolescent access to health care, the quality and cost of health care, and health and well-being of adolescent recipients of services” [8]. Because we were primarily interested in results of programmes, we did not include formative or input evaluations that informed programme development and focused our review instead on a range of evaluation types from process to output, outcome and impact evaluations (see Fig. 1). We used standard Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram to describe the inclusion and exclusion process [9]. PRISMA is an evidence-based flow diagram of the minimum items for reporting in systematic reviews and meta-analyses designed to help authors improve reporting. Human subjects review was not necessary given that our review protocol did not directly involve human participants.

Fig. 1
figure 1

Evaluation logic models

Full size image

Data analysis

Two authors reviewed all reports and entered data from those meeting initial inclusion criteria into an evidence table adapted from PRISMA statement elements [10]. We categorized data based on geographic region where the study/evaluation was conducted, year, institution/organization that carried it out, its objectives, its design and methods (see Table 2 for a definition of the types of evaluation or research designs employed across the selected evaluations), nature of health facilities (hospital/clinic, government/non-government), and number of health facilities and/or users studied. We identified the type of study/evaluation they employed organized them into four broad categories (see categories illustrated in the logic model Fig. 1). These categories included findings (when present for each category) specific to process (programme design, fidelity of implementation of the programme), outputs (including quality and coverage/reach of services), health behaviour outcomes, and programme results/impact measured by evaluation. Data entered into the table were discussed with all authors to reach consensus on characteristics and findings of each evaluation. Following data abstraction, we reviewed trends specific to the categories described above and developed primary results for each category through discussions among authors.

Table 2 Evaluation or study designs
Full size table

We utilized the Revised Standards for Quality Improvement Reporting Excellence to assess the quality of each publication [11]. The SQUIRE guidelines were developed and refined through a systematic vetting process with input from an expert panel and through public feedback [12, 13] and provide a framework for reporting new knowledge about how to improve healthcare. Two authors rated each evaluation using an adapted quality assessment scoring approach where each adapted SQUIRE criteria met by an evaluation report resulted in 1 point. A maximum score for meeting all criteria was 15. Two authors independently scored each report, and mean scores and inter-rater reliability were calculated and compared using a Mann–Whitney comparison and kappa statistic.

Results

We identified 161 publications in our initial database search and thirty-three additional publications from our grey literature search. The process we used to move from this to the thirty presented here is described using a PRISMA flow diagram (Appendix 3). After removing duplicates, we screened titles and abstracts of 194 publications, of which 141 were excluded. Of the remaining 53 full-text articles and reports reviewed, we excluded twenty-three based on: not examining health service provision (N = 14), not specific to adolescents or adolescent-friendly health services (N = 5), study/evaluation of programme distributing a health commodity (e.g. iron supplementation) outside of clinical service context/venue (N = 3), or other (N = 1 non-systematic review). Of the remaining thirty publications, eighteen were published as reports and twelve as peer-reviewed research studies. Characteristics and main findings of evaluation reports (labelled with letters A-S) are found in (Tables 3 and 4) and of peer-reviewed articles (labelled with numbers 1–12) in (Tables 5 and 6), respectively.

Table 3 Characteristics of evaluations (N=18)
Full size table
Table 4 Characteristics of research studies (N=12)
Full size table
Table 5 Main findings of evaluations (N=18)
Full size table
Table 6 Main findings of research studies (N=12)
Full size table

Where and when have the evaluations/studies been carried out?

We found a broad geographic distribution of the thirty studies/evaluations. We identified eight in Maharashtra, five in Bihar, three in Haryana, two in Delhi, Gujarat, and Uttar Pradesh, and one each in Odisha, Rajasthan, and Uttarakhand. We also identified five that covered multiple states and union territories. Some evaluations/studies analysed data from the same project (e.g., PRACHAR), at different time points and with varying study designs. See Fig. 2 for a map illustrating where specific evaluations/studies were carried out. The majority of reports/articles were published in the latter half of the inclusion time period of 2000 to 2014 with only five (A, B; 1,2,3) published before 2008. Time from AFHS implementation through data collection to publication of report, when indicated, ranged from 1 to 6 years.

Fig. 2
figure 2

Geographic distribution of evaluations (labelled A through S) and studies (labelled 1 through 12) of adolescent friendly health service initiatives in India

Full size image

Who has conducted these evaluations/studies?

NGO’s conducted fourteen of the thirty evaluations/studies (46%). Of those, five (D,M,N; 3,12) were conducted by indigenous NGOs and nine (A, B, I, R; 1,5,8,9,11) by international NGOs. Other bodies included academic institutions (S, F, K, P, Q, S; 2,4,6,7,10), consulting agencies (E,G,L), a government (C) or a multilateral agency (H). We found many partnerships between NGOs and state government agencies and also that most publications had multiple authors and contributors from different disciplines. The majority of reports/articles (A,B,D,E,F,G,I,L,P,Q,R; 1,3,6,7,9) involved a research/evaluation team that was external to the implementing agency.

For what purpose have these evaluations/studies been conducted?

Nearly all reports contained clearly defined objectives, often with multiple components. Common objectives were to assess the quality of health services provided to adolescents (process: C,E,F,G,H,I,K,L,M,N,O,R,S; 6,10,12), to assess changes in the utilization of health services by adolescents (outputs: D,E,H,K; 2,3,4,12), and to measure RSH knowledge of adolescents exposed to a programme (outcomes: B,J,K,L; 3,5,9,10). Few studies/evaluations aimed to assess behavioural outcomes such as condom or contraception use (outcomes: A, J;4,5) or health outcomes such as age at first birth associated with programme exposure (results/impact: 9,11). One large multi-component project called PRACHAR was evaluated in multiple studies and reports which examined various outcomes including age at first birth, birth spacing, and haemoglobin levels of participants (J; 5,8,9,11). Only the PRACHAR project evaluated the impact on community or population level outcomes such as age at marriage and first birth.

What evaluation/study designs and methods have been used?

We observed a variety of designs used to perform these studies/evaluations, falling broadly into categories of descriptive, quasi-experimental, feasibility assessment, situation analysis, and those using combinations of designs. A descriptive design was used in most evaluations/studies (E,F,G,H,I,K,M,O,P,R,S; 2,4,12), quasi-experimental in 10 (A,B,C,D,J,L; 5,6,8,11), a feasibility assessment in one (Q) and combinations of designs in five (1,3,7,9,10).

The most commonly utilized methodology was a simple post-implementation, cross-sectional analysis without a comparison group, found in 18 evaluations/studies (E,F,G,H,I,K,M,O,P,R; 1,2,3,4,9,10,11). In contrast, eight (B,J,L;1,3,5,7,10) applied a pre- and post-implementation (i.e. baseline and follow-up) analysis without comparison groups. We also observed the comparison of “exposed” (facilities/participants who received an AFHS intervention) versus those who were “non-exposed” (facilities/participants who had not received an AFHS intervention): this was used in five evaluations/studies (A,D;3,6,11).

In addition to quantitative analytic methods, many evaluations/studies utilized qualitative methods by means of key informant interviews, in-depth client interviews, or focus group discussions to assess various aspects of an AFHS initiative. Qualitative methods were used in 15 evaluations/studies (E,F,G,M,O,P,R,S; 1,2,3,6,7,9,12). Details specific to the qualitative analytic techniques were rarely described.

Facility checklists were utilized in a number of evaluations/studies (C,E,F,G,I,K,L,M,P,S), and facility attendance records were analysed in five (2,4,6,7,12). Provider interviews or questionnaires were used in nine (E,F,G,K,P,R,S; 6,10) while adolescent client interviews or questionnaires were used in 12 reports (A,B,C,F,G,M,O,P,R,S; 6,12). One (R) employed mystery clients. Standard definitions of quality varied widely and were inconsistently described in the reports. Only four reports (C,F,Q,P) specifically reported on the seven standards of quality noted in (Table 1) using the quality criteria set out in the Ministry’s implementation guide. (Reference 1), while others (H,K,P,S) describes quality measures that were similar to these standards but not explicitly standardized.

What was the nature and extent of facilities and service users included in the evaluations/studies?

Where descriptions were provided, there was variability in the nature and extent of health facilities and adolescent users included. Many reports did not contain this information. When information was available, as we found in thirteen evaluations/studies (C,D,E,F,G,I K,L,M,P Q,R,S), the size and distribution of target adolescent populations receiving an AFHS intervention was rarely stated. An exception was D, which reports that each cluster of three villages has an estimated adolescent population of 3000–5000, of those approximately 600 adolescents were sampled in each village. Thus, it was often challenging to assess representative nature of a sample or generalizability of the report.

Many reports noted number and kind of health facilities included in the context of a facility assessment (for example, one evaluation in Gujarat (E) included twenty-one facilities, representing 50% of all ARSH facilities in the intervention community and one in Rajasthan (G) covered 12/110 operating adolescent friendly health clinics (11%), including one of each facility type (district hospital, community health centre, and primary health centre) from each of the four selected districts. From these, evaluators sampled adolescent clients and service providers and also observed facilities using a checklist. Some reports described the number of health service providers or stakeholder interviews, for example, report E describes that three state officials, nine district officials, seventeen medical officers, and nineteen grassroots level health workers were interviewed.

We could not infer the representativeness of users surveyed from the information provided. While all evaluations/studies that included surveys or interviews with adolescent clients indicated number of adolescents interviewed, typically stratified by age, rarely did reports describe the sampling population from which these survey participants were drawn or how representative of the sample population they were. Where qualitative methodology was adopted, multiple reports described the number of focus group discussions conducted without indicating the number of participants included in each focus group (E,M; 9).

What were the main findings of the evaluations/studies?

Process

Very few reports commented on process outcomes, specifically programme design or fidelity of programme implementation, and whether any mid-course adaptations were made. The exceptions were report Q, which included specific comments about process of programme design, and a few which examined feasibility of programmes (B,Q;1) or commented on challenges of implementation or monitoring (E,C,F,G,L). Quality was assessed variably across evaluations/studies, with the minority that used the adapted Ministry standards demonstrating an increase across all quality standards compared to control groups or previous time intervals. Persistent unmet quality standards were noted: lack of ensuring adequate equipment and supplies (P), inadequate awareness in the community about services (C,F,Q) and inadequate management systems in place (C,F).

Outputs

More evaluations/studies described outputs, with 11 evaluations (D,E,G,H,M; 1,2,3,4,7,12) including assessments of service utilization. All but one report (G) reported that utilization increased as a result of an AFHS initiative. However, not all results were presented with baseline data.

Health knowledge and behaviour outcomes

In general, programmes designed to make health services more adolescent friendly resulted in increased knowledge about RSH needs of adolescents, both among service users themselves (A,B,D,L,R,S; 1,3,5,7,10,12) and among health service providers (K,10). Furthermore, a number of evaluations/studies commented on acceptance of the programme by gatekeepers in the community, such as parents (B,C;1,3). The most common behaviour outcomes evaluated were self-reported sexual health behaviours, such as condom or contraceptive use (A,J,L;5,9,11). In these studies/evaluations, AFHS exposure was associated with increased reported contraceptive and sanitary pad use.

Programme results/impact

A small number of initiatives evaluated programme results/impacts such as levels of delayed first birth [9, 11] or anaemia (B,2), and an early study (A) of CEDPA Better Life Options Programme examined mean number of children and rates of child deaths-finding both to be decreased. The PRACHAR intervention (11) demonstrated greater age at marriage and first birth at the community level.

Using the SQUIRE-adapted scoring system consisting of fifteen questions, the mean quality score averaged between two independent scorers was 8.1/15 (54%). Inter-rater reliability for scores in independent domains was variable (kappa = 0.122, p = 0.014), however the average mean quality score was not significantly different (8.53 vs. 7.63, p = 0.291).

Discussion

This is the first study to systematically review a body of country-specific evaluations and studies of AFHS initiatives and to draw conclusions about their quality and their effects. We found that at least 30 independent evaluations and studies have been conducted over a wide geographic distribution of India since 2000. They have been carried out primarily by NGOs and academic institutions and have focused on government-sponsored AFHS programmes or independent NGO initiatives to strengthen government services. They focused primarily on service utilization trends and health behavioural outcomes and less frequently on design and implementation of AFHS. The rationale for sampling strategies was not uniformly described in evaluation reports making it challenging to assess the generalizability of the findings. Further, study designs most commonly used were descriptive or quasi-experimental in nature, and frequently lacked a comparison group to draw inferences on effectiveness of initiatives. Future evaluations and studies should be better designed and implemented and should pay more attention to process and long term impact.

Most evaluations/studies demonstrated improvement in the quality of services as a result of government or NGO initiatives to make services more adolescent-friendly. Many also showed an improvement in adolescent knowledge levels of RSH issues, and in health behaviours, such as use of contraception, while few demonstrated positive programme results/impacts.

While much national and international attention has been paid to improving the quality of health systems for adolescents, few efforts to do so have been rigorously studied [14]. It is evident from these evaluation and study reports that a standard approach to evaluation of AFHS has not been adopted. The WHO has developed and promoted the application of its Quality Assessment Guidebook [15] which could facilitate greater comparability across evaluations/studies, but using it will require support —one evaluation (F) specifically referenced using WHO quality assessment tools, describing them as “very elaborate and time consuming” and needing to be simplified for local use.

The publication dates reveal that the volume of evaluations and studies of AFHS has increased over time, which is likely attributable to the establishment of the National Health Mission policy and accompanying resources made available for AFHS both by the Government of India and others. Some geographic regions like Maharashtra and Bihar are more represented than others, which may reflect differences in state government support of evaluation resources or external agency interest.

Reviews and syntheses of AFHS in low- and middle-income countries (LMICs) have been conducted at the global level. An example of the former is a review of research and evaluation evidence in improving the quality and use of SRH services by adolescents in LMICs. It found the most robust evidence for programmes using a combination of approaches including health worker training and facility improvements as well as strategies for demand generation and community acceptance [15]. An example of the latter is synthesis of programmatic outputs (i.e. quality and coverage) and service utilization in eight LMIC countries, which concluded that with support, government-run health facilities can improve the quality of health services and their utilization by adolescents [16].

Moving to measures and methods, a systematic review of indicators of youth-friendly health care in high-, middle-, and low-income countries, identified 22 studies, 15 of which used quantitative methods, six used qualitative methods, and one used mixed methodology [17]. The review further expanded upon eight domains as central to young people’s positive experience of care, including accessibility of health care, staff attitude, communication, medical competency, guideline-driven care, age appropriate environments, youth involvement in health care, and health outcomes. Certain attributes, particularly staff attitudes that were respectful and friendly, were universally applicable while some domains such as clean environment were more dependent to context. While understanding the most appropriate quality indicators is paramount to valuable evaluation, there is little research examining strengths and weakness of different evaluation designs. A recently published post hoc evaluation of a multi-country study on adolescent health provides pointers on good practice in designing and executing studies and evaluations [16]. More attention is needed on the strengths and weakness of different study and evaluation designs on AFHS.

Limitations

The variety of ways in which evaluations and studies are published and disseminated, ranging from peer-reviewed journals to NGO reports may have limited our ability to access all existing reports. We included only publicly available reports and peer-reviewed journal articles, which may have further limited our access to evaluation reports that have not yet been placed in public domain or may be currently in progress. Further, a publication bias for positive results may have influenced the findings of our review, although our search included reports published outside of the peer-review process. Because the evaluations ranged from brief reports to full evaluation summaries, it is possible that only select findings have been made publicly availably but more thorough evaluation data exists. Furthermore, only few publications provided copies of uniquely developed assessment tools for application in other settings. This presents challenges in comparing evaluation findings across states and also suggests the potential benefit of disseminating validated tools for shared use.

Conclusions

Evaluations and studies of AFHS initiatives in India are being performed and disseminated. The strengths of these evaluations include clearly stated objectives, frequent use of multiple data sources, and assessment of programmatic outputs as well as health outcomes and impacts. We observed significant variability across study designs in these evaluations, and the target populations and comparison groups were inconsistently defined. Our findings demonstrate that AFHS initiatives have demonstrated improvements in healthcare quality and utilization by adolescents, increased SRH knowledge, and in some settings, improved sexual health behaviours such as condom and contraception use.

India’s new Adolescent Health Programme – Rashtriya Kishor Swasthya Karyakram aims to broaden strategies for community-based health promotion and to strengthen preventive, diagnostic, and curative services for adolescents across levels of health facilities [17]. This programme highlights the importance of strong monitoring and evaluation systems, thus it is vital to build upon current knowledge of best evaluation practices in order to ensure the greatest impact to adolescent populations in India and worldwide.

Abbreviations

AFHS:

Adolescent friendly health services

CEDPA:

The center for development and population activities

CORT:

Centre for operational research and training

MeSH:

Medical subject heading

NGO:

Non-governmental organizations

RSH:

Reproductive and sexual health

WHO:

World health organization

References

  1. National Rural Health Mission. Implementation guide on RCH II adolescent reproductive sexual health strategy for state and district programme managers [Internet]. 2006. Available from: http://www.searo.who.int/entity/child_adolescent/topics/adolescent_health/rch_asrh_india.pdf

  2. Government of India. National Health Mission, Ministry of Health & Family Welfare [Internet]. Available from: http://nrhm.gov.in

  3. Jejeebhoy S, Santhya K. Sexual and reproductive health of young people in India: A review of policies, laws and programmes. New Delhi. 2011.

    Google Scholar 

  4. Uttekar B, Kanchan L, Sandhya B. Sexual and Reproductive Health and Unmet Needs of Family Planning Among Young People in India: A Review Paper. Vadodara. 2012.

    Google Scholar 

  5. Government of India/Ministry of Health and Family Welfare. National Health Mission Components, RMNCH + A, Adolescent Health:Background [Internet]. Available from: http://nrhm.gov.in/nrhm-components/rmnch-a/adolescent-health/adolescent-health/background.html

  6. World Health Organization. Adolescent Friendly Health Services — An Agenda for Change. 2002.

    Google Scholar 

  7. Patton M. Utilization-focused evaluation: The new century text, 1997. Sage, Thousand Oaks, CA [Internet]. 1997;0:431. Available from: http://scholar.google.com/scholar?hl=en&btnG=Search&q=intitle:Utilization-Focused+Evaluation:+The+New+Century+Text#0

  8. Lohr KN, Steinwachs DM. Health Services Research: An Evolving Definition of the Field. Heal Serv Res. 2002;37(1):15–7.

    Article  Google Scholar 

  9. Moher D, Liberati A, Tetzlaff JAD. PRISMA 2009 Flow Diagram. The PRISMA statement. 2009. p. p. 1000097.

    Google Scholar 

  10. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015 statement. Syst Rev [Internet]. 2015;4(1):1. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=4320440&tool=pmcentrez&rendertype=abstract

  11. Ogrinc G, Davies L, Goodman D, Batalden P, Davidoff F, Stevens D. Squire 2.0 (standards for quality improvement reporting excellence): Revised publication guidelines from a detailed consensus process. Am J Crit Care. 2015;24(6):466–73.

    Article  PubMed  Google Scholar 

  12. Ogrinc G, Mooney SE, Estrada C, Foster T, Goldmann D, Hall LW, et al. The SQUIRE (Standards for QUality Improvement Reporting Excellence) guidelines for quality improvement reporting: explanation and elaboration. Qual Saf Health Care. 2008;17(1):i13–32.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Davidoff F, Batalden P, Stevens D, Ogrinc G, Mooney S. Publication guidelines for quality improvement studies in health care: Evolution of the SQUIRE project. J Gen Intern Med. 2008;23:2125–30.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Denno DM, Hoopes AJ, Chandra-Mouli V. Effective Strategies to Provide Adolescent Sexual and Reproductive Health Services and to Increase Demand and Community Support. J Adolesc Heal.

  15. World Health Organization. Quality assessment guidebook: A guide to assessing health services for adolescent clients. 2009.

    Google Scholar 

  16. Ivanova O, Pozo KC, Segura ZE, Vega B, Chandra-Mouli V, Hindin MJ, et al. Lessons learnt from the CERCA Project, a multicomponent intervention to promote adolescent sexual and reproductive health in three Latin America countries: a qualitative post-hoc evaluation. Eval Program Plann [Internet]. Elsevier Ltd; 2016;58:98–105. Available from: http://dx.doi.org/10.1016/j.evalprogplan.2016.06.007

  17. Rashtriya Kishor Swasthya Kayrakram. Strategy Handbook. New Delhi. 2014.

    Google Scholar 

  18. Nanda A, Mehrotra F, Verma R, Nanda P, & Masilamani R. Evaluation Report of UNFPA India Country Programme-7 UNFPA Country Office, India Evaluation Team. 2011

  19. Andrew G, Patel V, & Ramakrishna J. Sex, studies or strife? What to integrate in adolescent health services. Reproductive Health Matters. 2003. (http://doi.org/10.1016/S0968-8080(03)02167-0)

  20. Biswas R. An overview of multicentric training workshops for public health professionals on reproductive and child health programme in India. Indian J Public Health. 2002;46(3):78–85.

    CAS  PubMed  Google Scholar 

  21. Calhoun LM, Speizer IS, Rimal R, Sripad P, Chatterjee N, Achyut P, Nanda P. Provider imposed restrictions to clients’ access to family planning in urban Uttar Pradesh, India: a mixed methods study. BMC Health Serv Res. 2013;13:532 (http://doi.org/10.1186/1472-6963-13-532).

    Article  PubMed  PubMed Central  Google Scholar 

  22. Char A, Saavala M, Kulmala T. Assessing young unmarried men’s access to reproductive health information and services in rural India. BMC Public Health. 2011;11(1):476. http://doi.org/10.1186/1471-2458-11-476.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Char A, Saavala M, Kulmala T. Influence of mothers-in-law on young couples’ family planning decisions in rural India. Reprod Health Matters. 2010;18(35):154–62. http://doi.org/10.1016/S0968-8080(10)35497-8.

    Article  PubMed  Google Scholar 

  24. Collumbien M, Mishra M, Blackmore C. Youth-friendly services in two rural districts of West Bengal and Jharkhand, India: Definite progress, a long way to go. Reprod Health Matters. 2011;19:174–83. http://doi.org/10.1016/S0968-8080(11)37557-X.

    Article  PubMed  Google Scholar 

  25. Das D. Morbidity and treatment seeking behavior among adolescent girls in a rural area of North 24 Parganas district, West Bengal. Indian J Public Health. 2006;50(4):242–3.

    PubMed  Google Scholar 

  26. De Souza R. A Qualitative Study of Roles Performed by Peer Workers in the Context of HIV in India. J Assoc Nurs AIDS Care. 2014;25:176–87. http://doi.org/10.1016/j.jana.2013.01.004.

    Article  Google Scholar 

  27. Dongre AR, Deshmukh PR, Garg BS. Health-promoting school initiative in Ashram schools of Wardha district. Natl Med J India. 2011;24(3):140–3. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/21786841.

    PubMed  Google Scholar 

  28. Hazarika I. Women’s reproductive health in slum populations in India: evidence from NFHS-3. J Urban Health. 2010;87(2):264–77. http://doi.org/10.1007/s11524-009-9421-0.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Kotecha PV, Patel SV, Mazumdar VS, Baxi RK, Misra S, Diwanji M, Shringarpure K. Reproductive health awareness among urban school going adolescents in Vadodara city. Indian J Psychiatry. 2012;54(4):344–8. http://doi.org/10.4103/0019-5545.104821.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Mishra SK, Mukhopadhyay S. Socioeconomic correlates of reproductive morbidity among adolescent girls in Sikkim, India. Asia-Pac J Public Health. 2012;24(1):136–50. http://doi.org/10.1177/1010539510375842.

    Article  PubMed  Google Scholar 

  31. Nair MKC, Leena ML, Thankachi Y, George B, Russell PSS. ARSH 1: Reproductive and Sexual Health Problems of Adolescents and Young Adults: A Cross Sectional Community Survey on Knowledge, Attitude and Practice. Indian J Pediatr. 2013;80 Suppl 2:192. http://doi.org/10.1007/s12098-013-1136-2.

    Article  Google Scholar 

  32. Nair MKC, Leena ML, George B, Thankachi Y, Russell PSS. ARSH 5: Reproductive Health Needs Assessment of Adolescents and Young People (15-24 y): A Qualitative Study on “Perceptions of Community Stakeholders.”. Indian J Pediatr. 2013;80 Suppl 2:214. http://doi.org/10.1007/s12098-013-1141-5.

    Article  Google Scholar 

  33. Nair MKC, Leena ML, George B, Thankachi Y, Russell PSS. ARSH 6: Reproductive Health Needs Assessment of Adolescents and Young People (15-24 y): A Qualitative Study on “Perceptions of Program Managers and Health Providers.”. Indian J Pediatr. 2013;80 Suppl 2:222. http://doi.org/10.1007/s12098-013-1149-x.

    Article  Google Scholar 

  34. Nair MKC, Leena ML, Paul MK, Vijayan Pillai H, Babu G, Russell PS, Thankachi Y. Attitude of parents and teachers towards adolescent reproductive and sexual health education. Indian J Pediatrics. 2012;79 Suppl 1:60. http://doi.org/10.1007/s12098-011-0436-7.

    Article  Google Scholar 

  35. Nath A, Garg S. Adolescent friendly health services in India: A need of the hour. Indian J Med Sci. 2008;62:465–72. http://doi.org/10.4103/0019-5359.48461.

    Article  PubMed  Google Scholar 

  36. Rao RSP, Lena A, Nair NS, Kamath V, Kamath A. Effectiveness of reproductive health education among rural adolescent girls: a school based intervention study in Udupi Taluk, Karnataka. Indian J Med Sci. 2008;62:439–43. http://doi.org/10.4103/0019-5359.48455.

    Article  CAS  PubMed  Google Scholar 

  37. Sabarwal S, Santhya KG. Treatment-seeking for symptoms of reproductive tract infections among young women in India. Int Perspect Sex Reprod Health. 2012;38(2):90–8. http://doi.org/10.1363/3809012.

    Article  PubMed  Google Scholar 

  38. Shah SP, Nair R, Shah PP, Modi DK, Desai SA, Desai L. Improving quality of life with new menstrual hygiene practices among adolescent tribal girls in rural Gujarat, India. Reprod Health Matters. 2013;21(41):205–13. http://doi.org/10.1016/S0968-8080(13)41691-9.

    Article  PubMed  Google Scholar 

  39. Sharma KD, Chavan YB, Khismatrao DS, Aras RY. Male health clinic strategy in control of STI/HIV: A program review. Indian J Public Health. 2012;56:238–41.

    Article  PubMed  Google Scholar 

  40. Singh L, Rai RK, Singh PK. Assessing the utilization of maternal and child health care among married adolescent women: evidence from India. J Biosoc Sci. 2012;44(1):1–26. http://doi.org/10.1017/S0021932011000472.

    Article  PubMed  Google Scholar 

  41. Speizer IS, Nanda P, Achyut P, Pillai G, Guilkey DK. Family planning use among urban poor women from six cities of Uttar Pradesh, India. J Urban Health. 2012;89(4):639–58. http://doi.org/10.1007/s11524-011-9667-1.

    Article  PubMed  PubMed Central  Google Scholar 

  42. The Centre for Development and Population Activities (CEDPA). Adolescent Girls in India Choose a Better Future : An Impact Assessment. Washington, DC. 2001. http://genderlinks.org.za/wp-content/uploads/imported/articles/attachments/13177_file_blp_report.pdf Accessed 21 Dec 2016.

  43. Mishra A, Levitt-Dayal M, & The Centre for Development and Population Activities (CEDPA). Improving Adolescent Reproductive Health Knowledge and Outcomes through NGO Youth-Friendly Services. Washington, DC. 2003.

  44. Society for Women and Children’s Health and Government of India, Ministry of Health and Family Welfare. Coverage Survey on Adolescent Friendly Health Services in a District in Haryana. 2008.

    Google Scholar 

  45. Government of India, Ministry of Health and Family Welfare. Status of Adolescent Friendly Health Services in Haryana. 2008.

    Google Scholar 

  46. Centre for Operations Research and Training. Assessment of Adolescent Reproductive and Sexual Health (ARSH) Centers in Gujarat: A Report. Vadodara, India. 2008. http://www.cortindia.in/RP%5CRP-2008-01.pdf Accessed 21 Dec 2016

  47. Government of India, Ministry of Health and Family Welfare. Status of Adolescent Friendly Health Services in Karjat Block, Maharashtra. 2009.

    Google Scholar 

  48. Institute of Health Management Research. Assessment of Adolescent Friendly Health Clinics in Rajasthan. Jaipur, India. 2010.

  49. Programme Evaluation Organisation Planning Commission. Evaluation Study on National Rural Health Mission (NRHM) in Seven States: Volume II. New Delhi. 2011.

  50. Pathfinder International. PRACHAR: Promoting Change In Reproductive Behavior In Bihar, India. 2011.

    Google Scholar 

  51. Bulliyya G, Kerketta AS. Assessment of adolescent reproductive and sexual health programme in Orissa: advocacy for intervention strategies. 2012.

    Google Scholar 

  52. Futures Group. Promoting adolescent reproductive health in Uttarakhand and Uttar Pradesh, India. 2012. Retrieved from http://pdf.usaid.gov/pdf_docs/pnadz546.pdf Accessed December 21, 2016

  53. Mehra S, Sogarwal R, Nair V, Satpati M, Tiwari R, Dwivedi K. Determinants of Youth Friendly Services Influencing Client Satisfaction: A Study of Client’s Perspectives in India. Indian J Public Health Res Dev. 2013;4(2):221 (http://doi.org/10.5958/j.0976-5506.4.2.047).

    Article  Google Scholar 

  54. Mehra S, Sogarwal R, Chandra M. Integrating adolescent-friendly health services into the public health system: an experience from rural India. WHO South-East Asia J Public Health. 2013;2(1):6 (http://doi.org/10.4103/2224-3151.115828).

    Google Scholar 

  55. National Institute for Research in Reproductive Health (Indian Council of Medical Research). Quality Assessment of Adolescent Reproductive and Sexual Health (ARSH) Services as per the National Standards of ARSH Implementation Guide in Karjat Block of Raigad District in Maharashtra, India. 2014.

    Google Scholar 

  56. National Institute for Research in Reproductive Health (Indian Council of Medical Research). Establishing, Operating, Strengthening and Sustaining the Adolescent Reproductive and Sexual Health (ARSH) Services in Karjat Block of Raigad District in Maharashtra, India. 2014.

    Google Scholar 

  57. Jejeebhoy SJ, Santhya KG, Singh SK, et al. Provision of Adolescent Reproductive and Sexual Health Services in India: Provider Perspectives. New Delhi: Population Council; 2014. Retrieved from http://www.popcouncil.org/uploads/pdfs/2014PGY_ARSH-IndiaProviderReport.pdf. Accessed December 21, 2016.

    Google Scholar 

  58. Sharma P, Ingle G, Kamra S, & Agarwal P. A Study of Gaps in Reproductive Health Services for Adolescents in Delhi. New Delhi. 2014.

  59. International Center for Research on Women. Improving the Reproductive Health of Married and Unmarried Youth in India: Reproductive and Sexual Health Education, Care and Counseling for Married Adolescents in Rural Maharashtra, India. 2006. Retrieved from http://www.icrw.org/files/images/Reproductive-and-Sexual-Health-Education-Care-and-Counseling-for-Married-Adolescents-in -Rural-Maharashtra-India.pdf

  60. Joshi BN, Chauhan SL, Donde UM, Tryambake VH, Gaikwad NS, Bhadoria V. Reproductive health problems and help seeking behavior among adolescents in urban India. Indian J Pediatr. 2006;73(6):509–13. Retrieved from (http://www.ncbi.nlm.nih.-gov/pubmed/16816513).

    Article  PubMed  Google Scholar 

  61. International Center for Research on Women. Improving the Reproductive Health of Married and Unmarried Youth in India: Social Mobilization or Government Services: What Influences Married Adolescents’ Reproductive Health in Rural Maharashtra, India? 2006. Retrieved from http://www.icrw.org/files/images/Social-Mobilization-or-Government-Services-What-Influences-Married-Adolescents-Reproductive-Health-in-Rural-Maharashtra-India.pdf

  62. Society for Women and Children’s Health and Government of India, Ministry of Health and Family Welfare. Coverage Survey on Adolescent Friendly Health Services in a District in Haryana. 2008.

    Google Scholar 

  63. Daniel EE, Masilamani R, Rahman M. The effect of community-based reproductive health communication interventions on contraceptive use among young married couples in Bihar, India. Int Fam Plan Perspect. 2008;34(4):189–97 (http://doi.org/10.1363/ifpp.34.189.08).

    Article  PubMed  Google Scholar 

  64. Yadav RJ, Mehta R, Pandey A, Adhikari T. Evaluation of Adolescent-Friendly Health Services in India. Health Popul Perspect Issues. 2009;32(2):66–72.

    Google Scholar 

  65. Chauhan S, Joshi B, Bandiwadekar A, Barathe U, Tryambake V, Gaikwad N. (n.d.). (2010) Scaling-up adolescent friendly health services within public sector in Mumbai, India.

  66. Rahman M, & Daniel EE. A Reproductive Health Communication Model That Helps Improve Young Women’s Reproductive Life and Reduce Population Growth: The Case of PRACHAR from Bihar, India. 2010. Retrieved from http://hivhealthclearinghouse.unesco.org/sites/default/files/resources/bie_prachar_impact_-_pathfinder_wp_jan_2010.pdf Accessed December 21, 2016.

  67. PRAGYA: Multisectoral, Gendered Approach to Improve Family Planning and Sexual and Reproductive Health for Young People: A Research Study, (December). Retrieved from http://www.pathfinder.org/wp-content/uploads/2016/10/PRAGYA-Multisectoral-Gendered-Approach-to-Improve-FP-and-SRH-for-Young-People.pdf Accessed December 21, 2016.

  68. Chauhan SR, Dalal AP, & Shukla AA. Interventional study to strengthen the 'Adolescent Friendly Health Services' in anganwadis of Ahmedabad Municipal. 2012;3(4):617–622.

  69. Daniel EE, & Nanda R. The Effective of Reproductive Health Communication Interventions on Age at Marriage and First Birth in Rural Bihar, India: A retrospective study. 2012. http://www2.pathfinder.org/site/DocServer/AOM_paper_-_full_paper_with_covers.pdf?docID=19841 Accessed 21 Dec 2016

  70. Mehra S, Sogarwal R, Chandra M. Integrating adolescent-friendly health services into the public health system: an experience from rural India. WHO South-East Asia J Public Health. 2013;2(1):6 (http://doi.org/10.4103/2224-3151.115828).

    Google Scholar 

Download references

Acknowledgements

None

Funding

Authors received no financial support from any organization for the submitted work. Dr. Hoopes’ training was supported by a National Research Service Award T32 MH 20021–16 for Psychiatry and Primary Care as well as a Leadership Education in Adolescent Health (LEAH) training grant. Her internship period at WHO was supported by grants from University of Washington’s Center for AIDS Research (CFAR) and Global Center for the Integrated Care of Women, Adolescents, and Children (Global WACh) as well as the American Academy of Pediatrics International Elective Award and Corkery Family Fellowship Travel Award.

Availability of data and material

Please contact corresponding author for data requests beyond what is available in tables and appendix.

Authors’ contributions

AH conducted data collection, carried out analysis, drafted the initial manuscript, and approved the final manuscript as submitted. PA conducted data collection, carried out the analysis, reviewed and revised the manuscript, and approved the final manuscript as submitted. SB provided input on study methodology, reviewed and revised the manuscript, and approved the final manuscript as submitted. VCM conceptualized and designed the study, supervised the analysis, reviewed and revised the manuscript, and approved the final manuscript as submitted.

Authors’ information

No additional information.

Competing interests

All authors declare that they have: received no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous 3 years; no other relationships or activities that could appear to have influenced the submitted work.

Consent for publication

All authors have approved this final version of the manuscript.

Ethics approval and consent to participate

Not applicable as manuscript does not report on or involve use of any individual animal or human data or tissue.

Author information

Authors and Affiliations

  1. Department of Pediatrics, University of Colorado School of Medicine, 13123 East 16th Avenue, Box B025, Aurora, CO, USA

    Andrea J. Hoopes

  2. Department of Community Medicine, Maulana Azad Medical College, New Delhi, India

    Paras Agarwal

  3. Department of Community and Behavioral Health, Colorado School of Public Health, 13001 E. 17th Place, B119, Bldg 500, Room, E3345A, Aurora, USA

    Sheana Bull

  4. Anschutz Medical Campus, Aurora, CO, 80045, USA

    Sheana Bull

  5. Division of Reproductive Health and Research, World Health Organization, Avenue Appia 20, 1211, Geneva 27, Switzerland

    Venkatraman Chandra-Mouli

Authors
  1. Andrea J. Hoopes
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Paras Agarwal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sheana Bull
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Venkatraman Chandra-Mouli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrea J. Hoopes.

Additional information

The original version of this article was revised; tables 1–4 and references 17–69 were incorrectly published in Additional File 1 and have now been moved to the main text.

An erratum to this article is available at http://dx.doi.org/10.1186/s12978-016-0267-0.

Appendices

Appendix 1

Medline search strategy

We chose to begin our search in 2000 because the International Conference on Population and Development +5 review (1999) reiterated the importance of enabling adolescents to obtain the health services they need and renewed attention and support for action in this area [18].

Searched 21/7/14: PubMed 152 Results

((“adolescent health services”[major] OR “adolescent health services”[tw] OR ((“adolescent-friendly”[tiab] OR “adolescent friendly”[tiab] OR “youth friendly”[tiab] OR “youth-friendly"[tiab]) AND ("healthcare services"[tiab] OR "health care"[tiab] OR "health services"[tiab] OR health services[mesh] OR preventive health services[mesh] OR "preventive health services"[tw])) OR school health services[mesh] OR "school health services"[tw]) OR ("reproductive health services"[major] OR "reproductive health services"[tiab] OR "sexual health services"[tiab] OR "reproductive and sexual health services"[tiab] OR "sexual and reproductive health services"[tiab] OR "sexual reproductive health services"[tiab] OR "reproductive sexual health services"[tiab])) AND ("India"[mesh] OR "India"[tiab] OR "India"[ot]) AND ("young adult"[mesh] OR "adolescent"[mesh] OR "minors"[mesh] OR adolescen*[tiab] OR teen*[tiab] OR juvenile[tiab] OR preteen*[tiab] OR pre-teen*[tiab] OR youth[tiab]) AND ("2000/01/01"[PDAT] : "3000/12/31"[PDAT]) AND ("adolescent"[MeSH Terms] OR "young adult"[MeSH Terms]) AND English[lang]

Appendix 2

EMBASE search strategy

21/7/14: EMBASE 9 results

'adolescent friendly' OR 'youth friendly' AND ('health service'/exp OR 'health service' OR 'reproductive health'/exp OR 'reproductive health' OR 'evaluation'/exp OR 'evaluation') AND ('india'/exp OR 'india') AND [2000-2014]/py AND [embase]/lim NOT [medline]/lim

Appendix 3

figure a

Appendix 4

Peer-reviewed publications that were reviewed in full-text and excluded

Table 7 Peer-reviewed publications that were reviewed in full-text and excluded
Full size table

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hoopes, A.J., Agarwal, P., Bull, S. et al. Measuring adolescent friendly health services in India: A scoping review of evaluations. Reprod Health 13, 137 (2016). https://doi.org/10.1186/s12978-016-0251-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12978-016-0251-8

Keywords

Reproductive Health

ISSN: 1742-4755