Skip to main content

Table 4 Implementation Evaluation Forms and Activities for CHARM2

From: A gender synchronized family planning intervention for married couples in rural India: study protocol for the CHARM2 cluster randomized controlled trial evaluation

Form

* form is data entered

Who completes form and when

Data management and when

Purpose of form

How are data reviewed and used

Screening, Recruitment, & Monitoring Sessions

 Recruitment and tracking log

Who: Field staff

When: Each time a couple is contacted. Additionally, updated on a quarterly basis for as long as participants stay followed up.

Who: Field staff to collect data and enter into tables. They will review the data weekly to ensure recruitment numbers are reaching their goal, and recruitment rates are acceptable. PC will compile tables from field staff team leaders into the master excel file.

When: During recruitment, weekly statistics on recruitment numbers and % of contacted couples recruited summarized. During follow-up, bi-weekly reports of contact attempts, contacts made and the current follow-up %.

To track recruitment rates, refusal rates and reasons for refusal. It will include detailed tracking information with contacts of in-laws, natal family, a neighbor on CommCare. Will also track the completion of each survey. For any loss to follow-up will track any known reason for loss to follow-up.

Reviewed by NIRRH/ PC weekly. Discussed with UCSD weekly, for recruitment numbers, and recruitment rates.

 Training protocol (for intervention)

N/A

N/A

Training protocol for providers. Includes role play and scoring on role play.

N/A

 Training evaluation for providers

Who: Providers

When: Before and after each training, and booster training.

Who: Field staff to review forms within 30 days of the training. Could be paper-based then manually entered.

Filled pre- and post each provider training. Evaluating trainee’s knowledge before and after training to assess knowledge gained and any need for specific content in booster training. Roleplay scores can also be used for assessing need for booster training. Booster training to be conducted annually.

India team to assess topic areas that training is not effectively conveying and/or areas that need booster training. Booster and additional trainings created based on findings and need.

Monitoring Intervention Quality and Delivery

 Intervention curriculum and delivery protocol

UCSD

N/A

Intervention curriculum for 3 sessions

N/A

 Session Observation/Checklist forms × 3 for each session

Note: This will only take place for 10% of participants; there should be different forms for each intervention session

Who: 10% CHARM Intervention Participants only (both male and female participants)

When: At the end of each randomly selected session

Who: Field staff will collect and give to field manager to review and process data

When: Once a month. Casefile analyzed as needed bases or at time of observation.

Quality assurance to ensure adherence to curriculum and that providers are providing the full program to participants

Reviewed by NIRRH and PC program manager, monthly; Feedback provided to Providers in monthly meetings. Entered with quantitative data; analyzed biannually; prevalence data used for funder reports

Participant and Provider Feedback on Intervention

 Participant Satisfaction Survey

Who: Research team administers satisfaction survey to participants.

When: With the 9 months, or 18 months follow up survey if not available at 9-month follow-up

Who: Field staff will collect data. The field manager will input data. Program manager will manage the data

When: Frequencies to be run by data analyst monthly to review quality and fidelity data.

Participant satisfaction with CHARM2 intervention

Discussed quarterly with UCSD. India team to discuss in their meetings.

 IDIs with couple participants (husband and wife separately)

Who: Research team administers satisfaction survey to 10% of participants who received intervention and 10% of participants who quit

When: 9 months follow up

Who: Data are translated and transcribed by the field team in India.

When: Within 2 days of interview completion.

To document participants’ perceptions of what they received in the intervention, what they learned from the provider, the quality of that learning and how that learning affected their relationship, FP and MSV.

Discussed twice a year.

UCSD will compile data and select quotes for inclusion in reports.

 IDI with providers

Who: Research team administers satisfaction survey to participants

When: Biannually, when no survey data is being collected

Who: Field research team

When: Twice a year, 6 months apart.

To document providers experiences with intervention delivery, their perceptions of how the intervention affected couples and how they continue to see these couples

Discussed twice a year.

UCSD will compile data and select quotes for inclusion in reports.

  1. Note: The field manager and the scientist overseeing the field team will maintain notes from their ongoing meetings with field staff and from observations of intervention delivery, to discuss key issues and generate plans for course correction or additional trainings as needed during the weekly to twice monthly meetings with the full scientific investigator team