Evaluation Statement of Work – Yemen

logo solidarités international 

SI in Yemen

Background and Project Description

Solidarités International (SI) has been present in (South) Yemen since 2017 responding to the protracted emergency crisis in Yemen, implementing WaSH, Food Security & livelihoods (FSL) and emergency shelter. Supported by the country office in Aden, it operates through two bases on the South of the frontline, Al Turbah and Al Mokha (Taizz Governorate), and a roving emergency response unit based in Aden and reaching out to needy spots in South Yemen as dictated by needs and access factors. In 2020, SI’s projects targeted more than 110,000 individuals (IDPs, Returnees and Host communities) and provided them with improved access to water, hygiene promotion, Sanitation, WaSH-in-health services. SI also promotes FSL activities such as food assistance through cash distribution, agricultural recovery, and Non-Food Item distribution integrated in WaSH interventions. All SI programs in Yemen cross cut Gender, Age and Diversity (GAD), protection and Emergency preparedness and Response (EPR).

The Emergency lifesaving WaSH, Shelter and Multi-purpose cash assistance to populations affected by conflict or any sudden shock in South Yemen was awarded (n°ECHO/YEM/BUD/2020/91003) to Solidarités International in April 2020, with a period of performance from May 2020 until May 2021. In November 2020, SI was granted a top-up for an introduction of a new result: Multi-purpose cash assistance. The project covers 4 sectors of intervention: Water, Sanitation and Hygiene (WaSH), WaSH in Health (AWD/Cholera focus), Shelter (emergency Shelter and Shelter NFI distribution) and Multipurpose cash assistance (MPCA) implemented in Mawza and Waziyah districts, Taizz Governorate, Khowkhah and Tuhayta Districts, in Hudaydah Governorate, and Dhale and Azreeq districts in Dhale Governorate. SI responds to the needs of shock and conflict affected populations (cholera outbreaks, natural disasters, new displacements, etc.) and vulnerable people with protracted needs. Under this project, 21,000 individuals will benefit from WaSH services, 14,000 from the cholera/AWD preparedness and response strategy located in 4 health facilities, 880 HH will receive Enhanced Emergency Shelter Kits and Shelter NFIs and 700 households will receive 3 rounds of Multi-purpose cash assistance.

Activities implemented so far

At the end of February 28th 2021, project activities are well on track with the plans and expected to be delivered by the end of April 2021. By February 2021, SI has constructed 300 and rehabilitated 24 sanitation facilities benefiting 471 HHs providing access to dignified, safe, clean and functional excreta disposal and bathing facilities in 14 IDPs sites in Mawza district, Taizz Governorate and At Tuhayta district Hudaydah Governorate. SI has also been providing water for 421 HHs, through water trucking for four months (from November 2020 till February 2021) in 4 IDP sites in Mawza’a district, Taizz Governorate. This activity is paired up with a strong exit strategy which includes a) rehabilitation of wells complete with retrofitting with solar pumping systems  and small pipe reticulation systems to bring water closer to dwelling sites. In total 12 water points (11 in Mawza district and 1 in At Tuhayta district) will be rehabilitated/maintained benefiting to 2094 HHs (to be completed in March and April). Where water source is not available, SI will do a handover of the assisted caseload to another actor to continue the support. Furthermore, solid waste cleaning campaigns have been conducted in 3 sites in Mawza district benefiting to 1771 HHs. SI distributed hygiene kits for 1243 HHs, which was accompanied with awareness sessions on the key HP messages for all targeted beneficiaries. In partnership with Humanity and Inclusion (HI), 4076 HHs received COVID-19 kits provided by HI and distributed by SI, which included COVID-19 awareness campaigns conducted by SI Hygiene Promotion Team.

Under Result 2, SI has been targeting health facilities in AWD/Cholera priority areas with the rehabilitation of WASH facilities and provision of Cholera preparedness kits. At the end of February, rehabilitation works were ongoing in Al Dhale and Al Tuhayta, where SI also prepositioned 400 Cholera preparedness kits.

Under Result 3 – Shelter, SI will distribute 880 Emergency Shelter and Shelter NFI kits, out of which 479 have already been already been distributed to 479 HH in Mawza district, Taizz Governorate and in Khawkhah and Tuhayta districts, Hudaydah Governorate, by the end of February.

Finally, under the new result 4, SI distributions of MPCA were well on the way in Waziyah district of Taizz Governorate. By end of February, SI has distributed 2 rounds of cash to 650 HH, and 1 round of cash to 50 HH. Total caseload to be assisted with a three-month MPC support is 700 HH.

Evaluation Plan

An external final evaluation is budgeted under the project covering:

  • WASH evaluation will focus on the emergency WASH component of the project, to assess the appropriateness, effectiveness and efficiency of SI’s WASH response for the most vulnerable people in South Yemen in a timely, cost-efficient, culturally sensitive and integrated manner, with the goal of identifying best practices and lessons learned for potential replication and scale-up.
  • MPCA evaluation will focus on the appropriateness and effectiveness of MPC assistance in reducing food insecurity of the most vulnerable HH. The outputs of the evaluation will be used to reflect on and improve planning of MPC activities and targeting of beneficiaries.

The evaluation will use a mixed approach with qualitative and quantitative data. It will allow SI to measure clearly the benefits of the program and understand how the chosen activities affected the target population. 

Emergency WASH and MPCA Response Evaluation – Scope of Work

 

Evaluation purpose

SI will carry out a final evaluation on the emergency WASH and MPC assistance activity component in its specific areas of intervention. The main goal is to assess the appropriateness, effectiveness, and efficiency of the emergency WASH and MPCA response. The replication and scale-up of best practices elsewhere in Yemen, potential linkages with existing rapid response schemes will also be considered.

 Evaluation Type and Methodology

The evaluation will be a final evaluation with the primary focus to assess the appropriateness of SI emergency response. A specific focus will be put on analyzing the response in hard-to-reach area, and whether the modalities selected were appropriate as well as effective and efficient as compared to alternative interventions (in kind or vouchers as opposed to MPCA, emergency WASH as opposed to early recovery WASH or vice versa).

SI usually uses mixed methods for its evaluations. However, the methodology will be left at the evaluator discretion during the selection process (the methodology will be proposed by the applicants and will be part of the selection criteria).

SI expects a participative methodology where the preparation phase is done in consultation with SI in order to tackle the specific needs as identified by the implementation teams, including a validation of the methodology upon reception of the inception report (cf. expected deliverables). The tools to be used by the evaluation team will be designed based on the methodology agreed upon. SI will then support but not interfere in the data collection, analysis and recommendations writing.

 Evaluation questions

The evaluation will focus on the three questions below:

 To what extent were the implemented WASH interventions relevant for increasing access to safe water, sanitation and awareness of safe hygiene practices of the beneficiaries?

  • This should examine the appropriateness of the action in terms of SI’s ability to target and access the most vulnerable persons, and whether or not the target population utilized the services and materials offered for the intended purpose.

 To what extent did the project cover the needs in relation to safe water, sanitation and awareness of safe hygiene practices, and hence contributed towards a decrease in the vulnerability of the target population to WASH related diseases?

  •  This should examine the impact of SI’s activities.

 How successful and sustainable is the exit strategy and handing-over process of water supply facilities and services?

This should examine the viability of interventions: will the owners (private well owners for solarized rural water community schemes, Local Water Authorities for public water schemes and coordination mechanisms) be able to sustain O&M of the facilities beyond the active project phase?

 To what extent did MPCA cover and respond to the food security needs of targeted populations?

  • This should include an examination of the appropriateness of MPCA to reduce food insecurity of HHs, the adequacy of the amount (particularly in relation to cash for food) and duration of the cash distributions and the efficiency of MPCA in terms of value for money as compared to in-kind distribution in Yemen.

Expected deliverables

SI expects the delivery of:

  • An inception report revising the methodology, taking into account secondary data review and discussions between the evaluation team and SI program coordination in Yemen
  • A comprehensive evaluation report, detailing:
    • Executive Summary
    • Methodology used (including tools and sampling methods if necessary)
    • Analysis
    • Lessons Learned
    • Recommendations for improvement (for short-term to mid and long term interventions). The recommendations should analyze and compare the affordability and environmental suitability of the WASH solutions selected and installed.[1]
    • Table of recommendations (for short-term to mid and long term interventions)
  • A presentation of main findings at country and/or HQ level in the form of a recorded webinar (recording of the webinar and PPT format to be provided following the presentation)

Evaluation timeframe and budget

  • ToRs diffusion: March 30th – April 13th 2021
  • Selection of evaluator: April 14th – April 21st 2021
  • Contract signature: Last week of April 2021
  • Methodology validation: 2-11th May 2021
  • Evaluation: May 17th – June 1st – June 17th 2021
  • Field Debriefing workshop[2]: 20th June 2021
  • Final Evaluation report: 15th July 2021[3]

The evaluation will be conducted after the project completion date.

The budget will be proposed by the consultant as part of the financial offer. A detailed budget should be provided indicating: accommodation and transportation fees. All other associated costs (insurance, passport and visa fees, vaccination) should be covered within the consultancy fees.

 Evaluator profile and expertise

  • Training and qualifications:
    • Advanced university degree in one of the following disciplines relevant to the following areas: Social Science, Political Sciences, Statistics, or related field (mandatory for lead evaluator)
  • General professional experience:
    • At least 7 years’ professional work experience in humanitarian intervention, including significant field experience, in international humanitarian organizations, especially in emergency context with emergency WASH and food security/MPCA intervention. (mandatory for lead evaluator/evaluation team)
    • Minimum of 3-5 years of experience in conducting studies, collecting data and producing quality baseline/midterm/end line study reports, preferably for international non-governmental organizations or multilateral agencies (mandatory for lead evaluator)
    • The bulk of the project comprises WASH interventions, hence at least one member of the team should be an experienced WASH professional – Civil Engineer with degree or practice specialization in water supply engineering, or a Water/Hydraulics Engineer with solid hardware experience.
  • Specific professional experience:
    • Experience in emergency projects,
    • Experience in emergency water supply, sanitation, hygiene promotion
    • Experience in cash and voucher assistance
    • Experience working in the conflict or post-conflict environments (preferred, not mandatory)
    • Experience working in Yemen (preferred, not mandatory) and Middle East (mandatory)
  • Languages:
    • Excellent spoken and written communication skills in English (mandatory) and Arabic (mandatory)
  • Other:
    • Evidence of similar work in the recent past (mandatory)
    • At least one field team member must be a woman and one field team member must be a man (mandatory)

Application:

Interested candidates should submit:

  1. A technical offer including:
    • An understanding of the issues at stake of the evaluation and the Terms of Reference (ToR): development of problems and formulation of questions which the offer will aim to answer
    • Methodology and proposed tools
    • The timetable showing the details for the completion of each of the evaluation phases. The proposed schedule should include time for briefing and debriefing on the mission and as much as possible at SI headquarter (or remotely).
  2. A financial offer including of a detailed budget in columns (fees, other costs)
  3. An up to date CV of the evaluator and all participants within the evaluation team (including field team)
  4. Organogram of the evaluation team structure
  5. Sample of previous work (10 to 20 pages) from at least 2 separate projects
  6. List of past experiences including description of the project evaluated, area of intervention/location and total budget
  7. At least 2 references

Solidarités International will consider individual candidates or teams equally.

The applicants must send off requested documents electronically to mvernusse@solidarites.org and dcd.prog@solidarites-yemen.org.

The deadline is 13/04/2021.

[1] For example, 1) the high capital investment cost of solar water pumping versus its low maintenance cost and less polluting effects compared to  a diesel generator pumping system; 2) the higher water demand of a pour flush latrine versus the  low maintenance cost but higher polluting risks of a pit latrines; 3) utilization of local materials and resources versus shipping in materials from outside the area; 4) capacity building and utilization of local labor versus bringing in skilled labor from outside the area, etc.

[2] This Field Debriefing will be done in the form of a webinar and the recording will be provided to the mission in order to ensure that all team members have access to this debriefing.

[3] First draft report to be sent by July 8th to be approved by the mission before the submission of the final version.