Inclusive WASH in Wewak District, Papua New Guinea

Terms of Reference

About the role

We are seeking an individual consultant or small, multi-disciplinary team to complete a short-term contract leading a final project evaluation of one of our Australian Government-funded Water for Women projects in PNG.

Background

WaterAid’s vision is a world where everyone, everywhere has safe water, sanitation and hygiene.  Extreme poverty cannot be eradicated without universal access to safe water, sanitation and hygiene (WASH). These basic services are human rights: everyone on our planet needs them to live healthy, dignified and productive lives. 

Water for Women

Water for Women is the Australian Government’s flagship WASH program and is being delivered as part of Australia's aid program, investing $110.6 Million over five years from 2018 to 2022.

Water for Women is partnering with 10 Civil Society Organisations (CSOs) to deliver 18 Projects in 15 Countries in South Asia, Southeast Asia and the Pacific. Over the course of the Fund, Water for Women aims to support an estimated 2.95 million people including the most marginalised within these communities.

In PNG, WaterAid has two projects funded through Water for Women:

• Inclusive WASH in Wewak District.  The project aims to strengthen WASH sector systems to improve service delivery and gender equality outcomes.
• Consortium Project. This is a two year project delivered in partnership with Plan International and World Vision to respond to the challenges of COVID-19 using a system strengthening approach to WASH.

This evaluation focuses on the Inclusive WASH in Wewak District project.

Inclusive WASH in Wewak District Project

Inclusive WASH for Wewak District is a 5 year, AUD5.9 million project that aims to support an improvement in government-led service delivery for Wewak District, PNG, leading to more inclusive, equitable and sustainable access to water, sanitation and hygiene promotion (WASH) services. The project commenced in 2018 and will conclude in December 2022. It is implemented in partnership with local government and several local civil society organisations.  

The four end-of-project objectives are:

District WASH sector systems are strengthened and there is a sustained commitment to adequate resources for WASH services

1. WASH service levels in Wewak District have improved over time with sustainable and inclusive models for service delivery being implemented
2. Empowered women are leaders in the sector and people with disabilities have a greater voice in decision making
3. Uptake and use of scalable, effective strategies for increasing inclusive, district-wide access to WASH by government and non-government agencies

To achieve these objectives WaterAid works with partners to take a district-wide approach to the planning and provision of WASH services, working with both rural and urban service providers. The program seeks to build a solid foundation for WASH service provision, leveraging WaterAid’s expertise with sector strengthening to improve WASH coordination and to promote data-driven, equitable planning and financing of WASH services.

Purpose of the evaluation

The purpose of the evaluation is to assess and document what the project has achieved and identify what lessons can be drawn from the project to inform WaterAid’s future WASH programming.

 Within this broad purpose, we are particularly interested in:

• determining the extent to which each of the four (4) end-of-project objectives were achieved and the enablers and challenges encountered in the level of achievement
• understanding the aspects of our system strengthening and gender equity, disability and social inclusion (GEDSI) approaches that contributed to achieving the programming objective of inclusive and sustainable WaSH service delivery and how these could be further refined,
• understanding how the outcomes can be built on to support enhanced climate resilience.

The findings of the evaluation will be used by WaterAid in our final project reporting for Water for Women, and as an important reference for future project design and delivery in PNG.

Key evaluation questions

The following key questions will be reviewed and finalised with the evaluation team as part of the inception process: 

1. How well has the project responded to the needs and priorities of local actors in relation to improving access to WASH?
2. To what extent did the project design enable progress towards program objectives?
   1. Was the project doing the right things to affect change?
   2. How well has the project adapted to the changing context over time (including COVID-19) and/or responded to learning and evidence?
3. To what extent have the project objectives been achieved?
   1. What factors have supported or hindered the achievement of objectives?
   2. What other changes (intended or unintended) has the project contributed to? 
4. To what extent was the project appropriately resourced (including human and financial resources) to meet the objectives?
   1. What were the strengths of key project partnerships and what could have been improved?
5. How well were GESI considerations integrated across project implementation? Were these effective?
6. What evidence is there that the results achieved will be sustained over time?
7. What key lessons can be drawn from this project to inform WaterAid’s future WASH programming in PNG? Including in the areas of:
   1. System strengthening
   2. GESI
   3. Climate resilience
   4. Locally-led programming and influencing

Evaluation annexes

In addition to preparing the main evaluation report addressing the evaluation questions, the evaluation consultant(s) will also prepare two annexes, as outlined below.

Stories of change

The evaluation consultant will prepare five stories of change, highlighting different aspects of the project and its achievements.  These stories should be 2-3 pages in length drawing on evidence collected during the evaluation. The topics should be negotiated and agreed with WaterAid during the evaluation, but will include at least one story related to GEDSI and one related to system strengthening.

WASH system strengthening building block assessment

The evaluation consultant(s) will also complete a WASH sector building block assessment, using WaterAid’s sector building block assessment rubric (at Annex A) (Note - there will be scope to further refine this rubric with the evaluation consultant(s)). The sector building block assessment should be completed concurrently with the evaluation and submitted as an Annex to the evaluation report. This will also form a key evidence piece contributing to discussion of results around Objective 1 on system strengthening.

Methodology

The evaluation consultant(s) is encouraged to propose an appropriate methodology to respond to the evaluation questions and prepare the annexes. This will be more fully developed in a detailed evaluation plan prepared during the inception phase, which will set out how data will be collected and analysed for each evaluation question.

Context permitting, it is anticipated that the evaluation will involve a desk review of existing monitoring data and reporting, and primary data collection (online and/or face-to-face) in  PNG (Port Moresby and Wewak). The consultant should propose contingencies if travel is not considered possible due to COVID or security concerns.

Existing data sources

A range of existing data sources will be available for the evaluation team to analyse as part of the evaluation. This should be taken into consideration when proposing the methodology:

• Project design document
• Baseline data, including:
  • Sector strengthening building block analysis - Wewak (Sep 2018)
  • Wewak district urban WASH baseline report 2019
  • WASH coverage snapshot reports for each rural LLG in Wewak
  • GEDSI in WASH baseline report
• Mid-term review
• Annual reports
• Healthy Islands review (anticipated to be completed end of July 2022)
• Partner capacity assessment
• Quantitative endline data on WASH coverage in Wewak district

Roles and Responsibilities

WaterAid Australia’s Head of Learning and Evidence and WaterAid Papua New Guinea’s Country Director – Programs will jointly coordinate the review, with support from relevant technical leads and specialists.  WaterAid will provide support throughout the process and sign-off on the final report. 

Deliverables and timelines:

We expect to appoint the consultant(s) by mid-late June, with the evaluation commencing in July and being completed by mid-November 2020.

Deliverable	Indicative timeframe
Evaluation Plan	15 July 2022
Draft evaluation report (inc. annexes)	15 October 2022
Validation workshop	End October 2022
Final report	15 November 2022

 

The final report must clearly set out the methodology, limitations, findings against each evaluation question and conclusions. 

Resourcing

The budget for this review is up to AUD $50,000 (inclusive of GST and reimbursable expenses). 

Evaluation team qualifications:

We seek an individual or small, multi-disciplinary team for this assignment who would bring specific experience with and knowledge of:

• Evaluation – particularly methods for qualitative data collection, analysis and interpretation
• Theory of change and adaptive management – particularly supporting organisations to apply the concepts in development programming
• Understanding of the PNG WASH context and enabling environment for WASH
• Gender equality and social inclusion – particularly as it relates to transforming systemic and cultural norms

Request for Proposals

Interested consultants are requested to submit a proposal with the following:

1. An EOI of up to five pages including:
   1. statement of the expertise you or your team will bring to this evaluation
   2. description of the proposed approach and methodology for the evaluation, including an indicative workplan.
2. CV for each proposed evaluation team member
3. Financial proposal with daily rates for team members (inclusive of GST) and anticipated reimbursable expenses
4. Please provide 2-3 executive summaries from recent evaluation reports written by the lead evaluator(s).

The deadline for submitting Expressions of Interest is 9am AEST Tuesday 14 June 2022. When submitting EOIs, please include reference to Water for Women PNG Final Evaluation in your email subject title.  Submissions should be made to WaterAid Australia via [email protected].  Please note that only shortlisted applicants will be contacted.

If you have any questions regarding this evaluation please contact Clare Hanley, Head of Learning and Evidence, WaterAid Australia at [email protected]

 

WaterAid is a child safe organisation. We recognise that we must meet community expectations and the trust placed in our personnel to maintain the highest standards of conduct with children. Therefore, all positions within WaterAid are required to comply with our Child Safeguarding Policy and Code of Conduct.

Annex A: System Strengthening Building Block Assessment Rubric

	Emergency WASH	Fragile but strengthening	Transitional	Desired – all actors using District systems – WaterAid exit?
Coordination	Humanitarian actors coordinated through WASH Cluster by UNICEF – no one working on long term development	No coordination of agencies	Geographical coordination of agencies within the district	Agencies aligned behind comprehensive district level strategy/policy
Strategic planning	OCHA Humanitarian Action Plan or government relief plans, no development plan	Plan responding to donor priorities – sustainability not addressed	Plan in place to extend services but not to sustain them	Credible plan to deliver sustained universal access.
Financing	Emergency spending directly through NGOs and UN Agencies	No fiscal decentralized spending. Donor spending on District Plan (“On Plan”) – not covering lifecycle costs	Fiscal decentralization and donor spending on capital costs. “On Budget” but not covering lifecycle costs.	Full fiscal decentralization, external support agencies channel funds through District accounts (“On Treasury”). Lifecycle costs matched to sources of finance.
Institutional Arrangements	Focus on saving lives by providing access rather than on building life-saving institutions	Institutions exist on paper but not functional or accountable to citizens. Overlapping, unclear roles and responsibilities	Partially functional institutions with weak capacity and accountability to citizens. Roles and responsibilities not fully clear	All necessary institutions and capacities are in place with clear roles and responsibilities eg regulator, health, education, HR, IT systems. Full accountability to citizens
Service delivery	Ad hoc emergency interventions	Fragmented project interventions, multiple missions, and reporting systems. No post implementation support.	District authorities and agencies mainly focused on extending coverage. Weak post implementation support.	Both coverage and post implementation support to all users fully addressed by duty bearer.
Monitoring	Through WASH cluster and to donors	No common monitoring or review process	Common sector targets and multi-stakeholder monitoring but no aggregated reporting	Government owned, regularly updated monitoring process feeding into strategic planning.