Terms of Reference, Evaluation of Oxfam in Ghana Country Strategy 2015-2019
1. Background, Rationale and Purpose of the Review
Following from the end of the 2009 - 2015 Joint Country Analysis and Strategy (JCAS) and as part of the Vision 2020 process, Oxfam in Ghana launched Oxfam Country Strategy (OCS) in 2015.
During this period, Oxfam in Ghana transitioned onto One Oxfam platform bringing together Oxfam GB, Oxfam US and Oxfam IBIS under one country line management.
The OCS has been in implementation since April 2016 and will end in March 2020. The OCS has a vision of contributing to a Ghana of active citizens, equitable development, and a responsive and effective state, which is setting a trend in Africa for accountable and progressive policy and practice.
The Oxfam Country Strategy was set out in three thematic program areas with change goals linked to the Oxfam Strategic Plan1.
Program Pillar 2 : Supporting extractive industry governance through CSO strengthening and engagement; Program Pillar 3 : Addressing inequalities in Ghana through enhancing access to quality essential services (education and health) for the poor.
Advancing gender justice, active citizenship and humanitarian action were defined and acknowledged as additional program areas and crosscutting issues particularly relevant for all the other program pillars.
For the purposes of this evaluation exercise, active citizenship and gender justice will be treated as both standalone and crosscutting themes.
The implementation of the OCS was guided by Country Operational Model (COM) which focused on support to advocacy and influencing policy reform processes around investments and pro-poor budgets for agriculture and food security, essential services (Universal Health Care and Universal Access to Quality Basic Education), active citizenship and accountable governance, and extractive governance (transparency, accountability and community rights in Mining, Oil and Gas sector), at both local and national levels linked to and support Oxfam International work in the West Africa region and elsewhere.
The COM included internal change management process to support Oxfam’s effort to better organize itself to deliver the strategic ambitions.
Progress toward our strategic ambition in the OCS is measured through annual output reporting and annual one program report at outcome levels, six-monthly program quality reviews, annual country learning reviews, individual program and project evaluations, organisational reviews, and partner assessments.
Among the key program and project reviews and evaluations that were conducted during the implementation of OCS and COM include Democratic Consolidation and Accountable Governance (DCAG), Education for Change (EfC), Maternal & Child Health (MCH), Oil for Development, mid-term review of the Global LEAP and Climate Resilient Agric and Food System projects.
Similarly, learning and knowledge products on women leadership in extractive industries, social accountability model, Complementary Basic Education (CBE), Girl Model Junior High, and renewable energy, among others were produced.
An effectiveness review of the Climate Resilient Agric and Food System project was also completed. Additionally, two donors to Oxfam namely DANIDA and NORAD conducted organizational reviews respectively led by partners affiliates (Oxfam ISBI and Oxfam US) during the period under review.
The European Union also conducted Systems Audit of Oxfam in Ghana during the period under review. The current exercise is aimed at reviewing and learning from the effectiveness of our work and strategic outcomes that the country program made.
As part of the process of objectively reviewing and contributing to accountability and learning, Oxfam in Ghana is commissioning an evaluation of its country strategy and operational model .
Results of the exercise will support Oxfam in Ghana respond to our accountability commitments, support program management decision-making, learn to improve our program work and inform the development of our new strategic plan and ambition of becoming influencing hub going forward.
The findings, lessons and recommendations from the evaluation will be used together with the outcomes / products of two other related processes, namely feasibility study and political economy analysis to shape the influencing hub model, next generation of Oxfam country strategy and operational model.
These Terms of Reference (TOR) therefore sets out the key steps for the evaluation of the 2015-2019 OCS and COM.
2. Specific Object and Objectives of the Evaluation 2 The main purpose of the evaluation is to :
Overall, this exercise will build on available information and evidence to reflect on :
As stipulated in the OCS results framework and program logic models / theories of change, the evaluation will further assess the underlying assumptions / context and overall progress towards strategic change objectives and outcomes as planned and budgeted, and to inform Oxfam in Ghana and partners on possible necessary adjustments and future directions.
The evaluation shall examine both general and specific aspects of the OCS including the underlying assumptions / context, and then based on analytical findings, propose applicable recommendations for future strategic directions including cooperation mechanisms, partnerships and funding modalities in terms of relevance to the changing development landscape in Ghana and beyond (global priorities and emerging issues).
3. Key questions of the Outcome Review
Given the broad scope of the different program pillars and change goals in the OCS and COM, the following proposed key questions have been identified to support a cross-program pillar-change goal analysis that will weave an overall, coherent narrative of what the individual program change goals tells us about Oxfam in Ghana (and partner) work during the OCS implementation period of 2015-2019.
Given the key questions of each program pillar change goal, there will be a special, focused analysis of partnership as an approach, as well as a specific analysis of how Oxfam in Ghana has organized itself to put women’s rights at the heart of all we do.
To what degree are programs transformational - fundamentally changing power relations as opposed to being more incremental or opportunity-bound?
Are there any established or emergent patterns of working in terms of :
What are the implications of these patterns in terms of developing partnerships for next generation programming?
In what ways, and how consistently, does Oxfam in Ghana put women’s rights at the heart of all we do and how do these efforts contribute to or impede achieving program and project goals?
Specifically, the outcome review will seek to address questions related to the following sub-headings guided and inspired by the OECD evaluation guidelines :
Using evaluations, reviews & other systematic analyses, what illustrative measures of outcome areas across the change goals, demonstrate Oxfam’s contributions, achievements and challenges?
Ways of working (operational model) :
Lessons Learned :
Which lessons can we draw and use for the future programming, in terms of strategies to be applied, ways of working, partner relationships, gender and accountability?
4. Scope of the evaluation and approach and methods, establishing the basic methodological considerations (if applicable)
The scope of the evaluation will include all the major program pillars (projects and initiatives) as well as joint initiatives with other organizations such as with CARE4.
The evaluation will be based on desk (document) assessments, key informant interviews with Oxfam and relevant stakeholders in Ghana and field visits.
The field visits will assess the link between Oxfam in Ghana’s support to partner projects in the field and Oxfam’s strategic plan.
The purpose of the visits is not to review the effectiveness of the specific projects and partnerships, but rather to review the projects and partnerships as illustrative cases, which will inform and validate the review of Oxfam strategies, plans and projects in practice.
a participatory review and planning workshops; and OCS review product validation workshops. The desk assessment will conclude with an inception report, which specifies the next steps, including a refined methodology for the data collection / field visits.
Data analysis and de-briefing (presentation of key findings and preliminary conclusions and recommendations); and reporting (Draft and Final reports).
To explore further insights, the consultant will undertake a limited number of interviews of program managers who led the different program interventions built on a broad array of Oxfam’s interventions, including programs and projects, advocacy and campaigns initiatives, and humanitarian work that falls within the OCS.
The programs and campaigns team will support the development of the general line of inquiry. Further interviews may be pursued where documentation needs clarification.
The commissioning manager and / or team members will provide the key contact information and appropriate introductions.
If appropriate, and supportive of decision-making, the consultant will be asked to include case examples that highlight insights into the approaches that are particularly important.
Otherwise, the place of any case example in the overall report will be determined once the final shape of the report is decided.
The consultant will provide an overall assessment of the degree to which multiple voices, perspectives, and experiences are considered in the overall document (e.
g., men’s, women’s, youth’s voices; staff, partners, allies, community members, etc.). This reflection aims to highlight the diversity behind the report, which is an Oxfam value.
This information will be expressed in the introduction and framed as the diversity that gives rise to the richness and depth of Oxfam’s knowledge.
6. Expected Output and Deliverables
The main deliverable will be a report written in clear, accessible language that will cover the following elements :
It is not necessary to include information about the methodology in the executive summary.
Key findings, including :
Evidence of key outcomes / changes achieved related to transformational change, including extent and nature of those changes (with a focus on how women, men, girls and boys and marginalized groups have benefited and how), and considering intended and unintended outcomes (positive or negative)
Approaches including partnerships leading to outcomes / changes
Analysis of how programs and campaigns (including partnerships and projects) have made progress toward transformational change, analysis of what strategies worked and how, and information on the gaps in strategies
Articulation of strategic learning questions that remain unanswered and identification of new / emerging learning questions that should be taken forward
these should focus on what we know and what we don’t know, so as to better position ourselves to learn in future
Recommendations , including recommendations for Oxfam in Ghana on how to improve programming and partnerships to achieve transformational change as an Influencing Hub as well as how to strengthen our different approaches across all our work, beyond the current specific change goals themselves to the strategic ambition of becoming an Influencing Hub
Bibliography / References
Other aspects to consider when writing the report are :
Publisher (which could include an Oxfam affiliate), month of report.
7. Evaluation Team : qualifications and skills needed, plan for organizing the evaluation team
Oxfam in Ghana will work with prospective consultants with strong record in conducting strategy reviews and evaluations, including of advocacy and campaigns.
The consultants or team leader will have wide respect and credibility within the development field, excellent knowledge of monitoring and evaluation in theory and practice, and a good understanding of policy influencing work in Ghana.
Consultants : Two-to-three international development consultants with expertise in development evaluation and result-based management, civil society and organisational development, governance and political economy analysis, and gender justice.
The review team should have the following skills and competencies :
8. Schedule, budget, logistics and deliverables. Include outline of the evaluation report
Oxfam in Ghana invites consultants with experience and skills described above to submit expression of interest (technical and financial proposals).
Joint bids are also welcome. Tenders should include :
The total budget for the assignment including participatory review and validation is GHS122,000. This budget will be split in the detail planning between the different forms of data gathering as agreed with successful consultants.
and other directly associated costs. The maximum contract amount for the evaluation is GHS122,000.00 and the consultants shall budget for the following in their financial proposal :
The budget should be based on a total of 35 person-days, divided by 2-3 consultants as outlined below. The exact number of days may be decreased and / or re-distributed among team members and will be decided upon during the inception phase and subject to the finalized methodology developed in the inception report.
9. Responsibilities and management arrangements
Oxfam in Ghana Country Leadership Team led by the Country Director will oversee the overall implementation of the evaluation.
The Head of Programs and Campaigns, Program and Functional Leads will be responsible for the planning and facilitating information provision and partner contacts for the process.
The programs and campaigns team together with the consultant plan the review’s content (agenda, process, outputs and facilitation).
This team will be responsible for all issues linked to the organization of the evaluation. The Ghana team will also seek further guidance and support from the Country Governance Group and OI Regional Platform.
10. Process of the selection of the evaluator or evaluation team and expectations for evaluation proposal
The criteria for selection will be :