Evaluability Assessment and Formative Evaluation of the Explosive Ordnance Risk Education (EORE) programme in Syria (International Consultant), Damascus, Syria, 70 working days within 4 months

• Country: Damascus, Syria
• No of vacancies: N/A
  
• Salary: N/A 
• Organization: UNICEF
• Gender: Both
• Deadline: 2024-02-07

OBJECTIVES OF THE ASSIGNMENT (PURPOSE OF THE ASSIGNMENT):

The purpose of the consultancy is to conduct an evaluability assessment and formative evaluation of UNICEF Explosive Ordnance Risk Education. This exercise comes at an important time to generate evidence and learning to inform the future strategic direction of the UNICEF Syria EORE programme including evidence-based programming and resource mobilisation.

The evaluation is both a reflective exercise on approaches taken by UNICEF Syria Country Office for EORE programming and a forward-look on what are the building blocks for effective EORE programming in Syria, including programme structure, processes and resources, enabling factors and how they can deliver future results for children in Syria.

The objectives of the evaluability assessment and formative evaluation are detailed in the attached TOR for the assignment

Scope:

The time period that this evaluation will cover is from 2021 – 2023; EORE activities have taken place prior to this time period but 2021 onwards represents a clearer programmatic approach that it would be useful to reflect on.

It will cover activities across the 14 governorates in Syria where UNICEF operates through 6 field offices.

The draft evaluation questions can be found in the attached TOR, in which they indicate the main area of interest and guide the focus of the assignment.

Methodology

This evaluation will be conducted in accordance to the 2016 United Nations Evaluation Group Norms and Standards for Evaluation[8] and the UNICEF Evaluation Policy (2018)[9].

The methodology of the consultancy and related deliverables should focus on the following three areas:

Review of existing monitoring and reporting data

1. Review of programme and project documentation, including a detailed mapping of available key documentation identifying key gaps. Available data includes but is not limited to 4Ws reports, programme visit reports (which include inquiries around accountability to affected populations), and regular reporting mechanisms. UNICEF Syria EORE programme monitoring is done through partner reports, validated by third party monitoring reports or field trips conducted by programme officers. Financial records from partners, and funds utilization information are also available. The evaluation should also review training and awareness-raising materials.

Primary data

2. Interviews and focus group discussions should be conducted with key internal and external stakeholders, based on programme stakeholder mapping that can be validated by UNICEF Syria EORE programme[10]. A potential key evidence source of secondary data on beneficiary knowledge and behaviour, as well as on programme implementation approaches, is the Third-Party Technical Facilitators, contracted by UNICEF Syria to provide technical support to partners on programme implementation in the field.
3. Small-scale primary qualitative data collection in Syria is possible via focus groups conducted by UNICEF Syria Independent Third-Party Monitoring data collectors in UNICEF-supported service centers run by implementing partners. The design and conduct of this data collection should be developed by the consultant during the evaluation design in consultation with UNICEF Syria EORE programme and PME section but will focus on small-scale appropriate ways to engage with beneficiaries to establish levels of awareness on risk education.  The consultant should design data collection tools, conduct training of and supervise the UNICEF Syria Third Party Monitors, and analyse the collected raw data[11]. If appropriate and if possible, in terms of access restrictions[12], efforts will be made for the consultant to conduct trainings and supervise data collection directly.

It is intended that this primary data collection could focus on establishing levels of knowledge and awareness of risks of explosive ordnance, helping to establish an indicative proxy baseline for future programming, as well as encouraging critical feedback on programme design and implementation to help inform future programming. The consultant will ensure appropriate training, supervision, and quality control of data collection remotely to minimize any bias and improve the credibility of the data. Any engagement with communities for data collection during the consultancy will be subject to UNICEF and UNEG ethical standards and would require ethical approval.

Review of data and results frameworks

4. The consultant should conduct a stocktake and assessment of monitoring and reporting systems, including mapping and assessment of data availability and indicators, and make recommendations for strengthening M&E systems to support monitoring, reporting and programme learning.

In particular, the consultant should consult with UNICEF Child Protection programme to i) reconstruct the current programme in an initial Theory of Change and then ii) propose an adjusted Theory of Change that better reflects the objectives of EORE programme and supports better data collection and evidence generation for future programming.

Risks and limitations

Current monitoring data is limited in terms of having been focused on quantitative indicators related to reach of risk education activities and materials. There is overall a lack of national data on mine risk and also a shortage of comparative data on mine risk mitigation.

Programme planning, monitoring and reporting data may be incomplete or not have generated enough information to undertake a meaningful assessment of UNICEF Syria EORE programming design, implementation or results. Where this is the case, the consultant should document the gaps, identify any possible proxies, and recommend how to improve in future.

Another risk is related to engaging with communities in Syria, and it is difficult to access individuals outside of UNICEF-supported facilities. Primary data collection is therefore envisaged in UNICEF-supported facilities.

It is important that the evaluation is timely in terms of the needs of the EORE programme and the recruited consultant will need to ensure adherence to workplan.

LOCATION (GEOGRAPHIC AREA/ DUTY STATION): Damascus, Syria

Off-site working days: 70 days, anticipated to be performed remotely

DURATION:

The selected consultant will work for 70 days within a 4-month period. It is anticipated that the work will be done remotely. The exact schedule of the activities will be agreed with the consultant based on the contract implementation progress. The deadline for submission of final deliverables to UNICEF is by the end of the contract. Specific dates for the deliverables should be detailed and agreed in the inception report.

SUPERVISOR:

The consultant will be supervised and report to the UNICEF Syria Chief of Planning, Monitoring and Evaluation who will provide ongoing technical support and quality assessment of deliverables in line with evaluation standards, in close collaboration with UNICEF Syria Child Protection Officer, with guidance from UNICEF Syria Child Protection Specialist. On a day-to-day basis, the consultant is expected to work with a small working group formed of the UNICEF Syria Monitoring & Evaluation Specialist, UNICEF Syria Evaluation Specialist and UNICEF Child Protection Officer as programme focal point. A small Reference Group will be formed to provide technical guidance and quality review of deliverables and support to the management of the evaluation.

DESCRIPTION OF ASSIGNMENT (TASKS, SMART DELIVERABLES, DEADLINES):  

PROPOSED PAYMENT SCHEDULE

By Deliverables.

The payment of professional fees will be paid in installments against the agreed deliverables and accepted implementation report, as follows:

1. Approval of inception report by Reference Group linked to 30% payment of fees;
2. Approval of draft report by Reference Group linked to 30% payment of fees;
3. Approval of final report & final action plan by Reference Group linked to 40% payment of fees;

To qualify as an advocate for every child you will have…

1. Education: Advanced (Masters or above) university degree in evaluation, social sciences, or related field.
2. Work experience:

• At least five years of relevant professional work experience in research/evaluation activities including work experience in complex emergencies and protracted crises is required;
• Direct experience of conducting evaluations or research in the MENA region/in Syria is desirable;
• Experience conducting evaluability assessments/technical support for programme design/M&E is desirable;
• Experience conducting evaluations for UN agencies/UNICEF is desirable.

3. Technical knowledge/competencies:

• Knowledge and experience of child protection and risk mitigation programming is required;
• Knowledge of child protection in MENA region/in Syria is desirable;
• Experience in child protection/youth evaluation/evaluability/programme design/M&E in the field of humanitarian work is desirable.

4. Language
   • High proficiency in reading and speaking in English is required;
   • Proficiency in report-writing in English is required;
   • Proficiency in reading and speaking Arabic is required.

APPLY NOW