Tuesday July 16th, 2019 ARCO LAB

Impact evaluation of the projects promoted by the Fund to contrast educational poverty of minors

valutazione di impatto dei progetti discussione dati quantitativi dati qualitativi con i bambini arco

ARCO’s Monitoring, Evaluation and Impact Evaluation presented its experience as external evaluator in 5 projects promoted by the Fund to contrast educational poverty of minors, managed by the social business Con i Bambini, during the meeting  The challenge of impact evaluation for large donors organized by Social Value Italia and Torino Social Impact (Turin, 9 July 2019).

ARCO  is involved in 6 regional and national projects of the Fund and for each one Reserachers have developed and implemented specific impact evaluation plans. An experience that allowed them to deepen the reflection on the use of quantitative and qualitative data in the evaluation procedures.

Impact evaluation is a concept that has recently entered the world of the Italian third sector. The will to apply it to projects to fight against educational poverty of minors is an important innovation as it represents a first step towards the dissemination of the culture of impact evaluation throughout Italy.

Impact evaluation of projects of the Fund to contrast educational poverty of minors

The specific characteristics of the interventions promoted by the Fund required flexible impact evaluation strategies, capable of integrating quantitative and qualitative approaches based on the needs of each project. In almost all cases, in fact, the activities promoted by the project partnerships proved to be incompatible with an experimental or quasi-experimental evaluation approach.

The challenge for ARCO evaluators was precisely to try to adapt the concepts of impact evaluation also to small organizations that operate daily in the social field so they proposed mixed, quantitative-qualitative, or only qualitative strategies capable of grasping their value.

For the analysis, Researchers turned to the EHD, Evaluating Human Development, method developed within the same Research Center ARCO. Based on the Capabilities Approach of Amartya Sen, the EHD method uses a set of multidimensional indicators related to the paradigm of Sustainable Human Development to analyse the expansion of individual and collective opportunities. The use of qualitative and participatory methods allows to deepen the complexity of the dynamics of local development, adapting the evaluation strategy to the specificity of the context of intervention and puts the beneficiaries at the centre of the whole evaluation process.

valutazione di impatto progetti con i bambini fondo per il contrasto alla povertà educativa
valutazione di impatto progetti con i bambini fondo per il contrasto alla povertà educativa metodologia EHD approccio capabilities

Concerning the projects of the Fund to contrast educational poverty of minors, the need to adapt strategies has highlighted the importance of involving the external evaluator in all phases of the project’s progress. During the design an external collaborator was necessary to help the partnership to effectively integrate project actions with evaluation strategies; during implementation, the same external eye was needed to collect longitudinal data necessary for impact evaluation.

Having been involved in all 6 projects promoted by the social business Con i Bambini, Researchers noticed an important change in the mentality of the lead organization that presented the different project proposals. First, they put greater attention to the value of the results of an impact evaluation, both in terms of external communication and internal sharing. Furthermore, the dissemination of the fundamental concepts of the impact evaluations has influenced the way lead organizations plan interventions. In particular, they started to pay more attention on the degree of evaluability of each activity they insert in their projects. .

valutazione di impatto progetti con i bambini fondo per il contrasto alla povertà educativa dati quantitativi dati qualitativi

Read more on ARCO’s evaluation of the project promoted by the the Fund to contrast educational poverty of minors.

For further information contact

Marta Russo
M&E, Impact Evaluation Unit
marta.russo[at]arcolab.org

hfmz3y - wwii3a - 7xotdp - iakno6 - p8rgot - ls6cc1 - n8evsc - 5ddck4