Annex: Methodology 1 STRATEGY - MADR

Updating of Mid-Term Evaluation of SAPARD in Romania for the period 2000-20051.3 Methodological ApproachMaking reference to the project objectives we describe in greater detail the four key elements of theevaluation process, as listed below:‣ Common Evaluation Questions (CEQ)‣ Indicators‣ Sources of data‣ Modalities of transfer2.3.1 The Common Evaluation QuestionsThe Common Evaluation Questions 1 (CEQ) are the instrument of reference that is used by theEvaluator in the course of the activities to provide the EC with performance information.The CEQ is a complex instrument which, also due to its aims of re-aggregating results atCommunity level, has a rigid structure and is accompanied by guidelines of analytical anddetailed use.The Common Evaluation Questions for SAPARD are organised into three chapters:• Chapter A - Measure-specific questions: these are the majority of the questions. Theyconcern effects arising from the activities within each of the fifteen measures ofRegulation 1268/99;• Chapter B – Cross-cutting questions: regarding the overall impacts of SAPARD in termsof results and implementation. They provide a summary concerning the main effects ofthe programme in relation to the means and objectives of Regulation 1268/99.• Programme – specific questions with criteria and indicators for each individualprogramme to be filled by the applicant countries.• Chapter C – Global assessment questions on the overall affects of SAPARD. Theyshould be addressed on the basis of responses to the two previous chapters.In all, the questionnaire contains 57 questions, which the evaluation has answered, where possibleand relevant, setting out as many as 98 evaluation criteria and 129 indicators.In the case of the SAPARD Programme in Romania, there are six accredited measures, asevidenced in the following table n° 2, with which 27 questions, 37 criteria and 48 indicators areassociated. In particular, Measures 1.1, 2.1 and 4.2 were accredited on 31st of July 2002 whileMeasures 3.1, 3.4 and 4.1 on 5th of December 2003. Other measures contained in theNational Program for Agriculture and Rural Development (NPARD) has been accredited in2005, others have been cancelled.The evaluation activities have included an analysis of the measures whose implementation hasbeen started by September 2005 and an analysis of the measures whose implementation will bestarted from December 2005, but which are to be achieved in accordance with the requirementsand guidelines provided for the ex-ante evaluation of the SAPARD Programme.1 Cf. Guidelines for the Evaluation of Rural Development Programmes supported by SAPARD, Section D. April2001.8