Annex: Methodology 1 STRATEGY - MADR

Updating of Mid-Term Evaluation of SAPARD in Romania for the period 2000-2005and once the impact has been established,• relevance: is the initiative still viable in relation to the sector priorities, or not?• sustainability: will the positive effects of the initiative continue once it has beenconcluded?Assessment of the effectiveness and of the efficiency, in particular, is necessary at thevarious levels of performance of the programme:the assessment of effectiveness will regard the relationships:• Global Objectives/Global Impact Indicators;• Specific Objectives / Indicators of Result;• Operative Objectives / Indicators of Output.the assessment of efficiency will regard the relationships:• Financial Plan / Financial Indicators;• Specific Objectives / Unit Costs.Figure n° 3 has helped us to distinguish the two components of effectiveness and efficiency.In the right part of the figure the elements necessary for assessment of effectiveness areidentified, and in the left part those for assessment of efficiency.With respect to the impact assessment, account has been taken of the difficulties linked withestimating the added value due to the programme measures. Hence, we have taken into dueconsideration the occurrence of factors exogenous to the generation of the impacts; thegross impacts of the measures have been distinguished from the net impacts directlyimputable to the implementation of the measures, where possible. To obtain the net effect ithas been necessary to take into adequate account three types of “disturbance factors”, whichare deducted from the gross effect:• deadweight effect: this is an effect that would have taken place in any case, evenin the absence of the programme;• substitution effect: this occurs when a change in the situation of an operator or ofa group of operators who are direct beneficiaries of the support of the programmeis obtained to the detriment of operators who are not beneficiaries of this support;• displacement effect: this occurs when a change in favour of an operator isaccompanied by undesired effects for operators not participating in theprogramme in the same geographical area of intervention.6