Energy efficiency and Demand Side Management Program ... - Eskom

the energy system could be reached when the engineering indicators (e.g. sources) do not compete
with the social, economic or environmental indicators (e.g. production, cost, environmental
concerns).
6 EEDSM Program Evaluation Criteria and Methodology
The program evaluation criteria and methodology are developed in such a way that they will assist
program planners, managers and evaluators to organise, design, and implement retrospective impact
evaluations that:
Set holistic and realistic goals for the program.
Pragmatically assess progress toward the key goals of the program.
Focus on the most important issues identified before the commencement of the program or
its evaluation.
Focus on the aspects that program planners and managers can control and/or influence.
Give credit that is due to program managers for the direct and indirect effects clearly
attributable to their programs.
Produce credible evaluations.
For this purpose, the following general steps for program evaluation are advised, and the POET based
process evaluation criteria and methodology are developed. It is important to go through the
following 6‐setep process with a view of what the POET model entails. This will equip the program
manager a so‐called ‘bird’s‐ eye view’ of the project or program.
Step 1 – Review program descriptions
Step 2 –Design the evaluation tables to highlight and prioritize important issues to be evaluated in
the program, and issue the program evaluation criteria to all stakeholders
Step 3 – Program managers (ESCos) prepare program documentation according to evaluation criteria
Step 4 – Program evaluation panel evaluates program reports and supporting documents and data
Step 5 – Finalize evaluation report and issue report to all stakeholders
Step 6 – Ensure actions taken on key issues through performance tracking
A general guideline often addresses issues such as:
Regulatory requirements
Energy and demand impacts
Economic/cost/financial impact
Social impact e.g. health benefits; job creation; etc.
Environmental impacts
Benefits to all stakeholders e.g. NERSA, Eskom, customers
General matters to all existing technologies which should evolve with time
Considerations of load shedding, double counting, kick back, etc.
Each of these falls into either technical, environmental, social or economic aspects those need to be
considered. Select and define specific indicators and their parameters (see Appendix 1 for examples
from the CDMGS toolbox). Goals for each of these should be broken down into sections, using the
POET model in order to ensure that the different aspects of the goal and how it interacts with other
goals will be taken into consideration.
11