manual for social impact assessment of land-based ... - Forest Trends

manual for social impact assessment of land-based ... - Forest Trends manual for social impact assessment of land-based ... - Forest Trends

forest.trends.org
from forest.trends.org More from this publisher
26.10.2013 Views

T9.2 Definitions Performance indicators are measures, qualitative and quantitative, used to reflect progress toward achievement of objectives. The indicators can measure ‘ends’ (achievement of objectives or impacts) or ‘means’ (ways of achieving objectives – outputs and outcomes) or a combination of the two. Box T8 lists some features of good indicators. Box T8. Features of Good Indicators A good indicator: • Is a direct and unambiguous measure of progress • Is relevant, i.e., it measures factors that reflect goals/objectives of the program/project • Varies across areas, groups, over time, and is sensitive to changes in policies, programs and institutions • Is transparent and cannot be manipulated to show achievement where none exists • Is practical/cost-effective to track Source: G. Prennushi, G. Rubio, and K. Subbanno 2001. Before a monitoring system can be set up to assess whether project activities are having a positive (or negative) social impact, it is necessary to decide which goals the project wants to achieve, and select key indicators in order to measure progress towards those goals. By verifying change, indicators help in demonstrating progress when things go right and provide early warning signals when things go wrong. Each output/outcome/impact has many possible indicators, some of which will be more appropriate than others. Indicators will vary from one project to another, according to the project’s objectives and its context. The choice of indicators is also dependent on the data available, as well as on what can be feasibly monitored given resource and capacity constraints. The challenge is to meaningfully capture key changes over time by combining what is relevant with what is practically feasible to monitor. At the end of the day, the key to good indicators is not volume of data or precision in measurement. Large volumes of data can confuse rather than bring focus. It is better to have indicators that provide approximate answers to some important questions than to have exact answers to many unimportant questions. Box T9 provides an overview of some key indicator definitions and distinctions. When it is not possible or practical to select an indicator that allows direct measurement of an outcome or impact then a proxy indicator may be necessary. Cost-effectiveness may be a reason to choose proxy or indirect indicators; the proxy indicator seeks a balance between the level of reliability of information and the efforts needed to obtain the data. The inability to measure the subject of interest directly may be another reason to formulate a proxy indicator. This is often the case for more qualitative subjects like behavioural change and good governance. For example “distance traveled” or “time spent” can be proxies for effort expended on obtaining livelihood resources or income and are particularly important for understanding resource degradation or access impacts on women and children. Social Impact Assessment of Land-Based Carbon Projects (1.0) – Part II | 105

Box T9. Goals and Indicators Definitions and Distinctions Impact Goals: what is to be assessed Impact Indicators: how it is to be assessed Quantitative and Qualitative Indicators Quantitative indicators are expressed in numerical form (number, percentage, ratio), however they vary in precision. They can record precise amounts, (e.g. wages actually paid) or estimate rough quantities (e.g. unrecorded income from informal sector activities). Qualitative indicators are expressed in verbal form. They may assess observable characteristics (e.g. villagers’ perceptions of whether they are poor or not), as well as ideas or attitudes. Data from assessments linked to qualitative indicators can also be categorized and ranked like quantitative indicators to varying degrees of precision. Direct and Proxy Indicators Direct indicators are those which are a direct result of an intervention (e.g. numbers of community members employed in a reforestation initiative). Proxy indicators are those which are used when data for direct indicators is not available or feasible to collect, e.g. levels of women’s savings as a proxy indicator of economic empowerment. Source: Mayoux, 2001. T9.3 Types of Indicators There are generally considered to be four types of indicators: input, output, outcome and impact indicators. Inputs and outputs are intermediate steps to determine if the desired outcomes/impacts are achieved. Activity or Input Indicators are measures of the project’s inputs and the direct activities involved in its implementation; e.g., the amount of the project’s implementation budget spent on training forest guards. Activity indicators are the most straightforward indicators to use. Output Indicators measure the immediate results of the project’s activities; they refer to goods and services that result from the project; e.g., number of forest guards trained. They are intervention indicators. Outcome Indicators seek to measure the extent to which the project’s objectives or purposes have been attained; they measure the results from the goods and services produced by the project activity. For example, the number of trained men employed as forest guards. Impact Indicators measure the highest objectives or the project’s contribution to attainment of a broader/larger strategic or overall goal over the longer-term, such as improved well-being or a reduction in poverty levels. A project typically only contributes to these longer term goals or impacts. Input and output indicators (also known as process indicators) are usually quantitative because they measure the implementation of project activities. Outcome or impact indicators can be quantitative Social Impact Assessment of Land-Based Carbon Projects (1.0) – Part II | 106

T9.2 Definitions<br />

Per<strong>for</strong>mance indicators are measures, qualitative and quantitative, used to reflect progress toward<br />

achievement <strong>of</strong> objectives. The indicators can measure ‘ends’ (achievement <strong>of</strong> objectives or <strong>impact</strong>s)<br />

or ‘means’ (ways <strong>of</strong> achieving objectives – outputs and outcomes) or a combination <strong>of</strong> the two. Box<br />

T8 lists some features <strong>of</strong> good indicators.<br />

Box T8. Features <strong>of</strong> Good Indicators<br />

A good indicator:<br />

• Is a direct and unambiguous measure <strong>of</strong> progress<br />

• Is relevant, i.e., it measures factors that reflect goals/objectives <strong>of</strong> the program/project<br />

• Varies across areas, groups, over time, and is sensitive to changes in policies, programs and<br />

institutions<br />

• Is transparent and cannot be manipulated to show achievement where none exists<br />

• Is practical/cost-effective to track<br />

Source: G. Prennushi, G. Rubio, and K. Subbanno 2001.<br />

Be<strong>for</strong>e a monitoring system can be set up to assess whether project activities are having a positive<br />

(or negative) <strong>social</strong> <strong>impact</strong>, it is necessary to decide which goals the project wants to achieve, and<br />

select key indicators in order to measure progress towards those goals. By verifying change,<br />

indicators help in demonstrating progress when things go right and provide early warning signals<br />

when things go wrong.<br />

Each output/outcome/<strong>impact</strong> has many possible indicators, some <strong>of</strong> which will be more appropriate<br />

than others. Indicators will vary from one project to another, according to the project’s objectives<br />

and its context. The choice <strong>of</strong> indicators is also dependent on the data available, as well as on what<br />

can be feasibly monitored given resource and capacity constraints. The challenge is to meaningfully<br />

capture key changes over time by combining what is relevant with what is practically feasible to<br />

monitor. At the end <strong>of</strong> the day, the key to good indicators is not volume <strong>of</strong> data or precision in<br />

measurement. Large volumes <strong>of</strong> data can confuse rather than bring focus. It is better to have<br />

indicators that provide approximate answers to some important questions than to have exact<br />

answers to many unimportant questions. Box T9 provides an overview <strong>of</strong> some key indicator<br />

definitions and distinctions.<br />

When it is not possible or practical to select an indicator that allows direct measurement <strong>of</strong> an<br />

outcome or <strong>impact</strong> then a proxy indicator may be necessary. Cost-effectiveness may be a reason to<br />

choose proxy or indirect indicators; the proxy indicator seeks a balance between the level <strong>of</strong><br />

reliability <strong>of</strong> in<strong>for</strong>mation and the ef<strong>for</strong>ts needed to obtain the data. The inability to measure the<br />

subject <strong>of</strong> interest directly may be another reason to <strong>for</strong>mulate a proxy indicator. This is <strong>of</strong>ten the<br />

case <strong>for</strong> more qualitative subjects like behavioural change and good governance. For example<br />

“distance traveled” or “time spent” can be proxies <strong>for</strong> ef<strong>for</strong>t expended on obtaining livelihood<br />

resources or income and are particularly important <strong>for</strong> understanding resource degradation or<br />

access <strong>impact</strong>s on women and children.<br />

Social Impact Assessment <strong>of</strong> Land-Based Carbon Projects (1.0) – Part II | 105

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!