Forests Sourcebook - HCV Resource Network

Forests Sourcebook - HCV Resource Network Forests Sourcebook - HCV Resource Network

hcvnetwork.org
from hcvnetwork.org More from this publisher
08.01.2014 Views

Box 4.14 Outcome Assessment Tracking It is difficult to reach agreement among all stakeholders about what is wanted and what is likely to happen. The outcome assessment approach is based upon negotiations among all stakeholders on what they want the landscape to look like and what it is to deliver, that is, how they want the landscape to perform. Indicators then have to be selected that will measure change in the landscape and how that will correspond to the desired performance criteria. Indicators of changes in different categories of landscape values (natural, built, human, and social value categories) provide a basis for assessing the impact of interventions from a holistic perspective. This approach is particularly useful in situations where an intervention is anticipated to impact a landscape mosaic, for instance, in determining and then assessing an appropriate balance between the amount of forest needed for conservation and the amount that might be converted to agriculture or other uses. Outcome assessment methodologies are consistent with commonly employed participatory techniques for planning and evaluating interventions; the techniques should thus be used early in project formulation to ensure clarity of desired project effects on landscape outcomes and establish the basis for measuring them. The indicator sets can be developed in a few days during a multistakeholder meeting. A technical person, or small team, will then need to conduct the first, baseline assessment. This may require extensive field surveys and, depending upon the complexity of the situation and the availability of data, may take several months. The process will have to be repeated every year to track progress, so an annual meeting will be needed to review progress and adapt management as needed. The costs associated with this approach include those of the facilitator for the first meeting and technical staff hired for several months to assemble data. Landscape-scale outcome assessment approaches capture the broader impacts of any intervention—a policy change, financial incentive, new projects, and so forth—on the landscape. They could complement rates of return studies in negotiating possible externalities of an intervention and then measuring them. Source: Sayer 2006. the intervention. It should be an ongoing process through which periodic monitoring is used to modify, as necessary, the implementation of the project (see chapter 7, Monitoring and Information Systems for Forest Management). SELECTED READINGS Forthcoming. Landscape Measures Resource Center. www.ecoagriculturepartners.org. Buck, L. E., J. C. Milder, T. A. Gavin, and I. Mukherjee. 2006. “Understanding Ecoagriculture: A Framework for Measuring Landscape Performance.” Discussion Paper No. 2, Ecoagriculture Partners, Washington, DC. http://www .ecoagriculturepartners.org/documents/reports/discus sionPapers/DiscussionPaperV2.pdf. REFERENCES CITED Stem, C., R. Margoluis, N. Salafsky, and M. Brown. 2005. “Monitoring and Evaluation in Conservation: A Review of Trends and Approaches.” Conservation Biology 19(2): 295–309. Buck, L. E., J. C. Milder, T. A. Gavin, and I. Mukherjee. 2006. “Understanding Ecoagriculture: A Framework for Measuring Landscape Performance.” Discussion Paper No. 2, Ecoagriculture Partners, Washington, DC. http://www .ecoagriculturepartners.org/documents/reports/discussionPapers/DiscussionPaperV2.pdf. Ecoagriculture Partners and IUCN (International Conservation Union). 2007. “Principles of Engagement with Stakeholders in Negotiating and Measuring Landscape- Level Outcomes.” Draft, Ecoagriculture Working Group, Cornell University, Ithaca, NY. http://ecoag.cals.cornell .edu/documents.html. Sayer, J. A., and S. Maginnis, eds. 2006. Forests in Landscapes: Ecosystem Approaches to Sustainability. London: Earthscan. CROSS-REFERENCED CHAPTERS AND NOTES Note 4.1: Integrated Forest Landscape Land-Use Planning Note 4.3: Using Adaptive Management to Improve Project Implementation Chapter 7: Information and Monitoring Systems for Forest Management, and associated notes 142 CHAPTER 4: OPTIMIZING FOREST FUNCTIONS IN A LANDSCAPE

NOTE 4.3 Using Adaptive Management to Improve Project Implementation Conservation and development interventions take place in complex systems influenced by biological, political, social, economic, and cultural factors. 1 Project managers and practitioners operating within these complex systems must make important decisions, yet they often have limited information and are operating in the face of uncertainty. This complexity is compounded at the landscape scale, where a larger geographical space, including all functions and processes and additional institutions involved, needs to be considered. The approach adopted at the landscape level needs to be flexible and able to accommodate new information and changing contexts (see chapter 4, Optimizing Forest Functions in a Landscape). This note addresses the use of an adaptive management approach to project implementation, a method for making more informed decisions about strategies, testing the effectiveness of strategies used, and learning and adapting to improve the strategies (Lee 1993; Gunderson, Holling, and Light 1995). OVERVIEW AND CONSIDERATIONS OF INTEREST FOR WORLD BANK ACTIVITIES Adaptive management stands in contrast to traditional project and program management by requiring an explicitly experimental—or scientific—approach. Specifically, adaptive management is the integration of design, management, and monitoring to systematically test assumptions to adapt and learn (Salafsky, Margoluis, and Redford 2001). There are three main components to adaptive management: ■ ■ ■ Testing assumptions. Assumption testing involves systematically trying different activities to achieve a desired outcome and is distinct from a random trial-and-error process. It requires clearly and explicitly articulating assumptions underlying the way in which proposed activities will help achieve project goals and objectives to strategically select project actions. The outcomes of the activities are monitored to compare the actual to the predicted outcome. This enables the project team to understand what worked, but more important, why it was effective. Adaptation. Several reasons may underlie the unexpected outcome of a project activity (for example, the project assumptions were wrong, the actions were poorly executed, the conditions at the project site changed, the monitoring was faulty—or some combination of these problems). Adaptation involves reviewing and, where relevant, changing assumptions and interventions to respond to the new information obtained through monitoring efforts. Learning. Learning involves systematically documenting a project team’s process and results. The aim is to avoid making similar mistakes in the future and to share lessons learned with the broader community of practice. The explicit and systematic testing of assumptions is the key facet of adaptive management that helps project teams uncover why a project was successful or faced setbacks and whether it was due to poor theory and underlying assumptions, poor implementation, or a combination of the two (see figure 4.1). There are at least two levels at which program managers could apply adaptive management: (i) at a high programmatic level, to help them determine the strategies and types of projects they should support and how well their portfolio of projects is doing; and (ii) at the project level, to help the initiatives they support go through an adaptive management process. This note focuses on the second of these levels, although the adaptive management process is important for both. OPERATIONAL ASPECTS For the purposes of explaining the adaptive management process, we use a cycle adapted from the Conservation Mea- 143

NOTE 4.3<br />

Using Adaptive Management to Improve<br />

Project Implementation<br />

Conservation and development interventions take<br />

place in complex systems influenced by biological,<br />

political, social, economic, and cultural factors. 1<br />

Project managers and practitioners operating within these<br />

complex systems must make important decisions, yet they<br />

often have limited information and are operating in the face<br />

of uncertainty. This complexity is compounded at the landscape<br />

scale, where a larger geographical space, including all<br />

functions and processes and additional institutions<br />

involved, needs to be considered. The approach adopted at<br />

the landscape level needs to be flexible and able to accommodate<br />

new information and changing contexts (see chapter<br />

4, Optimizing Forest Functions in a Landscape). This<br />

note addresses the use of an adaptive management<br />

approach to project implementation, a method for making<br />

more informed decisions about strategies, testing the effectiveness<br />

of strategies used, and learning and adapting to<br />

improve the strategies (Lee 1993; Gunderson, Holling, and<br />

Light 1995).<br />

OVERVIEW AND CONSIDERATIONS<br />

OF INTEREST FOR WORLD BANK ACTIVITIES<br />

Adaptive management stands in contrast to traditional<br />

project and program management by requiring an explicitly<br />

experimental—or scientific—approach. Specifically, adaptive<br />

management is the integration of design, management,<br />

and monitoring to systematically test assumptions to adapt<br />

and learn (Salafsky, Margoluis, and Redford 2001). There<br />

are three main components to adaptive management:<br />

■<br />

■<br />

■<br />

Testing assumptions. Assumption testing involves systematically<br />

trying different activities to achieve a desired outcome<br />

and is distinct from a random trial-and-error<br />

process. It requires clearly and explicitly articulating<br />

assumptions underlying the way in which proposed activities<br />

will help achieve project goals and objectives to strategically<br />

select project actions. The outcomes of the activities<br />

are monitored to compare the actual to the predicted outcome.<br />

This enables the project team to understand what<br />

worked, but more important, why it was effective.<br />

Adaptation. Several reasons may underlie the unexpected<br />

outcome of a project activity (for example, the project<br />

assumptions were wrong, the actions were poorly executed,<br />

the conditions at the project site changed, the<br />

monitoring was faulty—or some combination of these<br />

problems). Adaptation involves reviewing and, where<br />

relevant, changing assumptions and interventions to<br />

respond to the new information obtained through monitoring<br />

efforts.<br />

Learning. Learning involves systematically documenting<br />

a project team’s process and results. The aim is to avoid<br />

making similar mistakes in the future and to share lessons<br />

learned with the broader community of practice.<br />

The explicit and systematic testing of assumptions is the<br />

key facet of adaptive management that helps project teams<br />

uncover why a project was successful or faced setbacks and<br />

whether it was due to poor theory and underlying assumptions,<br />

poor implementation, or a combination of the two<br />

(see figure 4.1).<br />

There are at least two levels at which program managers<br />

could apply adaptive management: (i) at a high programmatic<br />

level, to help them determine the strategies and types of projects<br />

they should support and how well their portfolio of projects<br />

is doing; and (ii) at the project level, to help the initiatives<br />

they support go through an adaptive management process.<br />

This note focuses on the second of these levels, although the<br />

adaptive management process is important for both.<br />

OPERATIONAL ASPECTS<br />

For the purposes of explaining the adaptive management<br />

process, we use a cycle adapted from the Conservation Mea-<br />

143

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!