Forests Sourcebook - HCV Resource Network
Forests Sourcebook - HCV Resource Network Forests Sourcebook - HCV Resource Network
Box 4.14 Outcome Assessment Tracking It is difficult to reach agreement among all stakeholders about what is wanted and what is likely to happen. The outcome assessment approach is based upon negotiations among all stakeholders on what they want the landscape to look like and what it is to deliver, that is, how they want the landscape to perform. Indicators then have to be selected that will measure change in the landscape and how that will correspond to the desired performance criteria. Indicators of changes in different categories of landscape values (natural, built, human, and social value categories) provide a basis for assessing the impact of interventions from a holistic perspective. This approach is particularly useful in situations where an intervention is anticipated to impact a landscape mosaic, for instance, in determining and then assessing an appropriate balance between the amount of forest needed for conservation and the amount that might be converted to agriculture or other uses. Outcome assessment methodologies are consistent with commonly employed participatory techniques for planning and evaluating interventions; the techniques should thus be used early in project formulation to ensure clarity of desired project effects on landscape outcomes and establish the basis for measuring them. The indicator sets can be developed in a few days during a multistakeholder meeting. A technical person, or small team, will then need to conduct the first, baseline assessment. This may require extensive field surveys and, depending upon the complexity of the situation and the availability of data, may take several months. The process will have to be repeated every year to track progress, so an annual meeting will be needed to review progress and adapt management as needed. The costs associated with this approach include those of the facilitator for the first meeting and technical staff hired for several months to assemble data. Landscape-scale outcome assessment approaches capture the broader impacts of any intervention—a policy change, financial incentive, new projects, and so forth—on the landscape. They could complement rates of return studies in negotiating possible externalities of an intervention and then measuring them. Source: Sayer 2006. the intervention. It should be an ongoing process through which periodic monitoring is used to modify, as necessary, the implementation of the project (see chapter 7, Monitoring and Information Systems for Forest Management). SELECTED READINGS Forthcoming. Landscape Measures Resource Center. www.ecoagriculturepartners.org. Buck, L. E., J. C. Milder, T. A. Gavin, and I. Mukherjee. 2006. “Understanding Ecoagriculture: A Framework for Measuring Landscape Performance.” Discussion Paper No. 2, Ecoagriculture Partners, Washington, DC. http://www .ecoagriculturepartners.org/documents/reports/discus sionPapers/DiscussionPaperV2.pdf. REFERENCES CITED Stem, C., R. Margoluis, N. Salafsky, and M. Brown. 2005. “Monitoring and Evaluation in Conservation: A Review of Trends and Approaches.” Conservation Biology 19(2): 295–309. Buck, L. E., J. C. Milder, T. A. Gavin, and I. Mukherjee. 2006. “Understanding Ecoagriculture: A Framework for Measuring Landscape Performance.” Discussion Paper No. 2, Ecoagriculture Partners, Washington, DC. http://www .ecoagriculturepartners.org/documents/reports/discussionPapers/DiscussionPaperV2.pdf. Ecoagriculture Partners and IUCN (International Conservation Union). 2007. “Principles of Engagement with Stakeholders in Negotiating and Measuring Landscape- Level Outcomes.” Draft, Ecoagriculture Working Group, Cornell University, Ithaca, NY. http://ecoag.cals.cornell .edu/documents.html. Sayer, J. A., and S. Maginnis, eds. 2006. Forests in Landscapes: Ecosystem Approaches to Sustainability. London: Earthscan. CROSS-REFERENCED CHAPTERS AND NOTES Note 4.1: Integrated Forest Landscape Land-Use Planning Note 4.3: Using Adaptive Management to Improve Project Implementation Chapter 7: Information and Monitoring Systems for Forest Management, and associated notes 142 CHAPTER 4: OPTIMIZING FOREST FUNCTIONS IN A LANDSCAPE
NOTE 4.3 Using Adaptive Management to Improve Project Implementation Conservation and development interventions take place in complex systems influenced by biological, political, social, economic, and cultural factors. 1 Project managers and practitioners operating within these complex systems must make important decisions, yet they often have limited information and are operating in the face of uncertainty. This complexity is compounded at the landscape scale, where a larger geographical space, including all functions and processes and additional institutions involved, needs to be considered. The approach adopted at the landscape level needs to be flexible and able to accommodate new information and changing contexts (see chapter 4, Optimizing Forest Functions in a Landscape). This note addresses the use of an adaptive management approach to project implementation, a method for making more informed decisions about strategies, testing the effectiveness of strategies used, and learning and adapting to improve the strategies (Lee 1993; Gunderson, Holling, and Light 1995). OVERVIEW AND CONSIDERATIONS OF INTEREST FOR WORLD BANK ACTIVITIES Adaptive management stands in contrast to traditional project and program management by requiring an explicitly experimental—or scientific—approach. Specifically, adaptive management is the integration of design, management, and monitoring to systematically test assumptions to adapt and learn (Salafsky, Margoluis, and Redford 2001). There are three main components to adaptive management: ■ ■ ■ Testing assumptions. Assumption testing involves systematically trying different activities to achieve a desired outcome and is distinct from a random trial-and-error process. It requires clearly and explicitly articulating assumptions underlying the way in which proposed activities will help achieve project goals and objectives to strategically select project actions. The outcomes of the activities are monitored to compare the actual to the predicted outcome. This enables the project team to understand what worked, but more important, why it was effective. Adaptation. Several reasons may underlie the unexpected outcome of a project activity (for example, the project assumptions were wrong, the actions were poorly executed, the conditions at the project site changed, the monitoring was faulty—or some combination of these problems). Adaptation involves reviewing and, where relevant, changing assumptions and interventions to respond to the new information obtained through monitoring efforts. Learning. Learning involves systematically documenting a project team’s process and results. The aim is to avoid making similar mistakes in the future and to share lessons learned with the broader community of practice. The explicit and systematic testing of assumptions is the key facet of adaptive management that helps project teams uncover why a project was successful or faced setbacks and whether it was due to poor theory and underlying assumptions, poor implementation, or a combination of the two (see figure 4.1). There are at least two levels at which program managers could apply adaptive management: (i) at a high programmatic level, to help them determine the strategies and types of projects they should support and how well their portfolio of projects is doing; and (ii) at the project level, to help the initiatives they support go through an adaptive management process. This note focuses on the second of these levels, although the adaptive management process is important for both. OPERATIONAL ASPECTS For the purposes of explaining the adaptive management process, we use a cycle adapted from the Conservation Mea- 143
- Page 91: Wunder, S. 2005. “Payments for En
- Page 94 and 95: Box 3.1 Technical Definitions Wood
- Page 96 and 97: Table 3.2 Wood Fuel Data for Select
- Page 98 and 99: ered it important to have the World
- Page 100 and 101: operations (such as community-based
- Page 102 and 103: also needs to be extended in many c
- Page 104 and 105: NOTE 3.1 Mainstreaming Conservation
- Page 106 and 107: areas that can be used more intensi
- Page 108 and 109: Box 3.7 Applying HCVF in Papua New
- Page 110 and 111: Finally, any existing protections,
- Page 112 and 113: However, these general rules are se
- Page 114 and 115: the origin of products from a certi
- Page 116 and 117: management practices in selected en
- Page 118 and 119: Reforms) provide the framework for
- Page 120 and 121: lenges to weak institutions, which
- Page 123 and 124: CHAPTER 4 Optimizing Forest Functio
- Page 125 and 126: People and human societies are seen
- Page 127 and 128: Encourage stakeholder participation
- Page 129 and 130: Box 4.5 Tradeoffs Framework Used in
- Page 131 and 132: Sector and Thematic Evaluation, Ope
- Page 133 and 134: Identify planning team members and
- Page 135 and 136: Involve relevant stakeholders in de
- Page 137 and 138: needs of implementing partners and
- Page 139 and 140: NOTE 4.2 Assessing Outcomes of Land
- Page 141: Box 4.13 Possible Indicators for As
- Page 145 and 146: ■ ■ ■ ■ Develop a project p
- Page 147 and 148: Another important and useful proces
- Page 149 and 150: theless, it is never too late to st
- Page 151 and 152: CHAPTER 5 IMPROVING FOREST GOVERNAN
- Page 153 and 154: Improving forest governance and leg
- Page 155 and 156: tant part of the World Bank’s con
- Page 157 and 158: sector with broader governance and
- Page 159 and 160: NOTE 5.1 Decentralized Forest Manag
- Page 161 and 162: Assess the overall decentralization
- Page 163 and 164: Box 5.5 Nicaragua: Asymmetries Betw
- Page 165 and 166: Parker, A. 1995. “Decentralizatio
- Page 167 and 168: ■ ■ ■ Management of forests (
- Page 169 and 170: such as designing a transparent con
- Page 171 and 172: Box 5.11 Citizen Report Cards: Benc
- Page 173 and 174: NOTE 5.3 Strengthening Legal Framew
- Page 175 and 176: Box 5.13 Working on the Law with La
- Page 177 and 178: In addition, the process of public
- Page 179 and 180: ANNEX 5.3B SIX DRAFTING PRINCIPLES
- Page 181 and 182: forestry policy or to promote other
- Page 183 and 184: The most common fiscal incentives i
- Page 185 and 186: is reasonable to allow the administ
- Page 187 and 188: ANNEX 5.4A A SUMMARY OF THE DIFFERE
- Page 189 and 190: NOTE 5.5 ADDRESSING ILLEGAL LOGGING
- Page 191 and 192: Box 5.17 Measures Specific to Comba
NOTE 4.3<br />
Using Adaptive Management to Improve<br />
Project Implementation<br />
Conservation and development interventions take<br />
place in complex systems influenced by biological,<br />
political, social, economic, and cultural factors. 1<br />
Project managers and practitioners operating within these<br />
complex systems must make important decisions, yet they<br />
often have limited information and are operating in the face<br />
of uncertainty. This complexity is compounded at the landscape<br />
scale, where a larger geographical space, including all<br />
functions and processes and additional institutions<br />
involved, needs to be considered. The approach adopted at<br />
the landscape level needs to be flexible and able to accommodate<br />
new information and changing contexts (see chapter<br />
4, Optimizing Forest Functions in a Landscape). This<br />
note addresses the use of an adaptive management<br />
approach to project implementation, a method for making<br />
more informed decisions about strategies, testing the effectiveness<br />
of strategies used, and learning and adapting to<br />
improve the strategies (Lee 1993; Gunderson, Holling, and<br />
Light 1995).<br />
OVERVIEW AND CONSIDERATIONS<br />
OF INTEREST FOR WORLD BANK ACTIVITIES<br />
Adaptive management stands in contrast to traditional<br />
project and program management by requiring an explicitly<br />
experimental—or scientific—approach. Specifically, adaptive<br />
management is the integration of design, management,<br />
and monitoring to systematically test assumptions to adapt<br />
and learn (Salafsky, Margoluis, and Redford 2001). There<br />
are three main components to adaptive management:<br />
■<br />
■<br />
■<br />
Testing assumptions. Assumption testing involves systematically<br />
trying different activities to achieve a desired outcome<br />
and is distinct from a random trial-and-error<br />
process. It requires clearly and explicitly articulating<br />
assumptions underlying the way in which proposed activities<br />
will help achieve project goals and objectives to strategically<br />
select project actions. The outcomes of the activities<br />
are monitored to compare the actual to the predicted outcome.<br />
This enables the project team to understand what<br />
worked, but more important, why it was effective.<br />
Adaptation. Several reasons may underlie the unexpected<br />
outcome of a project activity (for example, the project<br />
assumptions were wrong, the actions were poorly executed,<br />
the conditions at the project site changed, the<br />
monitoring was faulty—or some combination of these<br />
problems). Adaptation involves reviewing and, where<br />
relevant, changing assumptions and interventions to<br />
respond to the new information obtained through monitoring<br />
efforts.<br />
Learning. Learning involves systematically documenting<br />
a project team’s process and results. The aim is to avoid<br />
making similar mistakes in the future and to share lessons<br />
learned with the broader community of practice.<br />
The explicit and systematic testing of assumptions is the<br />
key facet of adaptive management that helps project teams<br />
uncover why a project was successful or faced setbacks and<br />
whether it was due to poor theory and underlying assumptions,<br />
poor implementation, or a combination of the two<br />
(see figure 4.1).<br />
There are at least two levels at which program managers<br />
could apply adaptive management: (i) at a high programmatic<br />
level, to help them determine the strategies and types of projects<br />
they should support and how well their portfolio of projects<br />
is doing; and (ii) at the project level, to help the initiatives<br />
they support go through an adaptive management process.<br />
This note focuses on the second of these levels, although the<br />
adaptive management process is important for both.<br />
OPERATIONAL ASPECTS<br />
For the purposes of explaining the adaptive management<br />
process, we use a cycle adapted from the Conservation Mea-<br />
143