Modeling experiential learning: The challenges posed by threshold dynamics for sustainable renewable resource management

Authored by Emilie Lindkvist, Jon Norberg

Date Published: 2014-08

DOI: 10.1016/j.ecolecon.2014.04.018

Sponsors: No sponsors listed

Platforms: MATLAB

Model Documentation: Other Narrative Pseudocode Mathematical description

Model Code URLs: Model code not found

Abstract

Adaptive management incorporates learning-by-doing (LBD) in order to capture learning and knowledge generation processes, crucial for sustainable resource use in the presence of uncertainty and environmental change. By contrast, an optimization approach to management identifies the most efficient exploitation strategy by postulating an absolute understanding of the resource dynamics and its inherent uncertainties. Here, we study the potential and limitations of LBD in achieving optimal management by undertaking an analysis using a simple growth model as a benchmark for evaluating the performance of an agent equipped with a `state-of-the-art' learning algorithm. The agent possesses no a priori knowledge about the resource dynamics, and learns management solely by resource interaction. We show that for a logistic growth function the agent can achieve 90% efficiency compared to the optimal control solution, whereas when a threshold (tipping point) is introduced, efficiency drops to 65%. Thus, our study supports the effectiveness of the LED approach. However, when a threshold is introduced efficiency decreases as experimentation may cause resource collapse. Further, the study proposes that: an appropriate amount of experimentation, high valuation of future stocks (discounting) and, a modest rate of adapting to new knowledge, will likely enhance the effectiveness of LBD as a management strategy. (C) 2014 Elsevier By. All rights reserved.

Tags

Agent Based Modeling Adaptive management reinforcement learning Learning by doing Neural networks Renewable resources Thresholds