Simulation and validation of a reinforcement learning agent-based model for multi-stakeholder forest management

Authored by Christopher Bone

Date Published: 2010-03

DOI: 10.1016/j.compenvurbsys.2009.10.001

Sponsors: National Science and Engineering Research Council of Canada (NSERC)

Platforms: Repast

Model Documentation: Other Narrative

Model Code URLs: Model code not found

Abstract

Spatial optimization and agent-based modeling present two distinct approaches that have been implemented in forest management research for incorporating the objectives of multiple stakeholders. However, challenges arise in their implementation as optimization procedures do not consider the interactions amongst stakeholders, and agent-based models generate results from which it is difficult to determine if objectives have been successfully achieved. The purpose of this research is to overcome these limitations by improving the ability of an agent-based model to achieve optimal forest harvesting strategies through the integration of reinforcement learning (RL). A simulation model is developed in which forest company agents harvest trees in order to maximize their profits while considering the potential to cooperate with a conservationist agent whose objectives are based on protecting species habitat. RL algorithms are implemented to allow the forest company agents and the conservationist agent to learn where harvesting should occur in order to achieve their objectives. The model is validated by determining if generated solutions can be considered optimal given system constraints, and by comparing observed agent behavior against learning functions as defined by the RI. algorithms. The obtained results demonstrate a non-linear relationship between different levels of cooperation and the ability of agents to achieve their objectives. The model also provides outputs that depict the relative quality of forest areas and the tradeoffs between objectives for different optimal solutions. (C) 2009 Elsevier Ltd. All rights reserved.

Tags

Agent-based modeling Optimization Forest management reinforcement learning