Meta-models as a straightforward approach to the sensitivity analysis of complex models

Authored by Hiroyuki Yokomizo, Shaun R Coutts

Date Published: 2014

DOI: 10.1007/s10144-013-0422-1

Sponsors: Japanese Society for the Promotion of Science (JSPS)

Platforms: R

Model Documentation: Other Narrative Mathematical description

Model Code URLs: https://static-content-springer-com.ezproxy1.lib.asu.edu/esm/art%3A10.1007%2Fs10144-013-0422-1/MediaObjects/10144_2013_422_MOESM2_ESM.r

Abstract

Complex simulation models are important tools in applied ecological and conservation research. However sensitivity analysis of this important class of models can be difficult to conduct. High level interactions and non-linear responses are common in complex simulations, and this necessitates a global sensitivity analysis, where each parameter is tested at a range of values, and in combination with changes in many other parameters. We reviewed the literature, searching for population viability analyses that used simulation models. We found only 9 out of the 122 simulation population viability analysis used global sensitivity analysis. This result is typical of other simulation models in applied ecology, where global sensitivity analysis is rare. We then demonstrate how to conduct a meta-modeling sensitivity analysis, where a simpler statistically fit function (the meta-model, also known as the surrogate model or emulator) is used to approximate the behavior of the complicated simulation. This simpler meta-model is interrogated to inform on the behavior of simulation model. We fit two example meta-models, a generalized linear model and a boosted regression tree, to exemplify the approach. Our hope is that by going through these techniques thoroughly they will become more widely adopted.

Tags

Individual-based model Uncertainty Management Dynamics habitat Australia Strategies Population viability analysis Logistic-regression Emulation