TY - JOUR
T1 - Four principles for improved statistical ecology
AU - Popovic, Gordana
AU - Mason, Tanya Jane
AU - Drobniak, Szymon Marian
AU - Marques, Tiago André
AU - Potts, Joanne
AU - Joo, Rocío
AU - Altwegg, Res
AU - Burns, Carolyn Claire Isabelle
AU - McCarthy, Michael Andrew
AU - Johnston, Alison
AU - Nakagawa, Shinichi
AU - McMillan, Louise
AU - Devarajan, Kadambari
AU - Taggart, Patrick Leo
AU - Wunderlich, Alison
AU - Mair, Magdalena M.
AU - Martínez-Lanfranco, Juan Andrés
AU - Lagisz, Malgorzata
AU - Pottier, Patrice
PY - 2024/1/15
Y1 - 2024/1/15
N2 - 1. Increasing attention has been drawn to the misuse of statistical methods over recent years, with particular concern about the prevalence of practices such as poor experimental design, cherry picking and inadequate reporting. These failures are largely unintentional and no more common in ecology than in other scientific disciplines, with many of them easily remedied given the right guidance.2. Originating from a discussion at the 2020 International Statistical Ecology Conference, we show how ecologists can build their research following four guiding principles for impactful statistical research practices: (1) define a focussed research question, then plan sampling and analysis to answer it; (2) develop a model that accounts for the distribution and dependence of your data; (3) emphasise effect sizes to replace statistical significance with ecological relevance; and (4) report your methods and findings in sufficient detail so that your research is valid and reproducible.3. These principles provide a framework for experimental design and reporting that guards against unsound practices. Starting with a well-defined research question allows researchers to create an efficient study to answer it, and guards against poor research practices that lead to poor estimation of the direction, magnitude, and uncertainty of ecological relationships, and to poor replicability. Correct and appropriate statistical models give sound conclusions. Good reporting practices and a focus on ecological relevance make results impactful and replicable.4. Illustrated with two examples—an experiment to study the impact of disturbance on upland wetlands, and an observational study on blue tit colouring—this paper explains the rationale for the selection and use of effective statistical practices and provides practical guidance for ecologists seeking to improve their use of statistical methods.
AB - 1. Increasing attention has been drawn to the misuse of statistical methods over recent years, with particular concern about the prevalence of practices such as poor experimental design, cherry picking and inadequate reporting. These failures are largely unintentional and no more common in ecology than in other scientific disciplines, with many of them easily remedied given the right guidance.2. Originating from a discussion at the 2020 International Statistical Ecology Conference, we show how ecologists can build their research following four guiding principles for impactful statistical research practices: (1) define a focussed research question, then plan sampling and analysis to answer it; (2) develop a model that accounts for the distribution and dependence of your data; (3) emphasise effect sizes to replace statistical significance with ecological relevance; and (4) report your methods and findings in sufficient detail so that your research is valid and reproducible.3. These principles provide a framework for experimental design and reporting that guards against unsound practices. Starting with a well-defined research question allows researchers to create an efficient study to answer it, and guards against poor research practices that lead to poor estimation of the direction, magnitude, and uncertainty of ecological relationships, and to poor replicability. Correct and appropriate statistical models give sound conclusions. Good reporting practices and a focus on ecological relevance make results impactful and replicable.4. Illustrated with two examples—an experiment to study the impact of disturbance on upland wetlands, and an observational study on blue tit colouring—this paper explains the rationale for the selection and use of effective statistical practices and provides practical guidance for ecologists seeking to improve their use of statistical methods.
KW - HARKing
KW - Model assumptions
KW - p-hacking
KW - Pre-registration
KW - p-values
KW - Questionable research practices
KW - Reproducibility crisis
KW - Research waste
U2 - 10.1111/2041-210X.14270
DO - 10.1111/2041-210X.14270
M3 - Review article
SN - 2041-210X
VL - Early View
JO - Methods in Ecology and Evolution
JF - Methods in Ecology and Evolution
ER -