Competition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs
Competition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs
StatusVoR
Alternative title
Authors
Huber, Christoph
Dreber, Anna
Huber, Jürgen
Johannesson, Magnus
Kirchler, Michael
Weitzel, Utz
Abellán, Miguel
Adayeva, Xeniya
Ay, Fehime Ceren
Barron, Kai
Monograph
Monograph (alternative title)
Date
2023-05-30
Publisher
Journal title
Proceedings of the National Academy of Sciences of the United States of America
Issue
23
Volume
120
Pages
Pages
1-10
ISSN
0027-8424
ISSN of series
Access date
2023-05-30
Abstract PL
Abstract EN
Does competition affect moral behavior? This fundamental question has been debated among leading scholars for centuries, and more recently, it has been tested in experimental studies yielding a body of rather inconclusive empirical evidence. A potential source of ambivalent empirical results on the same hypothesis is design heterogeneity—variation in true effect sizes across various reasonable experimental research protocols. To provide further evidence on whether competition affects moral behavior and to examine whether the generalizability of a single experimental study is jeopardized by design heterogeneity, we invited independent research teams to contribute experimental designs to a crowd-sourced project. In a large-scale online data collection, 18,123 experimental participants were randomly allocated to 45 randomly selected experimental designs out of 95 submitted designs. We find a small adverse effect of competition on moral behavior in a meta-analysis of the pooled data. The crowd-sourced design of our study allows for a clean identification and estimation of the variation in effect sizes above and beyond what could be expected due to sampling variance. We find substantial design heterogeneity—estimated to be about 1.6 times as large as the average standard error of effect size estimates of the 45 research designs—indicating that the informativeness and generalizability of results based on a single experimental design are limited. Drawing strong conclusions about the underlying hypotheses in the presence of substantive design heterogeneity requires moving toward much larger data collections on various experimental designs testing the same hypothesis.
Abstract other
Keywords PL
Keywords EN
competition
moral behavior
metascience
generalizability
experimental design
moral behavior
metascience
generalizability
experimental design