Sophia Crüwell, Deborah Apthorp, Bradley J Baker, Lincoln Colling, Malte Elson, Sandra J Geiger, Sebastian Lobentanzer, Jean Monéger, Alex Patterson, D Samuel Schwarzkopf, Mirela Zaneva, Nicholas J L Brown
In April 2019, Psychological Science published its first issue in which all Research Articles received the Open Data badge. We used that issue to investigate the effectiveness of this badge, focusing on the adherence to its aim at Psychological Science : sharing both data and code to ensure reproducibility of results. Twelve researchers of varying experience levels attempted to reproduce the results of the empirical articles in the target issue (at least three researchers per article). We found that all 14 articles provided at least some data and six provided analysis code, but only one article was rated to be exactly reproducible, and three were rated as essentially reproducible with minor deviations...
February 2, 2023: Psychological Science