Advancing theory and research on Open Science Practices in psychology
Loading...
Date
2024
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Die vorliegende Dissertation zielt darauf ab, Theorie und Forschung zu Open Science Practices (OSPs) in der Psychologie weiterzuentwickeln. Sie umfasst vier Artikel und zusätzliche Analysen. Der erste Artikel gibt einen Überblick über den aktuellen Stand der Reproduzierbarkeit und Replizierbarkeit in der Arbeits- und Organisationspsychologie (AOP) und verwandten Bereichen. Im Rahmen dieses Überblicks diskutiere ich, wie OSPs die Vertrauenswürdigkeit der Forschung verbessern können, indem sie beispielsweise fragwürdige Forschungspraktiken reduzieren. Der zweite Artikel ist ein Kommentar, der gängige Missverständnisse über OSPs anspricht und deren Vorteile hervorhebt. Anschließend vertieft die Dissertation die Implementierung von OSPs mit vier empirischen Studien. Der dritte Artikel umfasst zwei Studien. Die erste Studie untersucht die Implementierung von OSPs in AOP- und Managementzeitschriften anhand der Webseiten dieser Zeitschriften. Wir stellten fest, dass die meisten Zeitschriften OSPs nicht erwähnten. Die zweite Studie untersucht wahrgenommene Barrieren bei der Implementierung von OSPs anhand einer Befragung unter Herausgeber*innen der AOP- und Managementzeitschriften. Die Antworten zeigten die Notwendigkeit, neue OSPs zu entwickeln und bestehende zu verfeinern, sowie die Verfügbarkeit von Informationen über OSPs zu erhöhen. Der vierte Artikel untersucht, ob und wie Replikationen in den Autor*innen-Richtlinien der sozialpsychologischen Zeitschriften in den Jahren 2015 und 2022 erwähnt werden. Obwohl mehr Zeitschriften 2022 Replikationen begrüßen, werden sie auf den Webseiten der meisten Zeitschriften weiterhin nicht erwähnt. Die zusätzlichen Analysen untersuchen, inwieweit AOP-Studien eine Präregistrierung haben und sich an diese halten. Wir fanden heraus, dass nur wenige Studien eine Präregistrierung hatten und dass Abweichungen hiervon häufig waren. Gemeinsam erweitern die Artikel dieser Dissertation das Wissen über OSPs in der Psychologie und können so dazu beitragen, die psychologische Forschung offener und transparenter zu gestalten.
The current doctoral dissertation aims to advance theory and research on Open Science Practices (OSPs) in Psychology. It comprises four articles and additional analyses. The first article reviews the current state of reproducibility and replicability in Industrial and Organizational Psychology (IOP) and related fields. As part of this review, we discuss how implementing OSPs can mitigate factors that undermine research trustworthiness, such as Questionable Research Practices (QRPs). The second article is a commentary addressing common misconceptions about OSPs and highlighting OSPs’ benefits. The dissertation then delves deeper into the implementation of OSPs with four empirical studies. The third article includes two studies. The first study examines the implementation of OSPs in IOP and Management journals by analyzing whether journal websites refer to OSPs. We found that most journals did not mention OSPs. The second study investigates perceived barriers to implementing OSPs with a survey among editors from the IOP and Management journals featured in the first study. Their responses indicated a need for developing new and refining existing OSPs, as well as increasing the availability of information on OSPs. The fourth article examines whether and how replications are mentioned in the author guidelines on the websites of Social Psychology journals in 2015 and 2022. Although we found an increase in journals welcoming replications in 2022, they were still not mentioned on the websites of most journals. The additional analyses examine the extent to which IOP studies have preregistrations and adhere to their preregistrations. We found that only very few studies had a preregistration and that deviations from preregistrations were common. Together, the articles included in this dissertation expand the knowledge about OSPs in Psychology and may thereby contribute to making psychological research more open and transparent.
The current doctoral dissertation aims to advance theory and research on Open Science Practices (OSPs) in Psychology. It comprises four articles and additional analyses. The first article reviews the current state of reproducibility and replicability in Industrial and Organizational Psychology (IOP) and related fields. As part of this review, we discuss how implementing OSPs can mitigate factors that undermine research trustworthiness, such as Questionable Research Practices (QRPs). The second article is a commentary addressing common misconceptions about OSPs and highlighting OSPs’ benefits. The dissertation then delves deeper into the implementation of OSPs with four empirical studies. The third article includes two studies. The first study examines the implementation of OSPs in IOP and Management journals by analyzing whether journal websites refer to OSPs. We found that most journals did not mention OSPs. The second study investigates perceived barriers to implementing OSPs with a survey among editors from the IOP and Management journals featured in the first study. Their responses indicated a need for developing new and refining existing OSPs, as well as increasing the availability of information on OSPs. The fourth article examines whether and how replications are mentioned in the author guidelines on the websites of Social Psychology journals in 2015 and 2022. Although we found an increase in journals welcoming replications in 2022, they were still not mentioned on the websites of most journals. The additional analyses examine the extent to which IOP studies have preregistrations and adhere to their preregistrations. We found that only very few studies had a preregistration and that deviations from preregistrations were common. Together, the articles included in this dissertation expand the knowledge about OSPs in Psychology and may thereby contribute to making psychological research more open and transparent.
Description
Table of contents
Keywords
Open Science Practice, Journal policies, Replication, Preregistration