Ciência-IUL
Publications
Publication Detailed Description
Raising the value of research studies in psychological science by increasing the credibility of research reports: The transparent Psi project
Journal Title
Royal Society Open Science
Year (definitive publication)
2023
Language
English
Country
United Kingdom
More Information
Web of Science®
Scopus
Google Scholar
Abstract
The low reproducibility rate in social sciences has produced hesitation among researchers in accepting published findings at their face value. Despite the advent of initiatives to increase transparency in research reporting, the field is still lacking tools to verify the credibility of research reports. In the present paper, we describe methodologies that let researchers craft highly credible research and allow their peers to verify this credibility. We demonstrate the application of these methods in a multi-laboratory replication of Bem’s Experiment 1 (Bem 2011 J. Pers. Soc. Psychol. 100, 407–425 (doi:10.1037/a0021524)) on extrasensory perception (ESP), which was co-designed by a consensus panel including both proponents and opponents of Bem’s original hypothesis. In the study, we applied direct data deposition in combination with born-open data and real-time research reports to extend transparency to protocol delivery and data collection. We also used piloting, checklists, laboratory logs, and video-documented trial sessions to ascertain as-intended protocol delivery, and external research auditors to monitor research integrity. We found 49.89% successful guesses, while Bem reported 53.07% success rate, with the chance level being 50%. Thus, Bem’s findings were not replicated in our study. In the paper, we discuss the implementation, feasibility, and perceived usefulness of the credibility-enhancing methodologies used throughout the project.
Acknowledgements
--
Keywords
Metascience,Research methods,Credibility,Transparency,Replication,Real-time procedures
Fields of Science and Technology Classification
- Psychology - Social Sciences
Funding Records
Funding Reference | Funding Entity |
---|---|
122/16 | Bial Foundation |
Contributions to the Sustainable Development Goals of the United Nations
With the objective to increase the research activity directed towards the achievement of the United Nations 2030 Sustainable Development Goals, the possibility of associating scientific publications with the Sustainable Development Goals is now available in Ciência-IUL. These are the Sustainable Development Goals identified by the author(s) for this publication. For more detailed information on the Sustainable Development Goals, click here.