Scientific journal paper Q1
Examining the generalizability of research findings from archival data
Andrew Delios (Delios, A.); Elena Giulia Clemente (Clemente, E. G.); Tao Wu (Wu, T.); Hongbin Tan (Tan, H.); Yong Wang (Wang, Y); Michael Gordon (Gordon, M.); Domenico Viganola (Viganola, D.); Zhaowei Chen (Chen, Z.); Anna Dreber (Dreber, A.); Magnus Johannesson (Johannesson, M.); Thomas Pfeiffer (Pfeiffer, T.); Eric Luis Uhlmann (Uhlmann, E. L.); Marcio Amaral-Baptista (Amaral-Baptista, M.); Joshua D. Wright (Wright, J. D.); Qiong Xia (Xia, Q.); Zhenzhen Xie (Xie, Z.); Sangsuk Yoon (Yoon, S.); Wenlong Yuan (Yuan, W.); Lin Yuan (Yuan, L.); Generalizability Tests Forecasting Collaboration (Generalizability Tests Forecasting Collaboration); et al.
Journal Title
Proceedings of the National Academy of Sciences of the United States of America
Year (definitive publication)
2022
Language
English
Country
United States of America
More Information
Web of Science®

Times Cited: 0

(Last checked: 2024-07-02 06:26)

View record in Web of Science®

Scopus

Times Cited: 15

(Last checked: 2024-06-28 14:12)

View record in Scopus


: 0.8
Google Scholar

Times Cited: 37

(Last checked: 2024-06-30 03:55)

View record in Google Scholar

Abstract
This initiative examined systematically the extent to which a large set of archival research findings generalizes across contexts. We repeated the key analyses for 29 original strategic management effects in the same context (direct reproduction) as well as in 52 novel time periods and geographies; 45% of the reproductions returned results matching the original reports together with 55% of tests in different spans of years and 40% of tests in novel geographies. Some original findings were associated with multiple new tests. Reproducibility was the best predictor of generalizability-for the findings that proved directly reproducible, 84% emerged in other available time periods and 57% emerged in other geographies. Overall, only limited empirical evidence emerged for context sensitivity. In a forecasting survey, independent scientists were able to anticipate which effects would find support in tests in new samples.
Acknowledgements
--
Keywords
  • Economics and Business - Social Sciences
Funding Records
Funding Reference Funding Entity
72002158 National Natural Science Foundation of China
R-313-000-131-115 Ministry of Educatiob, Singapore
SFB F63 Austrian Science Fund

With the objective to increase the research activity directed towards the achievement of the United Nations 2030 Sustainable Development Goals, the possibility of associating scientific publications with the Sustainable Development Goals is now available in Ciência-IUL. These are the Sustainable Development Goals identified by the author(s) for this publication. For more detailed information on the Sustainable Development Goals, click here.