Scientific journal paper Q1
Assessing the coding reliability of work accidents statistical data: how coders make a difference
Celeste Jacinto (Jacinto, C.); Fernando P. Santos (Santos, F. P.); Guedes Soares, C. (Soares, C. G.); Sílvia Agostinho da Silva (Silva, S. A.);
Journal Title
Journal of Safety Research
Year (definitive publication)
2016
Language
English
Country
United Kingdom
More Information
Web of Science®

Times Cited: 19

(Last checked: 2024-07-21 16:33)

View record in Web of Science®


: 0.7
Scopus

Times Cited: 15

(Last checked: 2024-07-21 13:06)

View record in Scopus


: 0.5
Google Scholar

Times Cited: 25

(Last checked: 2024-07-17 17:32)

View record in Google Scholar

Abstract
Introduction: This study assesses the reliability of the coding procedure for a set of variables belonging to the European Statistics of Accidents at Work (ESAW). The work focused on the Portuguese data and experience with the system. In Portugal, this task has been systematically carried out by GEP (the governmental Cabinet for Strategy and Planning), here defined as the “reference group” or “expert group”. However, it is anticipated that this coding task will be performed by non-expert people, since paper-forms will be replaced by e-forms, similarly to what happened in a few EU countries. Objective: This study aims to: 1) assess the current situation, i.e., to quantify reliability of data coded by GEP (reference group), and 2) assess the impact on the reliability level when the coding is carried out by non-experts (two different groups of coders). Methods: The study comprises the estimation of both intercoder and intracoder reliability for a set of 8 nominal variables. The assessment applies 3 reliability coefficients calculated by 3 software packages. Results: The results reveal that the expert group (GEP) holds good to excellent reliability (inter- and intracoder agreements), between 68-98%, while there is a considerable “loss of reliability” (-5% to -39%) when the coding process is transferred to other people, without special training or knowledge in this task. Conclusions: this work gives quantified evidence that reliability of coding accident data is substantially affected by the coders’ profile. Moreover, certain variables, regardless of the coder, systematically hold a higher level of coding reliability than others, suggesting that certain codes may need improvement. Future studies should assess coding quality across the EU countries using the ESAW protocol. Practical Applications: directions for improving the quality of accident data and related statistics; data that is used by researchers and governmental decision-makers to derive prevention strategies.
Acknowledgements
--
Keywords
Accident data,Content analysis,Reliability coefficients,Intercoder reliability,ESAW variables
  • Psychology - Social Sciences
  • Social and Economic Geography - Social Sciences
  • Other Social Sciences - Social Sciences
Funding Records
Funding Reference Funding Entity
PTDC/SDE/71193/2006 Fundação para a Ciência e a Tecnologia
UID/GES/00315/2013 Fundação para a Ciência e a Tecnologia
Related Projects

With the objective to increase the research activity directed towards the achievement of the United Nations 2030 Sustainable Development Goals, the possibility of associating scientific publications with the Sustainable Development Goals is now available in Ciência-IUL. These are the Sustainable Development Goals identified by the author(s) for this publication. For more detailed information on the Sustainable Development Goals, click here.