Scientific journal paper Q1
A deep learning classifier for sentence classification in biomedical and computer science abstracts
Sérgio Gonçalves (Gonçalves, S.); Paulo Cortez (Cortez, P.); Sérgio Moro (Moro, S.);
Journal Title
Neural Computing and Applications
Year (definitive publication)
2020
Language
English
Country
Germany
More Information
Web of Science®

Times Cited: 26

(Last checked: 2024-05-19 06:56)

View record in Web of Science®


: 1.1
Scopus

Times Cited: 30

(Last checked: 2024-05-14 17:42)

View record in Scopus


: 1.2
Google Scholar

Times Cited: 55

(Last checked: 2024-05-14 13:30)

View record in Google Scholar

Abstract
The automatic classification of abstract sentences into its main elements (background, objectives, methods, results, conclusions) is a key tool to support scientific database querying, to summarize relevant literature works and to assist in the writing of new abstracts. In this paper, we propose a novel deep learning approach based on a convolutional layer and a bidirectional gated recurrent unit to classify sentences of abstracts. First, the proposed neural network was tested on a publicly available repository containing 20 thousand abstracts from the biomedical domain. Competitive results were achieved, with weight-averaged Precision, Recall and F1-score values around 91%, and an area under the ROC curve (AUC) of 99%, which are higher when compared to a state-of-the-art neural network. Then, a crowdsourcing approach using gamification was adopted to create a new comprehensive set of 4111 classified sentences from the computer science domain, focused on social media abstracts. The results of applying the same deep learning modeling technique trained with 3287 (80%) of the available sentences were below the ones obtained for the larger biomedical dataset, with weight-averaged Precision, Recall and F1-score values between 73 and 76%, and an AUC of 91%. Considering the dataset dimension as a likely important factor for such performance decrease, a data augmentation approach was further applied. This involved the use of text mining to translate sentences of the computer science abstract corpus while retaining the same meaning. Such approach resulted in slight improvements (around 2 percentage points) for the weight-averaged Recall and F1-score values.
Acknowledgements
--
Keywords
Bidirectional gated recurrent unit,Abstract sentence classification,Deep learning,Crowdsourcing
  • Computer and Information Sciences - Natural Sciences
Funding Records
Funding Reference Funding Entity
UID/CEC/00319/2019 Fundação para a Ciência e a Tecnologia
UID/MULTI/0446/2013 Fundação para a Ciência e a Tecnologia

With the objective to increase the research activity directed towards the achievement of the United Nations 2030 Sustainable Development Goals, the possibility of associating scientific publications with the Sustainable Development Goals is now available in Ciência-IUL. These are the Sustainable Development Goals identified by the author(s) for this publication. For more detailed information on the Sustainable Development Goals, click here.