Publication in conference proceedings
Automating the Classification of Smart Tourism Tools with LLMs: A Taxonomy-Driven Approach
Diogo Cosme (Cosme, D.); Fernando Batista (Batista, F.); António Miguel Portugal Galvão (Galvão, A.); Fernando Brito e Abreu (Brito e Abreu, F.);
Proceedings of the 15th Symposium on Languages, Applications and Technologies (SLATE 2026)
Year (definitive publication)
2026
Language
English
Country
Germany
More Information
Web of Science®

This publication is not indexed in Web of Science®

Scopus

This publication is not indexed in Scopus

Google Scholar

This publication is not indexed in Google Scholar

This publication is not indexed in Overton

Abstract
Smart Tourism Tools (STTs) are digital solutions that support tourism stakeholders in designing, managing, promoting, and enhancing tourism experiences. As the number and diversity of these tools increase, consistent classification becomes essential for organizing them in observatory-like repositories and making them easier to search, compare, and reuse. However, previous attempts to classify STTs using Large Language Models (LLMs) showed that broad taxonomy descriptions can lead to subjective and inconsistent interpretations. This paper proposes an improved STT classification framework that operationalizes the original taxonomy as a set of binary classification questions. Each taxonomy category is represented by a yes/no question, making the classification process more explicit, traceable, and easier to analyze. The taxonomy is also refined by renaming selected action domains and categories and removing one low-utility category. An exploratory evaluation was conducted using 100 randomly selected English-language STT descriptions and three state-of-the-art LLMs. A randomly selected subset of 20 examples was validated by a human expert. The results suggest that the proposed framework can support LLM-based classification with substantial alignment to expert judgment, while also revealing remaining challenges related to over-classification and ambiguous category boundaries. The paper contributes a more transparent and reproducible framework for classifying STTs and provides initial evidence of its feasibility for semi-automatic classification in smart tourism observatories.
Acknowledgements
--
Keywords
Language Models (LMs),Multi-Label Learning,Domain-Specific NLP,Taxonomy Alignment,Smart Tourism Systems
  • Computer and Information Sciences - Natural Sciences
  • Languages and Literature - Humanities
Funding Records
Funding Reference Funding Entity
2024.07579.IACDC/2024 FCT – Fundação para a Ciência e a Tecnologia, I.P., under PRR – Plano de Recuperação e Resiliência funding, investment RE-C05-i08 – Ciência Mais Digital
INESC-ID projects UID/50021/2025 and UID/PRR/50021/2025 Portuguese Foundation for Science and Technology
ISTAR-Iscte Pluriannual Project UID/04466/2025 Portuguese Foundation for Science and Technology

With the objective to increase the research activity directed towards the achievement of the United Nations 2030 Sustainable Development Goals, the possibility of associating scientific publications with the Sustainable Development Goals is now available in Ciência_Iscte. These are the Sustainable Development Goals identified by the author(s) for this publication. For more detailed information on the Sustainable Development Goals, click here.