Publication in conference proceedings
Studying the GenAI’s Impact on Learning and Critical Thinking: A Multi-Site Field Experiment
Isabel Ramos (Ramos, I.); Anabela Mesquita (Mesquita, A.); António Luís Lopes (Lopes, A. L.); Fernando Moreira (Moreira, F.); Victor Barros (Barros, V.); Rui Dinis de Sousa (Sousa, R. D.); Gonçalo Regadas (Regadas, G.); Luís Gomes (Gomes, L.); Patrícia Leite (Leite, P.); et al.
ICIS 2025 Proceedings
Year (definitive publication)
2025
Language
English
Country
United States of America
More Information
Web of Science®

This publication is not indexed in Web of Science®

Scopus

This publication is not indexed in Scopus

Google Scholar

This publication is not indexed in Google Scholar

This publication is not indexed in Overton

Abstract
Generative AI (GenAI) tools are transforming higher education, but robust evidence of their pedagogical value is limited. This multi-site field experiment, based on Situated Cognition Theory, explores the impact of GenAI on learning and critical thinking at ten universities and polytechnics. Around 270 students were randomly assigned to an experimental group using licensed ChatGPT for a supervised task, or a control group using traditional resources. Tasks, aligned with local learning outcomes, were evaluated using a rubric assessing critical thinking, accuracy, coherence, and originality. Classroom observations and a post-task questionnaire further enriched the analysis. Preliminary results indicate that ChatGPT enhanced content comprehension and motivation, but many students struggled with evaluating AI reliability and creating effective prompts.
Acknowledgements
--
Keywords
Generative AI,ChatGPT,Higher Education,Critical Thinking,Information Systems Educations
  • Computer and Information Sciences - Natural Sciences
  • Educational Sciences - Social Sciences

With the objective to increase the research activity directed towards the achievement of the United Nations 2030 Sustainable Development Goals, the possibility of associating scientific publications with the Sustainable Development Goals is now available in Ciência_Iscte. These are the Sustainable Development Goals identified by the author(s) for this publication. For more detailed information on the Sustainable Development Goals, click here.