Scientific journal paper
“There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI
Ilkka Kaate (Kaate, I.); Joni Salminen (Salminen, J.); João M. Santos (Santos, J. M.); Soon-Gyo Jung (Jung, S.-G.); Hind Ali Almerekhi (Almerekhi, H. A.); Bernard J. Jansen (Jansen, B. J.);
Journal Title
Computers in Human Behavior: Artificial Humans
Year (definitive publication)
2024
Language
English
Country
United States of America
More Information
Web of Science®

This publication is not indexed in Web of Science®

Scopus

This publication is not indexed in Scopus

Google Scholar

Times Cited: 6

(Last checked: 2024-11-19 10:01)

View record in Google Scholar

Abstract
Although they often have a negative connotation due to their social risks, deepfakes have the potential to improve HCI, human-centered AI, and user experience (UX). To investigate the impact of deepfakes on persona UX, we conducted an experimental study with 46 users who used a deepfake persona and a human persona to carry out a design task. We collected think-aloud, observant notes, and survey data. The results of our mixed-method analysis indicate that if users observe glitches in the deepfake personas, these glitches have a detrimental effect on the persona UX and task performance; however, not all users identify glitches. Our quantitative analysis of survey data shows that there are differences in how (a) users perceive deepfakes, (b) users detect deepfake glitches, (c) deepfake glitches affect information comprehension, and (d) deepfake glitches affect task completion. Glitches have the most significant impact on authenticity, persona perception, and task perception variables but less impact on behavioral variables. The results imply that organizations implementing deepfake personas need to address perceptual challenges before the full potential of deepfake technology can be realized for persona creation.
Acknowledgements
--
Keywords
Deepfakes,User perceptions,Human-centered AI,User study