Scientific journal paper Q2
Musical control gestures in mobile handheld devices: Design guidelines informed by daily user experience
Alexandre Clément (Clément, A.); Luciano Moreira (Moreira, L.); Miriam Henriques Rosa (Rosa, M.); Gilberto Bernardes (Bernardes, G.);
Journal Title
Multimodal Technologies and Interaction
Year (definitive publication)
2021
Language
English
Country
Switzerland
More Information
Web of Science®

Times Cited: 3

(Last checked: 2024-10-01 07:16)

View record in Web of Science®


: 1.2
Scopus

Times Cited: 2

(Last checked: 2024-09-29 07:45)

View record in Scopus


: 0.2
Google Scholar

Times Cited: 4

(Last checked: 2024-10-01 08:28)

View record in Google Scholar

Abstract
Mobile handheld devices, such as smartphones and tablets, have become some of the most prominent ubiquitous terminals within the information and communication technology landscape. Their transformative power within the digital music domain changed the music ecosystem from production to distribution and consumption. Of interest here is the ever-expanding number of mobile music applications. Despite their growing popularity, their design in terms of interaction perception and control is highly arbitrary. It remains poorly addressed in related literature and lacks a clear, systematized approach. In this context, our paper aims to provide the first steps towards defining guidelines for optimal sonic interaction design practices in mobile music applications. Our design approach is informed by user data in appropriating mobile handheld devices. We conducted an experiment to learn links between control gestures and musical parameters, such as pitch, duration, and amplitude. A twofold action—reflection protocol and tool-set for evaluating the aforementioned links—are also proposed. The results collected from the experiment show statistically significant trends in pitch and duration control gesture mappings. On the other hand, amplitude appears to elicit a more diverse mapping approach, showing no definitive trend in this experiment.
Acknowledgements
--
Keywords
Digital musical instruments,Interaction,Instrument control,Musical gesture,Smartphone,Human computer interaction
  • Computer and Information Sciences - Natural Sciences
  • Basic Medicine - Medical and Health Sciences
  • Psychology - Social Sciences
Funding Records
Funding Reference Funding Entity
UIDB/03125/2020 Fundação para a Ciência e a Tecnologia
DL 57/2016/CP1359/CT0027 Fundação para a Ciência e a Tecnologia
PD/BD/128230/2016 Fundação para a Ciência e a Tecnologia
PTDC/CED-EDG/31480/2017 Fundação para a Ciência e a Tecnologia
UIDB/00081/2020 Fundação para a Ciência e a Tecnologia

With the objective to increase the research activity directed towards the achievement of the United Nations 2030 Sustainable Development Goals, the possibility of associating scientific publications with the Sustainable Development Goals is now available in Ciência-IUL. These are the Sustainable Development Goals identified by the author(s) for this publication. For more detailed information on the Sustainable Development Goals, click here.