Ciência-IUL
Publications
Publication Detailed Description
Musical control gestures in mobile handheld devices: Design guidelines informed by daily user experience
Journal Title
Multimodal Technologies and Interaction
Year (definitive publication)
2021
Language
English
Country
Switzerland
More Information
Web of Science®
Scopus
Google Scholar
Abstract
Mobile handheld devices, such as smartphones and tablets, have become some of the most prominent ubiquitous terminals within the information and communication technology landscape. Their transformative power within the digital music domain changed the music ecosystem from production to distribution and consumption. Of interest here is the ever-expanding number of mobile music applications. Despite their growing popularity, their design in terms of interaction perception and control is highly arbitrary. It remains poorly addressed in related literature and lacks a clear, systematized approach. In this context, our paper aims to provide the first steps towards defining guidelines for optimal sonic interaction design practices in mobile music applications. Our design approach is informed by user data in appropriating mobile handheld devices. We conducted an experiment to learn links between control gestures and musical parameters, such as pitch, duration, and amplitude. A twofold action—reflection protocol and tool-set for evaluating the aforementioned links—are also proposed. The results collected from the experiment show statistically significant trends in pitch and duration control gesture mappings. On the other hand, amplitude appears to elicit a more diverse mapping approach, showing no definitive trend in this experiment.
Acknowledgements
--
Keywords
Digital musical instruments,Interaction,Instrument control,Musical gesture,Smartphone,Human computer interaction
Fields of Science and Technology Classification
- Computer and Information Sciences - Natural Sciences
- Basic Medicine - Medical and Health Sciences
- Psychology - Social Sciences
Funding Records
Funding Reference | Funding Entity |
---|---|
UIDB/03125/2020 | Fundação para a Ciência e a Tecnologia |
DL 57/2016/CP1359/CT0027 | Fundação para a Ciência e a Tecnologia |
PD/BD/128230/2016 | Fundação para a Ciência e a Tecnologia |
PTDC/CED-EDG/31480/2017 | Fundação para a Ciência e a Tecnologia |
UIDB/00081/2020 | Fundação para a Ciência e a Tecnologia |
Contributions to the Sustainable Development Goals of the United Nations
With the objective to increase the research activity directed towards the achievement of the United Nations 2030 Sustainable Development Goals, the possibility of associating scientific publications with the Sustainable Development Goals is now available in Ciência-IUL. These are the Sustainable Development Goals identified by the author(s) for this publication. For more detailed information on the Sustainable Development Goals, click here.