Tag Multimodal Interaction

User experience, performance, and social acceptability: usable multimodal mobile interaction

This thesis explores the social acceptability of multimodal interaction in public places with respect to acceptance, adoption and appropriation. Previous work in multimodal interaction has mainly focused on recognition and detection issues without thoroughly considering the willingness of users to adopt these kinds of interactions in their everyday lives.

This thesis presents a novel approach to user experience that is theoretically motivated by phenomenology, practiced with mixed-methods, and analysed based on dramaturgical metaphors. In order to explore the acceptance of multimodal interfaces, this thesis presents three studies that look at users’ initial reactions to multimodal interaction techniques: a survey study focusing on gestures, an on-the-street user study, and a follow-up survey study looking at gesture and voice-based interaction.

Related Posts:

Send Me Bubbles: Multimodal Performance and Social Acceptability

The use of performance as the focus of interaction provides the opportunity for exploratory and individual experiences but can also put users in an uncomfortable position.

This paper presents an initial user study of a mobile remote awareness application in which users can control their own fish in a virtual fish tank using multimodal input from an external sensing device, where the input styles are created and performed by participants in an open ended sensing model. The study was designed in order to better understand the issues of performance when audience members are both casual passersby and familiar others watching remotely. Additionally, this study investigated the creation of performances and the effects of props when used in different social settings. The study involved pairs of participants interacting with the system in both public and private locations over repeated sessions. The results of this study show how users created and interpreted performances as well as how their consideration of passersby influenced their experiences.

[ PDF ]

Author: Julie R. Williamson
Department: University of Glasgow, Scotland, UK

Related Posts: