A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality.
Tools
Tools
Jin, Yunshui, Ma, Minhua 
ORCID: https://orcid.org/0000-0001-7451-546X and Zhu, Yongning ORCID: https://orcid.org/0000-0003-4413-9226
(2021)
A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality.
Multimedia tools and applications, 81.
pp. 1-32.
ISSN 1573-7721
Preview |
Text
article.pdf - Published Version Available under License Creative Commons Attribution. Download (3MB) | Preview |
Abstract / Summary
Over the years, the various mediums available for storytelling have progressively expanded, from spoken to written word, then to film, and now to Virtual Reality (VR) and Augmented Reality (AR). In 2016, the cutting-edge Head-Mounted Display (HMD) AR Microsoft HoloLens was released. However, though it has been several years, the quality of the user experience with narration using HMD-based AR technology has been rarely discussed. The present study explored interactive narrative in HMD-based AR regarding different user interfaces and their influence on users' presence, narrative engagement and reflection. Inspired by an existing exhibition at the National Holocaust Centre and Museum in the U.K., a HoloLens narrative application, entitled The AR Journey, was developed by the authors using two different interaction methods, Natural User Interface (NUI) and Graphical User Interface (GUI), which were used to perform an empirical study. As revealed from the results of the between-subject design experiment, NUI exhibited statistically significant advantages in creating presence for users without 3D Role Playing Game (RPG) experience, and GUI was superior in creating presence and increasing narrative engagement for users with 3D RPG experience. As indicated by the results of the interviews, the overall narrative experience in HMD-based AR was acceptable, and the branching narrative design was engaging. However, HoloLens hardware issues, as well as virtuality and reality mismatch, adversely affected user experience. Design guidelines were proposed according to the qualitative results.<h4>Supplementary information</h4>The online version contains supplementary material available at 10.1007/s11042-021-11723-0.
| Item Type: | Article |
|---|---|
| Identification Number: | 10.1007/s11042-021-11723-0 |
| Additional Information: | ** From Europe PMC via Jisc Publications Router ** History: ppub 01-12-2021; epub 30-12-2021. |
| Uncontrolled Keywords: | Presence, Augmented Reality (Ar), Narrative Engagement, Hololens, Natural User Interface (Nui), Interactive Narrative, Game Experience, Head Mounted Display (Hmd) |
| ISSN: | 1573-7721 |
| Subjects: | Computer Science, Information & General Works |
| Related URLs: | |
| SWORD Depositor: | Mr Pub Router |
| Depositing User: | Mr Pub Router |
| Date Deposited: | 18 Jul 2022 14:59 |
| Last Modified: | 11 Nov 2022 16:19 |
| URI: | https://repository.falmouth.ac.uk/id/eprint/4488 |
Actions
 |
View Item (login required) |