Designing Interactions with Intention-Aware Gaze-Enabled Artificial Agents - Human-Computer Interaction – INTERACT 2019 Access content directly
Conference Papers Year : 2019

Designing Interactions with Intention-Aware Gaze-Enabled Artificial Agents


As it becomes more common for humans to work alongside artificial agents on everyday tasks, it is increasingly important to design artificial agents that can understand and interact with their human counterparts naturally. We posit that an effective way to do this is to harness nonverbal cues used in human-human interaction. We, therefore, leverage knowledge from existing work on gaze-based intention recognition, where the awareness of gaze can provide insights into the future actions of an observed human subject. In this paper, we design and evaluate the use of a proactive intention-aware gaze-enabled artificial agent that assists a human player engaged in an online strategy game. The agent assists by recognising and communicating the intentions of a human opponent in real-time, potentially improving situation awareness. Our first study identifies the language requirements for the artificial agent to communicate the opponent’s intentions to the assisted player, using an inverted Wizard of Oz method approach. Our second study compares the experience of playing an online strategy game with and without the assistance of the agent. Specifically, we conducted a within-subjects study with 30 participants to compare their experience of playing with (1) detailed AI predictions, (2) abstract AI predictions, and (3) no AI predictions but with a live visualisation of their opponent’s gaze. Our results show that the agent can facilitate awareness of another user’s intentions without adding visual distraction to the interface; however, the cognitive workload was similar across all three conditions, suggesting that the manner in which the agent communicates its predictions requires further exploration. Overall, our work contributes to the understanding of how to support human-agent teams in a dynamic collaboration scenario. We provide a positive account of humans interacting with an intention-aware artificial agent afforded by gaze input, which presents immediate opportunities for improving interactions between the counterparts.
Fichier principal
Vignette du fichier
488591_1_En_17_Chapter.pdf (1.96 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02544628 , version 1 (16-04-2020)





Joshua Newn, Ronal Singh, Fraser Allison, Prashan Madumal, Eduardo Velloso, et al.. Designing Interactions with Intention-Aware Gaze-Enabled Artificial Agents. 17th IFIP Conference on Human-Computer Interaction (INTERACT), Sep 2019, Paphos, Cyprus. pp.255-281, ⟨10.1007/978-3-030-29384-0_17⟩. ⟨hal-02544628⟩
51 View
86 Download



Gmail Facebook X LinkedIn More