Software Support for Coherent Prototyping of 3D Gesture Interactions - Human-Centered Software Engineering Access content directly
Conference Papers Year : 2019

Software Support for Coherent Prototyping of 3D Gesture Interactions

Dominik Rupprecht
  • Function : Author
  • PersonId : 1052751
Rainer Blum
  • Function : Author
  • PersonId : 1052752
Birgit Bomsdorf
  • Function : Author
  • PersonId : 1052753


When prototyping applications that include touchless 3D gesture interaction three design matters must be taken into consideration: the gestures the user must execute, the visual representation and the dialog flow. Ideally, these aspects should be considered in parallel, to achieve a coherent design process, and avoid ineffective extra effort stemming from coordination between them. A flexible changeover of perspectives among the separate matters is needed. This paper proposes a software environment that enables the desired coherent rapid prototyping of applications with 3D gesture interactions. Its core consists of two types of mapping and a so-called co-simulation functionality. The environment facilitates combining existing software tools from industry and literature to cover the three design matters, i.e. specification and simulation of UI prototypes, gestures, and dialog models. It assists developers at design time in the specification of gestures and in binding them to UI prototypes as well as to statecharts used for defining dialog models. Relevant coherency information is used to offer the option to evaluate gestures at runtime in the context of UI prototype and dialog model. The co-simulator manages the synchronized simulation of all relevant artefacts once a gesture event occurs. Therefore, it enables quickly building prototypes that go beyond the capabilities of the individual tools. This paper describes the usage of the proposed environment in form of a case study with several software tools, each covering one of the three design aspects. It also shows its general applicability, meaning that it can be used with other tools too.
Fichier principal
Vignette du fichier
465452_1_En_12_Chapter.pdf (354.34 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02270720 , version 1 (26-08-2019)





Dominik Rupprecht, Rainer Blum, Birgit Bomsdorf. Software Support for Coherent Prototyping of 3D Gesture Interactions. 7th International Conference on Human-Centred Software Engineering (HCSE), Sep 2018, Sophia Antipolis, France. pp.207-218, ⟨10.1007/978-3-030-05909-5_12⟩. ⟨hal-02270720⟩
90 View
13 Download



Gmail Facebook X LinkedIn More