Reactive Statistical Mapping: Towards the Sketching of Performative Control with Data - Innovative and Creative Developments in Multimodal Interaction Systems (eNTERFACE 2013) Access content directly
Conference Papers Year : 2014

Reactive Statistical Mapping: Towards the Sketching of Performative Control with Data

Abstract

This paper presents the results of our participation to the ninth eNTERFACE workshop on multimodal user interfaces. Our target for this workshop was to bring some technologies currently used in speech recognition and synthesis to a new level, i.e. being the core of a new HMM-based mapping system. The idea of statistical mapping has been investigated, more precisely how to use Gaussian Mixture Models and Hidden Markov Models for realtime and reactive generation of new trajectories from inputted labels and for realtime regression in a continuous-to-continuous use case. As a result, we have developed several proofs of concept, including an incremental speech synthesiser, a software for exploring stylistic spaces for gait and facial motion in realtime, a reactive audiovisual laughter and a prototype demonstrating the realtime reconstruction of lower body gait motion strictly from upper body motion, with conservation of the stylistic properties. This project has been the opportunity to formalise HMM-based mapping, integrate various of these innovations into the Mage library and explore the development of a realtime gesture recognition tool.
Fichier principal
Vignette du fichier
978-3-642-55143-7_2_Chapter.pdf (2.21 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01134574 , version 1 (01-08-2016)

Identifiers

Cite

Nicolas D’alessandro, Joëlle Tilmanne, Maria Astrinaki, Thomas Hueber, Rasmus Dall, et al.. Reactive Statistical Mapping: Towards the Sketching of Performative Control with Data. eNTERFACE - 9th International Summer Workshop on Multimodal Interfaces (eNTERFACE), Jul 2013, Lisbonne, Portugal. pp.20-49, ⟨10.1007/978-3-642-55143-7_2⟩. ⟨hal-01134574⟩
654 View
111 Download

Altmetric

Share

Gmail Facebook X LinkedIn More