51ÖØ¿ÚÁÔÆæ

The browser you are using is not supported by this website. All versions of Internet Explorer are no longer supported, either by us or Microsoft (read more here: ).

Please use a modern browser to fully experience our website, such as the newest versions of Edge, Chrome, Firefox or Safari etc.

Motion capture-based animated characters for the study of speech-gesture integration

Author

Summary, in English

Digitally animated characters are promising tools in research studying how we integrate information from speech and visual sources such as gestures because they allow specific gesture features to be manipulated in isolation. We present an approach combining motion capture and 3D-animated characters that allows us to manipulate natural individual gesture strokes for experimental purposes, for example to temporally shift and present gestures in ecologically valid sequences. We exemplify how such stimuli can be used in an experiment investigating implicit detection of speech–gesture (a) synchrony, and discuss the general applicability of the workflow for research in this domain.

Publishing year

2020-06

Language

English

Pages

1339-1354

Publication/Series

Behavior Research Methods

Volume

52

Issue

3

Links

Document type

Journal article

Publisher

Springer

Topic

  • Other Social Sciences not elsewhere specified
  • Comparative Language Studies and Linguistics

Keywords

  • Crossmodal information processing
  • Gesture
  • Speech-gesture integration
  • Motion Capture
  • gesture
  • multimodal information processing
  • Method development
  • Motion Capture
  • Crossmodal information processing
  • Speech-gesture integration

Status

Published

Research group

  • The Educational Technology Group
  • Communication and Cognition

ISBN/ISSN/Other

  • ISSN: 1554-3528