BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesis [PDF]
Achieving realistic, vivid, and human-like synthesized conversational gestures conditioned on multi-modal data is still an unsolved problem due to the lack of available datasets, models and standard evaluation metrics.
Haiyang Liu +7 more
semanticscholar +1 more source
Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agents**This work has been supported in part by ARO Grants W911NF1910069 and W911NF1910315, and Intel. Code and additional materials available at: https://gamma.umd.edu/t2g [PDF]
We present Text2Gestures, a transformer-based learning method to interactively generate emotive full-body gestures for virtual agents aligned with natural language text inputs.
Uttaran Bhattacharya +5 more
semanticscholar +1 more source
Learning Speech-driven 3D Conversational Gestures from Video [PDF]
We propose the first approach to synthesize the synchronous 3D conversational body and hand gestures, as well as 3D face and head animations, of a virtual character from speech input.
I. Habibie +7 more
semanticscholar +1 more source
Speech2AffectiveGestures: Synthesizing Co-Speech Gestures with Generative Adversarial Affective Expression Learning [PDF]
We present a generative adversarial network to synthesize 3D pose sequences of co-speech upper-body gestures with appropriate affective expressions. Our network consists of two components: a generator to synthesize gestures from a joint embedding space ...
Uttaran Bhattacharya +3 more
semanticscholar +1 more source
SMG: A Micro-gesture Dataset Towards Spontaneous Body Gestures for Emotional Stress State Analysis
We explore using body gestures for hidden emotional state analysis. As an important non-verbal communicative fashion, human body gestures are capable of conveying emotional information during social communication.
Haoyu Chen +4 more
semanticscholar +1 more source
Exploring the user experience (UX) of a multi-window augmented reality environment
Augmented reality is an emergent form of technology that allows users to interact with and manipulate virtual objects and information integrated into the physical environment.
Pitch Sinlapanuntakul +2 more
doaj +1 more source
Based on three Portuguese romances of chivalry, the Crónica do Imperador Clarimundo (1522), the Palmeirim de Inglaterra (c. 1544) and the Memorial das Proezas da Segunda Távola Redonda (1567), this article presents a study of married and widowed women in
Pedro Monteiro
doaj +1 more source
Gesture and Liturgical Gesture [PDF]
The usual interpretations of gestuality presuppose that a gesture accompanies the expressive action, whereby it itself almost disappears, in order to make way for what the person gesturing wants to show as appertaining to his or her interiority. The intention of the present paper is to demonstrate how a gesture cannot be considered as something ...
openaire +2 more sources
Referential gestures emerge early during children’s development. Growing up, they gradually master several multimodal resources and elaborate more complex discourse, using referring expressions often accompanied by gestures that increasingly correspond ...
Corrado Bellifemine, Camille Dupret
doaj +1 more source
Grasping gestures: Gesturing with physical artifacts [PDF]
AbstractGestures play an important role in communication. They support the listener, who is trying to understand the speaker. However, they also support the speaker by facilitating the conceptualization and verbalization of messages and reducing cognitive load. Gestures thus play an important role in collaboration and also in problem-solving tasks.
Elise van den Hoven, Ali Mazalek
openaire +2 more sources

