Results 281 to 290 of about 7,003,244 (332)

Full-Duplex-Bench: A Benchmark to Evaluate Full-Duplex Spoken Dialogue Models on Turn-taking Capabilities

Automatic Speech Recognition & Understanding
Spoken dialogue modeling poses challenges beyond text-based language modeling, requiring real-time interaction, turn-taking, and backchanneling. While most Spoken Dialogue Models (SDMs) operate in half-duplex mode—processing one turn at a time—emerging ...
Guan-Ting Lin, Jiachen Lian, Tingle Li, Qirui Wang, G. Anumanchipalli, Alexander H. Liu, Hung-yi Lee   +6 more
semanticscholar   +1 more source

Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics

International Conference on Learning Representations
The recent wave of audio foundation models (FMs) could provide new capabilities for conversational modeling. However, there have been limited efforts to evaluate these audio FMs comprehensively on their ability to have natural and interactive ...
Siddhant Arora, Zhiyun Lu, Chung-Cheng Chiu, Ruoming Pang, Shinji Watanabe   +4 more
semanticscholar   +1 more source

Organization of turn-taking and mechanisms for turn-taking repairs in a chaired meeting

Journal of Pragmatics, 1993
Abstract In their famous article published in 1974, Sacks, Schegloff, and Jefferson studied the organization of turn-taking in conversations, and proposed a model alleged to be both context- and content- independent. However, they evoke specific exchange formats where the system of rules in effect is obviously not the one described in the model ...
Janine Larrue, Alain Trognon
openaire   +1 more source

Easy Turn: Integrating Acoustic and Linguistic Modalities for Robust Turn-Taking in Full-Duplex Spoken Dialogue Systems

IEEE International Conference on Acoustics, Speech, and Signal Processing
Full-duplex interaction is crucial for natural human-machine communication, yet remains challenging as it requires robust turn-taking detection to decide when the system should speak, listen, or remain silent.
Guojian Li, Chengyou Wang, Hongfei Xue, Shuiyuan Wang, Dehui Gao, Zihan Zhang, Yuke Lin, Wenjie Li, Longshuai Xiao, Zhonghua Fu, Lei Xie   +10 more
semanticscholar   +1 more source

Multilingual Turn-taking Prediction Using Voice Activity Projection

International Conference on Language Resources and Evaluation
This paper investigates the application of voice activity projection (VAP), a predictive turn-taking model for spoken dialogue, on multilingual data, encompassing English, Mandarin, and Japanese.
K. Inoue, Bing'er Jiang, Erik Ekstedt, Tatsuya Kawahara, G. Skantze   +4 more
semanticscholar   +1 more source

Real-time and Continuous Turn-taking Prediction Using Voice Activity Projection

arXiv.org
A demonstration of a real-time and continuous turn-taking prediction system is presented. The system is based on a voice activity projection (VAP) model, which directly maps dialogue stereo audio to future voice activities.
K. Inoue, Bing'er Jiang, Erik Ekstedt, Tatsuya Kawahara, G. Skantze   +4 more
semanticscholar   +1 more source

Turn / Turn Taking

, 2010
Ohm U. Turn / Turn Taking. In: Barkowski H, Krumm H-J, eds. Fachlexikon Deutsch als Fremd- und Zweitsprache. UTB. Vol 8422 : Sprachwissenschaft.
Ohm, Udo, Barkowski, Hans, Krumm, Hans-Jürgen   +2 more
openaire   +2 more sources

Categorizing Turn-Taking Interactions

2012
We address the problem of categorizing turn-taking interactions between individuals. Social interactions are characterized by turn-taking and arise frequently in real-world videos. Our approach is based on the use of temporal causal analysis to decompose a space-time visual word representation of video into co-occuring independent segments, called ...
Karthir Prabhakar, James M. Rehg
openaire   +2 more sources

Turn-taking in office

Constitutional Political Economy, 2020
This paper provides a theoretical explanation for the adoption of turn-taking in office. Turn-taking in office is where two or more individuals are elected to serve individual terms for the same public office, with the exclusive right to exercise the public office rotating among those elected individuals at intervals shorter than the term.
openaire   +1 more source

Turn-Taking in Shakespeare

Voice and Speech Review, 2020
Dr. Oliver Morgan, at the end of Turn-taking in Shakespeare, writes “This book has been a success if it sends the reader back to Shakespeare with a heightened sensitivity to dramatic dialogue—more ...
openaire   +1 more source