Continual Learning for Multimodal Data Fusion of a Soft Gripper
Models trained on a single data modality often struggle to generalize when exposed to a different modality. This work introduces a continual learning algorithm capable of incrementally learning different data modalities by leveraging both class‐incremental and domain‐incremental learning scenarios in an artificial environment where labeled data is ...
Nilay Kushawaha, Egidio Falotico
wiley +1 more source
A perceptual approach to the composition of meaning in artificial spatial audio [PDF]
This paper describes research to inform the production of spatial audio that consolidates knowledge from several disparate fields. A perceptual model is proposed, based on contemporary perception theories, as the basis for new approaches to audio spatial
Myatt, Tony, Lennox, Peter
core
Auditory–Tactile Congruence for Synthesis of Adaptive Pain Expressions in RoboPatients
In this work, we explore auditory–tactile congruence for synthesizing adaptive vocal pain expressions in robopatients. Using a robopatient platform that integrates vocal pain sounds with palpation forces, we conducted 7680 trials across 20 participants.
Saitarun Nadipineni +4 more
wiley +1 more source
Streaming VR for Immersion: Quality Aspects of Compressed Spatial Audio [PDF]
Delivering a 360-degree soundscape that matches full sphere visuals is an essential aspect of immersive VR. Ambisonics is a full sphere surround sound technique that takes into account the azimuth and elevation of sound sources, portraying source ...
O’Leary, Sean +9 more
core +2 more sources
Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models
A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki +2 more
wiley +1 more source
Effect of Vertical Microphone Layer Spacing for a 3D Microphone Array [PDF]
Subjective listening tests were conducted to investigate how the spacing between main (lower) and height (upper) microphone layers in a 3D main microphone array affects perceived spatial impression and overall preference. Four different layer spacings of
Lee, Hyunkook, Gribben, Christopher
core +1 more source
Spatial Reconstruction-Based Rendering of Microphone Array Room Impulse Responses [PDF]
Publisher Copyright: © 2023 Audio Engineering Society. All rights reserved.A reconstruction-based rendering approach is explored for the task of imposing the spatial characteristics of a measured space onto a monophonic signal while also reproducing it ...
Leo McCormack +5 more
core +1 more source
LLM‐Integrated Human–Robot Interaction System for Microrobots
This paper proposes an LLM‐based control framework for guiding microrobots using human natural language. This framework can convert the natural human speech into safe and executable command sets for reliable navigation in complex environments. The experimental results show high accuracy and robustness in task performance, demonstrating the potential of
Bairong Zhu, Amar Salehi, Tingting Yu
wiley +1 more source
Immersive Acoustics via Next-Generation Networks: Achieving High-Fidelity Audio in the Metaverse
The rapid evolution of the Metaverse demands integrated solutions that merge advanced telecommunication networks with immersive audio technologies.
Claudia Rinaldi +6 more
doaj +1 more source
Spatial audio in small display screen devices [PDF]
Our work addresses the problem of (visual) clutter in mobile device interfaces. The solution we propose involves the translation of technique-from the graphical to the audio domain-for expliting space in information representation.
Brewster, S.A. +3 more
core +1 more source

