Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models
Advanced Robotics Research, EarlyView.A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki +2 more
wiley +1 more source
Characterizing covert articulation in apraxic speech using real-time MRI
, 2012 We explore the use of real-time magnetic resonance imaging (rtMRI) as a tool to investigate apraxic speech, in particular, by examining articulatory behavior.
Gorno Tempini, Maria Luisa +4 more
core
Task-State fMRI-Derived Whole-Brain Functional Topology-Constrained Spiking Neural Network with an Embedded Auditory Core Circuit for Speech Recognition. [PDF]
Biomimetics (Basel)Guo L, Yang Y.
europepmc +1 more source
LLM‐Integrated Human–Robot Interaction System for Microrobots
Advanced Robotics Research, EarlyView.This paper proposes an LLM‐based control framework for guiding microrobots using human natural language. This framework can convert the natural human speech into safe and executable command sets for reliable navigation in complex environments. The experimental results show high accuracy and robustness in task performance, demonstrating the potential of
Bairong Zhu, Amar Salehi, Tingting Yu
wiley +1 more source
Effects of Hearing Aids in a Simulated Open-Plan Office: A Laboratory Study Involving Normal-Hearing Participants and Simulated Hearing Loss. [PDF]
Noise HealthBrocolini L +6 more
europepmc +1 more source
Advanced Robotics Research, EarlyView.This work presents the MicroRoboScope, a highly integrated, compact, and portable microrobotic experimentation platform combining electromagnetic and acoustic actuation with real‐time visual feedback into a single, end‐to‐end device. The system enables closed‐loop control and tracking algorithm experimentation within an accessible and unified hardware ...
Max Sokolich +4 more
wiley +1 more source
Reservoir computing-based cryptanalysis of structured phase-masked chaos encryption. [PDF]
Sci RepTosyali E, Oniz Y.
europepmc +1 more source
Advanced Robotics Research, EarlyView.This review maps the methods to monitor robots’ health by fusing vibration, sound, control signals, vision, force, and oil information with artificial intelligence. It identifies deep learning, transfer learning, digital twins, and physics‐informed models as key methodological pathways enabling earlier diagnosis, safer human–robot collaboration, and ...
Yuting Qiao +6 more
wiley +1 more source
Gaps and Future Directions in the Research About Masking and Voice Production: Bibliometric Analysis, Systematic Literature Review, and Meta-analysis. [PDF]
J VoiceCantor-Cutiva LC +2 more
europepmc +1 more source
Learning‐Based Soft Robotic Grasping: Recent Progress and Remaining Challenges
Advanced Robotics Research, EarlyView.This review analyzes learning‐based soft robotic grasping from a pipeline‐oriented perspective, encompassing soft gripper design, multimodal sensing, and learning‐based planning and control. It surveys key neural network architectures and benchmark datasets and identifies critical challenges such as sim‐to‐real transfer, generalization, and continual ...
Arnab Majumder +3 more
wiley +1 more source