Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models
A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki +2 more
wiley +1 more source
LLM‐Integrated Human–Robot Interaction System for Microrobots
This paper proposes an LLM‐based control framework for guiding microrobots using human natural language. This framework can convert the natural human speech into safe and executable command sets for reliable navigation in complex environments. The experimental results show high accuracy and robustness in task performance, demonstrating the potential of
Bairong Zhu, Amar Salehi, Tingting Yu
wiley +1 more source
A Phase I Study of PF-07062119, an Anti-GUCY2C/Anti-CD3 Bispecific Fc Antibody, in Patients with Advanced Gastrointestinal Cancers. [PDF]
Fakih M +19 more
europepmc +1 more source
Light‐Driven Quadrupedal Walking Biohybrid Robot With Antagonistic Muscle‐Rings and Inclined Joints
This work presents a light‐driven quadrupedal walking biohybrid robot powered by antagonistic muscle‐rings that achieve alternating walking gait. Optical training improved reproducibility of cultured muscle tissues, while caffeine treatment enhanced contractile force.
Shotaro Saito +5 more
wiley +1 more source
Zero-shot emotional speech synthesis based on feature decoupling and adaptive loss-threshold reweighting. [PDF]
Zhu Y, Wang Y, Zhou Y, Liu B, Zhou R.
europepmc +1 more source
Learning‐Based Soft Robotic Grasping: Recent Progress and Remaining Challenges
This review analyzes learning‐based soft robotic grasping from a pipeline‐oriented perspective, encompassing soft gripper design, multimodal sensing, and learning‐based planning and control. It surveys key neural network architectures and benchmark datasets and identifies critical challenges such as sim‐to‐real transfer, generalization, and continual ...
Arnab Majumder +3 more
wiley +1 more source
Neural Sensitivity to Conversational Inter-Speaker Gaps in the Broad Autism Phenotype. [PDF]
Neo WS +5 more
europepmc +1 more source
A balanced multimodal food‐waste dataset and a novel Split Spatial‐Spectral Attention fusion framework are presented for robotic contaminant detection. Separate processing of RGB, thermal, and multispectral inputs preserves subtle material signatures before feature integration, reducing modality interference and improving classification and ...
Matthew Vestal +5 more
wiley +1 more source
Delivery and Attitude Modulate Shared Neural Processing of Speech Through Distinct Frequency Channels. [PDF]
Atia B, Berson Y, Goldstein A.
europepmc +1 more source

