Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models
A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki +2 more
wiley +1 more source
LLM‐Integrated Human–Robot Interaction System for Microrobots
This paper proposes an LLM‐based control framework for guiding microrobots using human natural language. This framework can convert the natural human speech into safe and executable command sets for reliable navigation in complex environments. The experimental results show high accuracy and robustness in task performance, demonstrating the potential of
Bairong Zhu, Amar Salehi, Tingting Yu
wiley +1 more source
This review maps the methods to monitor robots’ health by fusing vibration, sound, control signals, vision, force, and oil information with artificial intelligence. It identifies deep learning, transfer learning, digital twins, and physics‐informed models as key methodological pathways enabling earlier diagnosis, safer human–robot collaboration, and ...
Yuting Qiao +6 more
wiley +1 more source
The Impact of Prior Beliefs about Volatility on Adaptive Behavior. [PDF]
Bleser A, Fink GR, Vossel S, Mengotti P.
europepmc +1 more source
Push the Limits: Human‐Like Multimodal Extreme Embodied Intelligence for Autonomous Racing
Autonomous racing tests embodied intelligence under extreme control limits of speed, actuation, and decision‐making. Inspired by human multimodality, we present Apex, an embodied agent deployed on a super‐formula racing car at Yas Marina. Integrating physics‐informed perception, multimodal learning, and tasking, Apex cuts lap times by 15% and achieves ...
Yanxin Zhou +13 more
wiley +1 more source
Analytic posterior distribution and bayes factor for pearson partial correlations. [PDF]
Kucharský Š +3 more
europepmc +1 more source
Learning‐Based Soft Robotic Grasping: Recent Progress and Remaining Challenges
This review analyzes learning‐based soft robotic grasping from a pipeline‐oriented perspective, encompassing soft gripper design, multimodal sensing, and learning‐based planning and control. It surveys key neural network architectures and benchmark datasets and identifies critical challenges such as sim‐to‐real transfer, generalization, and continual ...
Arnab Majumder +3 more
wiley +1 more source
When Literature Priors Are Removed: Clinical Rank Shifts and Transancestral Stability in Antipsychotic Low-Density Lipoprotein (LDL)-Risk Modelling. [PDF]
Cheung N, Cheung HK, Yu YW, Tsang YY.
europepmc +1 more source
Continuum Robots in Surgery: From Engineering Design to Clinical Practice
The hyper‐redundant nature of continuum robot structures enables near‐infinite degrees of freedom leading to immense potential for medical applications. This review provides a historical background of continuum robots and novel ideas shaping their progress to current structural design, sensing technology, modeling techniques, and control methods.
Griffin Smith +6 more
wiley +1 more source
PRISM: Feature-Guided Hierarchical Inpainting for Dual-Band Infrared Defective Pixel Clusters. [PDF]
Zhao X +7 more
europepmc +1 more source

