Results 161 to 170 of about 1,788,159 (256)

Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models

open access: yesAdvanced Robotics Research, EarlyView.
A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki   +2 more
wiley   +1 more source

LLM‐Integrated Human–Robot Interaction System for Microrobots

open access: yesAdvanced Robotics Research, EarlyView.
This paper proposes an LLM‐based control framework for guiding microrobots using human natural language. This framework can convert the natural human speech into safe and executable command sets for reliable navigation in complex environments. The experimental results show high accuracy and robustness in task performance, demonstrating the potential of
Bairong Zhu, Amar Salehi, Tingting Yu
wiley   +1 more source

Intelligent Maintenance Review for Robots: Multimodal Information, Deep Diagnosis and Embodied Artificial Intelligence

open access: yesAdvanced Robotics Research, EarlyView.
This review maps the methods to monitor robots’ health by fusing vibration, sound, control signals, vision, force, and oil information with artificial intelligence. It identifies deep learning, transfer learning, digital twins, and physics‐informed models as key methodological pathways enabling earlier diagnosis, safer human–robot collaboration, and ...
Yuting Qiao   +6 more
wiley   +1 more source

Push the Limits: Human‐Like Multimodal Extreme Embodied Intelligence for Autonomous Racing

open access: yesAdvanced Robotics Research, EarlyView.
Autonomous racing tests embodied intelligence under extreme control limits of speed, actuation, and decision‐making. Inspired by human multimodality, we present Apex, an embodied agent deployed on a super‐formula racing car at Yas Marina. Integrating physics‐informed perception, multimodal learning, and tasking, Apex cuts lap times by 15% and achieves ...
Yanxin Zhou   +13 more
wiley   +1 more source

Learning‐Based Soft Robotic Grasping: Recent Progress and Remaining Challenges

open access: yesAdvanced Robotics Research, EarlyView.
This review analyzes learning‐based soft robotic grasping from a pipeline‐oriented perspective, encompassing soft gripper design, multimodal sensing, and learning‐based planning and control. It surveys key neural network architectures and benchmark datasets and identifies critical challenges such as sim‐to‐real transfer, generalization, and continual ...
Arnab Majumder   +3 more
wiley   +1 more source

Continuum Robots in Surgery: From Engineering Design to Clinical Practice

open access: yesAdvanced Robotics Research, EarlyView.
The hyper‐redundant nature of continuum robot structures enables near‐infinite degrees of freedom leading to immense potential for medical applications. This review provides a historical background of continuum robots and novel ideas shaping their progress to current structural design, sensing technology, modeling techniques, and control methods.
Griffin Smith   +6 more
wiley   +1 more source

Home - About - Disclaimer - Privacy