Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models
A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki +2 more
wiley +1 more source
LLM‐Integrated Human–Robot Interaction System for Microrobots
This paper proposes an LLM‐based control framework for guiding microrobots using human natural language. This framework can convert the natural human speech into safe and executable command sets for reliable navigation in complex environments. The experimental results show high accuracy and robustness in task performance, demonstrating the potential of
Bairong Zhu, Amar Salehi, Tingting Yu
wiley +1 more source
Cross‐Scale Hierarchical Targeted Delivery System Based on Small‐Scale Magnetic Robots
This article reviews a cross‐scale hierarchical targeted delivery system that integrates magnetic continuum robots and magnetic microrobots. By combining rapid long‐range navigation with precise microscale targeting, the system overcomes key limitations of single‐scale approaches.
Junjian Zhou +4 more
wiley +1 more source
Research on Reinforcement Learning-Based Autonomous Navigation and Obstacle Avoidance Methods for AGVs in Unknown Hospital Environments. [PDF]
Luo T, Hu J, Zhang B, Zhang X, Luo S.
europepmc +1 more source
Miniaturized Magnetic Tip Design for Endoluminal Vine Robot Navigation
A magnetic tip mount is designed for a miniaturized 7 mm soft‐growing vine robot to enable wireless magnetic steering and onboard imaging, while preserving a 3 mm working channel. The internal–external ring magnets design balances magnetic attachment with low eversion pressure. Experiments demonstrate ±90° steering, 34 mm bending radius, and successful
Andrea Yanez Trujillo +4 more
wiley +1 more source
Unified Modulation Matrix-Based Shared Control for Teleoperated Multi-Robot Formation and Obstacle Avoidance. [PDF]
Chen R, Zhang Z, Zhang Z, Li J, Zhang H.
europepmc +1 more source
From Lab to Landscape: Environmental Biohybrid Robotics for Ecological Futures
This Perspective explores environmental biohybrid robotics, integrating living tissues, microorganisms, and insects for operation in real‐world ecosystems. It traces the leap from laboratory experiments to forests, wetlands, and urban environments and discusses key challenges, development pathways, and opportunities for ecological monitoring and ...
Miriam Filippi
wiley +1 more source
Dynamic obstacle avoidance path planning for collaborative robot based on improved APF-Bi-RRT algorithm. [PDF]
Li Y, Yan L, Wang M, Wang X.
europepmc +1 more source
DRIVE‐SAFE evaluates learning‐based, black‐box autonomous driving policies against evolving temporal safety requirements using Signal Temporal Logic robustness metrics. It aggregates distributional robustness measures with domain‐informed weights to guide iterative retraining.
Kristy Sakano +3 more
wiley +1 more source
Visual obstacle avoidance technology of VSLAM indoor intelligent logistics robot combining optical flow and feature extraction. [PDF]
Li J.
europepmc +1 more source

