Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models
Advanced Robotics Research, EarlyView.A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki +2 more
wiley +1 more source
Telerehabilitation Delivery of Multi-Modality Aphasia Therapy (M-MAT Tele): A Pilot Feasibility Trial. [PDF]
Int J TelerehabilAston V +7 more
europepmc +1 more source
Hybrid Continuum Robot Designs and Architectures for Healthcare Applications
Advanced Robotics Research, EarlyView.Hybrid continuum robots represent an emerging class of flexible manipulators that blend materials, structures, and actuation concepts from the established fields of soft and continuum robotics. This review introduces an accessible framework to distinguish key hybridization approaches, surveys current designs aimed at complex clinical applications, and ...
Burak Ozdemir +4 more
wiley +1 more source
Automatic Segmentation of Medial Temporal Lobe Subregions in Multi-Scanner, Multi-Modality Magnetic Resonance Imaging of Variable Quality. [PDF]
HippocampusLi Y +11 more
europepmc +1 more source
LLM‐Integrated Human–Robot Interaction System for Microrobots
Advanced Robotics Research, EarlyView.This paper proposes an LLM‐based control framework for guiding microrobots using human natural language. This framework can convert the natural human speech into safe and executable command sets for reliable navigation in complex environments. The experimental results show high accuracy and robustness in task performance, demonstrating the potential of
Bairong Zhu, Amar Salehi, Tingting Yu
wiley +1 more source
Core-Periphery Multi-Modality Feature Alignment for Zero-Shot Medical Image Analysis. [PDF]
IEEE Trans Med ImagingYu X, Zhang L, Wu Z, Zhu D.
europepmc +1 more source
Cross‐Scale Hierarchical Targeted Delivery System Based on Small‐Scale Magnetic Robots
Advanced Robotics Research, EarlyView.This article reviews a cross‐scale hierarchical targeted delivery system that integrates magnetic continuum robots and magnetic microrobots. By combining rapid long‐range navigation with precise microscale targeting, the system overcomes key limitations of single‐scale approaches.
Junjian Zhou +4 more
wiley +1 more source
RefineFuse: an end-to-end network for multi-scale refinement fusion of multi-modality images. [PDF]
Vis IntellSong C, Li H, Xu T, Wu XJ, Kittler J.
europepmc +1 more source
Advanced Robotics Research, EarlyView.This work presents the MicroRoboScope, a highly integrated, compact, and portable microrobotic experimentation platform combining electromagnetic and acoustic actuation with real‐time visual feedback into a single, end‐to‐end device. The system enables closed‐loop control and tracking algorithm experimentation within an accessible and unified hardware ...
Max Sokolich +4 more
wiley +1 more source
Advanced Robotics Research, EarlyView.This review maps the methods to monitor robots’ health by fusing vibration, sound, control signals, vision, force, and oil information with artificial intelligence. It identifies deep learning, transfer learning, digital twins, and physics‐informed models as key methodological pathways enabling earlier diagnosis, safer human–robot collaboration, and ...
Yuting Qiao +6 more
wiley +1 more source