Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models
A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki +2 more
wiley +1 more source
'Line' Constraints Optimization for Improved Dose Distribution in Locally Recurrent Nasopharyngeal Carcinoma Using Knowledge-Based Planning. [PDF]
Yu X +5 more
europepmc +1 more source
LLM‐Integrated Human–Robot Interaction System for Microrobots
This paper proposes an LLM‐based control framework for guiding microrobots using human natural language. This framework can convert the natural human speech into safe and executable command sets for reliable navigation in complex environments. The experimental results show high accuracy and robustness in task performance, demonstrating the potential of
Bairong Zhu, Amar Salehi, Tingting Yu
wiley +1 more source
Integrating knowledge-based planning and noncoplanar oblique VMAT arcs: A study of dose to the heart and immune cells in thoracic radiotherapy. [PDF]
Diedrich B +7 more
europepmc +1 more source
Data‐Driven Bulldozer Blade Control for Autonomous Terrain Leveling
A simulation‐driven framework for autonomous bulldozer leveling is presented, combining high‐fidelity terramechanics simulation with a neural‐network‐based reduced‐order model. Gradient‐based optimization enables efficient, low‐level blade control that balances leveling quality and operation time.
Harry Zhang +5 more
wiley +1 more source
Quality and mechanical efficiency of automated knowledge-based planning for volumetric-modulated arc therapy in head and neck cancer. [PDF]
Thongsawad S +8 more
europepmc +1 more source
Developing knowledge-based planning for gynaecological and rectal cancers: a clinical validation of RapidPlan™. [PDF]
Shepherd M +7 more
europepmc +1 more source
Mutual Adaptation and Influence: Review of Latent Dynamics Models in Human–Robot Interaction
Robots are becoming better teammates by learning hidden patterns in how people act. This review covers how state‐of‐the‐art approaches leverage these patterns to help robots not only react but also anticipate and guide cooperation. Here, we synthesize a unifying framework for these approaches, classify and review existing works, and highlight key ...
Mason O. Smith +4 more
wiley +1 more source
Dosimetric comparison between laterality-specific and general knowledge-based planning models for nonsmall cell lung cancer. [PDF]
Seng J +4 more
europepmc +1 more source
This review maps the methods to monitor robots’ health by fusing vibration, sound, control signals, vision, force, and oil information with artificial intelligence. It identifies deep learning, transfer learning, digital twins, and physics‐informed models as key methodological pathways enabling earlier diagnosis, safer human–robot collaboration, and ...
Yuting Qiao +6 more
wiley +1 more source

