Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models
A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki +2 more
wiley +1 more source
Pollution control mechanism of national water network with water quality differences based on differential game and case study. [PDF]
Yang Y, Yang Y, Yang S, Zhang J.
europepmc +1 more source
LLM‐Integrated Human–Robot Interaction System for Microrobots
This paper proposes an LLM‐based control framework for guiding microrobots using human natural language. This framework can convert the natural human speech into safe and executable command sets for reliable navigation in complex environments. The experimental results show high accuracy and robustness in task performance, demonstrating the potential of
Bairong Zhu, Amar Salehi, Tingting Yu
wiley +1 more source
Optimal control and differential game solutions for social distancing in response to epidemics of infectious diseases on networks. [PDF]
Dashtbali M, Malek A, Mirzaie M.
europepmc +1 more source
A flexible, skin‐integrated electromagnetic actuator is developed for wearable virtual/augmented reality (VR/AR) haptic systems. A tunable design model enables control over displacement and resonance frequency. The system is validated through a custom VR application with a 6 × 4 actuator array, demonstrating real‐time, spatially targeted tactile ...
Naji Tarabay +9 more
wiley +1 more source
Analyzing the influence of government policy on building carbon emission reduction based on differential game. [PDF]
Zhang Y, Zeng C, Chi N.
europepmc +1 more source
Mutual Adaptation and Influence: Review of Latent Dynamics Models in Human–Robot Interaction
Robots are becoming better teammates by learning hidden patterns in how people act. This review covers how state‐of‐the‐art approaches leverage these patterns to help robots not only react but also anticipate and guide cooperation. Here, we synthesize a unifying framework for these approaches, classify and review existing works, and highlight key ...
Mason O. Smith +4 more
wiley +1 more source
An evolutionary differential game for regulating the role of monoclonal antibodies in treating signalling pathways in oesophageal cancer. [PDF]
Alajmi M, Roy S.
europepmc +1 more source
This work presents the MicroRoboScope, a highly integrated, compact, and portable microrobotic experimentation platform combining electromagnetic and acoustic actuation with real‐time visual feedback into a single, end‐to‐end device. The system enables closed‐loop control and tracking algorithm experimentation within an accessible and unified hardware ...
Max Sokolich +4 more
wiley +1 more source

