Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models
Advanced Robotics Research, EarlyView.A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki +2 more
wiley +1 more source
LLM‐Integrated Human–Robot Interaction System for Microrobots
Advanced Robotics Research, EarlyView.This paper proposes an LLM‐based control framework for guiding microrobots using human natural language. This framework can convert the natural human speech into safe and executable command sets for reliable navigation in complex environments. The experimental results show high accuracy and robustness in task performance, demonstrating the potential of
Bairong Zhu, Amar Salehi, Tingting Yu
wiley +1 more source
Population Code Dynamics in Categorical Perception. [PDF]
Sci Rep, 2016 Tajima CI +5 more
europepmc +1 more source
Modular, Textile‐Based Soft Robotic Grippers for Agricultural Produce Handling
Advanced Robotics Research, EarlyView.This article introduces textile‐based pneumatic grippers that transform simple textiles into robust bending actuators. Detailed experiments uncover how cut geometry and fabric selection shape performance. Successful handling of fragile agricultural items showcases the potential of textile robotics for safe, scalable automation in food processing and ...
Zeyu Hou +4 more
wiley +1 more source
Newly learned categories induce pre-attentive categorical perception of faces. [PDF]
Sci Rep, 2017 Yu M, Li Y, Mo C, Mo L.
europepmc +1 more source
Cross‐Scale Hierarchical Targeted Delivery System Based on Small‐Scale Magnetic Robots
Advanced Robotics Research, EarlyView.This article reviews a cross‐scale hierarchical targeted delivery system that integrates magnetic continuum robots and magnetic microrobots. By combining rapid long‐range navigation with precise microscale targeting, the system overcomes key limitations of single‐scale approaches.
Junjian Zhou +4 more
wiley +1 more source
Context-dependent categorical perception in a songbird. [PDF]
Proc Natl Acad Sci U S A, 2015 Lachlan RF, Nowicki S.
europepmc +1 more source
Mutual Adaptation and Influence: Review of Latent Dynamics Models in Human–Robot Interaction
Advanced Robotics Research, EarlyView.Robots are becoming better teammates by learning hidden patterns in how people act. This review covers how state‐of‐the‐art approaches leverage these patterns to help robots not only react but also anticipate and guide cooperation. Here, we synthesize a unifying framework for these approaches, classify and review existing works, and highlight key ...
Mason O. Smith +4 more
wiley +1 more source
From Lab to Landscape: Environmental Biohybrid Robotics for Ecological Futures
Advanced Robotics Research, EarlyView.This Perspective explores environmental biohybrid robotics, integrating living tissues, microorganisms, and insects for operation in real‐world ecosystems. It traces the leap from laboratory experiments to forests, wetlands, and urban environments and discusses key challenges, development pathways, and opportunities for ecological monitoring and ...
Miriam Filippi
wiley +1 more source
Individual differences in categorical perception of speech: Cue weighting and executive function. [PDF]
J Phon, 2016 Kong EJ, Edwards J.
europepmc +1 more source