Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models
A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki +2 more
wiley +1 more source
Speech Recognition with an fMRISNN Constrained by Human Functional Brain Networks: A Study of Enhanced MFCC-Driven Sparse Spike Encoding. [PDF]
Guo L, Ma N, Wang Z, Liu R.
europepmc +1 more source
Task‐Oriented Path Planning Towards Autonomous Sensor Network Deployment in Rainforest Canopies
An informative path planner for drone‐based deployment of wireless sensor networks in rainforest canopies is presented, addressing key challenges in large‐scale biodiversity monitoring. By integrating canopy surface detection with connectivity‐aware sampling under strict flight constraints, the approach enables efficient and reliable aerial sensor ...
Rita Santos Raminhos, Salua Hamaza
wiley +1 more source
Passive cavitation imaging with p<sup>th</sup> root coherence factor and sparse arrays: In vitro and in vivo assessment for histotripsy monitoring. [PDF]
Singh AK +4 more
europepmc +1 more source
This review maps the methods to monitor robots’ health by fusing vibration, sound, control signals, vision, force, and oil information with artificial intelligence. It identifies deep learning, transfer learning, digital twins, and physics‐informed models as key methodological pathways enabling earlier diagnosis, safer human–robot collaboration, and ...
Yuting Qiao +6 more
wiley +1 more source
Structural Prior-Guided Weighted Low-Rank Denoising for Short-Wave Infrared Star Images. [PDF]
Wu C +5 more
europepmc +1 more source
Learning‐Based Soft Robotic Grasping: Recent Progress and Remaining Challenges
This review analyzes learning‐based soft robotic grasping from a pipeline‐oriented perspective, encompassing soft gripper design, multimodal sensing, and learning‐based planning and control. It surveys key neural network architectures and benchmark datasets and identifies critical challenges such as sim‐to‐real transfer, generalization, and continual ...
Arnab Majumder +3 more
wiley +1 more source
Native sparse attention: co-designing algorithms and hardware for practical long-context efficiency. [PDF]
Yuan J, Zhang M.
europepmc +1 more source
A Whole‐Head Finite Element Model for Electrical Neuromodulation via Visual Brain‐Machine Interfaces
A multimodal, personalized head model is presented that integrates the entire visual pathway with surrounding tissues to simulate electrical stimulation of the optic nerve. In vivo validation in humans and goats, plus systematic component‐elimination analysis, demonstrates the high accuracy of the comprehensive model.
Shengjian Lu +12 more
wiley +1 more source

