Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models
A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki +2 more
wiley +1 more source
Causal Mediation and Functional Outcome Analysis with Process Data. [PDF]
Suk Y, Park C.
europepmc +1 more source
LLM‐Integrated Human–Robot Interaction System for Microrobots
This paper proposes an LLM‐based control framework for guiding microrobots using human natural language. This framework can convert the natural human speech into safe and executable command sets for reliable navigation in complex environments. The experimental results show high accuracy and robustness in task performance, demonstrating the potential of
Bairong Zhu, Amar Salehi, Tingting Yu
wiley +1 more source
VIRSE: a variational Bayesian framework for RNA structural ensemble inference. [PDF]
Liang J, Wang Y, Fan X, Xie M, Song Q.
europepmc +1 more source
This review maps the methods to monitor robots’ health by fusing vibration, sound, control signals, vision, force, and oil information with artificial intelligence. It identifies deep learning, transfer learning, digital twins, and physics‐informed models as key methodological pathways enabling earlier diagnosis, safer human–robot collaboration, and ...
Yuting Qiao +6 more
wiley +1 more source
Gap Measurement Method for Railway Switch Machines Based on the Fusion of Deep Vision and Geometric Features. [PDF]
Zhi W +6 more
europepmc +1 more source
Deep Contrastive Learning for High‐Throughput Prediction of Drug Resistance Mutations from Sequences
This study presents DeepMutDTA, a deep learning framework aimed at predicting mutation‐induced changes in protein‐drug interactions and prioritizing variants potentially linked to drug resistance. Trained on large‐scale data, it incorporates SimSiam‐MuTF, a label‐aware contrastive fine‐tuning strategy that encourages separation between WT and MT ...
Xiaowen Hu +7 more
wiley +1 more source
Beyond Linear Risk: A Machine Learning Approach to Understanding Perinatal Depression in Context. [PDF]
Sherlock P +11 more
europepmc +1 more source
A genome‐wide microRNA CRISPR screen identifies miR‐18a as a master regulator of cross‐resistance in melanoma. Loss of miR‐18a activates the AJUBA–YAP/Hippo axis to confer BRAFi resistance and enhances THBS1–CD47 interaction to impair CD8+ T cell immunity. hnRNP A1 is identified as an upstream regulator of miR‐18a processing.
Zhao Wang +19 more
wiley +1 more source
Resolving non-identifiability mitigates systematic errors in simultaneous models of neural tuning and functional coupling. [PDF]
Sachdeva P +6 more
europepmc +1 more source

