MacroTox: A Macroscopic Graph Topology-Based Multimodal Learning Framework for Robust Molecular Toxicity Prediction. [PDF]
Huang H +6 more
europepmc +1 more source
This work presents a robotic control method for human–robot collaborative assembly based on a biomechanics‐constrained digital human model. Reinforcement learning is used to generate physiologically plausible human motion trajectories, which are integrated into a virtual environment for robot control learning.
Bitao Yao +4 more
wiley +1 more source
Using Multimodal Learning Analytics to Identify Aspects of Collaboration in Project-Based Learning
Collaborative learning activities are a key part of education and are part of many common teaching approaches including problem-based learning, inquiry-based learning, and project-based learning.
Cukurova, Mutlu +2 more
core
Multimodal learning reveals plants' hidden sensory integration logic. [PDF]
Vomo-Donfack KL +4 more
europepmc +1 more source
Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models
A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki +2 more
wiley +1 more source
Multimodal Learning with Privileged Report Supervision for Generalizable Tuberculosis Detection on Chest Radiographs. [PDF]
Rajaraman S +4 more
europepmc +1 more source
LLM‐Integrated Human–Robot Interaction System for Microrobots
This paper proposes an LLM‐based control framework for guiding microrobots using human natural language. This framework can convert the natural human speech into safe and executable command sets for reliable navigation in complex environments. The experimental results show high accuracy and robustness in task performance, demonstrating the potential of
Bairong Zhu, Amar Salehi, Tingting Yu
wiley +1 more source
Patient-specific multimodal learning with multi-view contrastive alignment for chest X-ray report generation. [PDF]
Miao Q +7 more
europepmc +1 more source
Modular, Textile‐Based Soft Robotic Grippers for Agricultural Produce Handling
This article introduces textile‐based pneumatic grippers that transform simple textiles into robust bending actuators. Detailed experiments uncover how cut geometry and fabric selection shape performance. Successful handling of fragile agricultural items showcases the potential of textile robotics for safe, scalable automation in food processing and ...
Zeyu Hou +4 more
wiley +1 more source
Multimodal learning with next-token prediction for large multimodal models. [PDF]
Wang X +25 more
europepmc +1 more source

