Results 101 to 110 of about 16,504,576 (273)

A multimodal expert system for the intelligent monitoring and maintenance of transformers enhanced by multimodal language large model fine‐tuning and digital twins

IET Collaborative Intelligent Manufacturing
The development of multimodal large models and digital twin technology is set to revolutionise the methods of intelligent monitoring and maintenance for transformers.
Xuedong Zhang, Wenlei Sun, Ke Chen, Renben Jiang   +3 more
doaj   +1 more source

Safety of Multimodal Large Language Models on Images and Text

Proceedings of the Thirty-ThirdInternational Joint Conference on Artificial Intelligence
Attracted by the impressive power of Multimodal Large Language Models (MLLMs), the public is increasingly utilizing them to improve the efficiency of daily work. Nonetheless, the vulnerabilities of MLLMs to unsafe instructions bring huge safety risks when these models are deployed in real-world scenarios. In this paper, we systematically survey current
Xin Liu 0086, Yichen Zhu 0001, Yunshi Lan, Chao Yang 0026, Yu Qiao 0001   +4 more
openaire   +4 more sources

Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models

Advanced Robotics Research, EarlyView.
A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki, Ilche Georgievski, Marco Aiello   +2 more
wiley   +1 more source

Prompt Driven Multimodal Large Language Models for Concrete Defect Identification

IEEE Access
Detecting surface defects in concrete structures is essential for ensuring structural safety; however, traditional methods have limitations, including subjectivity and heavy data dependency. This study proposes using pretrained multimodal large and small
Seokjae Heo
doaj   +1 more source

Unpacking Large Language Models: Grundlagen, Perspektiven und Herausforderungen

Obwohl es statistische Sprachmodelle bereits seit den 1980ern gibt, konnte erst ChatGPT, welches im Winter 2022 veröffentlicht wurde, das Interesse der breiten Gesellschaft für diese Technologie wecken.
Kraft, Angelie
core   +1 more source

LLM‐Integrated Human–Robot Interaction System for Microrobots

Advanced Robotics Research, EarlyView.
This paper proposes an LLM‐based control framework for guiding microrobots using human natural language. This framework can convert the natural human speech into safe and executable command sets for reliable navigation in complex environments. The experimental results show high accuracy and robustness in task performance, demonstrating the potential of
Bairong Zhu, Amar Salehi, Tingting Yu
wiley   +1 more source

Parallel Multimodal Language Model: Enhanced Breast Nodule Diagnosis through Parallel Multimodal Representations and Large Language Models

Advanced Intelligent Systems
Large language models (LLMs) have emerged in medical image analysis and can provide accurate and personalized medical services for doctors and patients.
Dashun Zheng, Patrick Cheong‐Iao Pang, Ping He, Yue Sun, Hongju Yan, Xiangyu Xiong, Ligang Cui, Tao Tan, Lingyun Bao   +8 more
doaj   +1 more source

Mutual Adaptation and Influence: Review of Latent Dynamics Models in Human–Robot Interaction

Advanced Robotics Research, EarlyView.
Robots are becoming better teammates by learning hidden patterns in how people act. This review covers how state‐of‐the‐art approaches leverage these patterns to help robots not only react but also anticipate and guide cooperation. Here, we synthesize a unifying framework for these approaches, classify and review existing works, and highlight key ...
Mason O. Smith, Sunny Amatya, Seyed Yousef Soltanian, Jonathan Bush, Wenlong Zhang   +4 more
wiley   +1 more source

Exploring Multimodal Prompt for Visualization Authoring with Large Language Models

Here is the repository for paper "Exploring Multimodal Prompt for Visualization Authoring with Large Language ...
Wen Zhen
core  

Intelligent Maintenance Review for Robots: Multimodal Information, Deep Diagnosis and Embodied Artificial Intelligence

Advanced Robotics Research, EarlyView.
This review maps the methods to monitor robots’ health by fusing vibration, sound, control signals, vision, force, and oil information with artificial intelligence. It identifies deep learning, transfer learning, digital twins, and physics‐informed models as key methodological pathways enabling earlier diagnosis, safer human–robot collaboration, and ...
Yuting Qiao, Hongbo Wang, Naipeng Li, Shuo Wang, Yaguo Lei, Tonghai Wu, Junyi Cao   +6 more
wiley   +1 more source