Results 71 to 80 of about 40,713,079 (253)
Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift [PDF]
Multimodal image-text models have shown remarkable performance in the past few years. However, evaluating robustness against distribution shifts is crucial before adopting them in real-world applications. In this work, we investigate the robustness of 12
Li, Bo +7 more
core
Advanced Robotics Research, EarlyView.This work presents a robotic control method for human–robot collaborative assembly based on a biomechanics‐constrained digital human model. Reinforcement learning is used to generate physiologically plausible human motion trajectories, which are integrated into a virtual environment for robot control learning.
Bitao Yao +4 more
wiley +1 more source
Text+ Plenary 2024: Call for Posters
Das 3. Plenary von Text+ widmet sich am 10.+11. Oktober 2024 dem Thema „Large Language Models (LLMs) und deren Nutzung“. Für diejenigen, die sich bisher nicht mit den Hintergründen von LLMs beschäftigt haben, gibt es die Möglichkeit, am Nachmittag vor ...
Text+ Blog-Redaktion
core +1 more source
Multimodal Human–Robot Interaction Using Human Pose Estimation and Local Large Language Models
Advanced Robotics Research, EarlyView.A multimodal human–robot interaction framework integrates human pose estimation (HPE) and a large language model (LLM) for gesture‐ and voice‐based robot control. Speech‐to‐text (STT) enables voice command interpretation, while a safety‐aware arbitration mechanism prioritizes gesture input for rapid intervention.
Nasiru Aboki +2 more
wiley +1 more source
Brian Bilston’s multimodal poetic practices: interactions between the digital and the analogue
Слово.ру: балтийский акцентThis article examines texts by the modern British poet Brian Bilston from the perspective of their semantic and syntactic organisation and the lines of the author's investigation into paralinguistic, i. e. visual, elements.
Sabina G. Busareva
doaj +1 more source
Wings: Learning Multimodal LLMs without Text-only Forgetting [PDF]
Multimodal large language models (MLLMs), initiated with a trained LLM, first align images with text and then fine-tune on multimodal mixed inputs. However, the MLLM catastrophically forgets the text-only instructions, which do not include images and can
Luo, Weihua +9 more
core
Text+ auf der OPERAS-Konferenz 2024
Autor:innen: Nanette Rißler-Pipka, Angela Vorndran, Philippe Genêt, Eva-Maria Gerstner Bei der kommenden OPERAS conference 2024, die vom 24. bis zum 26.
Text+ Mitglied
core +1 more source
LLM‐Integrated Human–Robot Interaction System for Microrobots
Advanced Robotics Research, EarlyView.This paper proposes an LLM‐based control framework for guiding microrobots using human natural language. This framework can convert the natural human speech into safe and executable command sets for reliable navigation in complex environments. The experimental results show high accuracy and robustness in task performance, demonstrating the potential of
Bairong Zhu, Amar Salehi, Tingting Yu
wiley +1 more source
Voice and Touch Based Error-tolerant Multimodal Text Editing and Correction for Smartphones. [PDF]
Proc ACM Symp User Interface Softw Tech, 2021 Zhao M +4 more
europepmc +1 more source
Mutual Adaptation and Influence: Review of Latent Dynamics Models in Human–Robot Interaction
Advanced Robotics Research, EarlyView.Robots are becoming better teammates by learning hidden patterns in how people act. This review covers how state‐of‐the‐art approaches leverage these patterns to help robots not only react but also anticipate and guide cooperation. Here, we synthesize a unifying framework for these approaches, classify and review existing works, and highlight key ...
Mason O. Smith +4 more
wiley +1 more source