Results 41 to 50 of about 5,997,557 (286)
Image-Text Sentiment Classification Model Based on Multi-scale Cross-modal Feature Fusion [PDF]
For the image-text sentiment classification task,the cross-modal feature fusion strategy which combines early fusion and Transformer model is usually used for image-text feature fusion.However,this strategy prefers to focus on the unique information ...
LIU Qian, BAI Zhihao, CHENG Chunling, GUI Yaocheng
doaj +1 more source
Video-Teller: Enhancing Cross-Modal Generation with Fusion and Decoupling
This paper proposes Video-Teller, a video-language foundation model that leverages multi-modal fusion and fine-grained modality alignment to significantly enhance the video-to-text generation task. Video-Teller boosts the training efficiency by utilizing frozen pretrained vision and language modules. It capitalizes on the robust linguistic capabilities
Haogeng Liu +7 more
openaire +3 more sources
Rethink Cross-Modal Fusion in Weakly-Supervised Audio-Visual Video Parsing [PDF]
Existing works on weakly-supervised audio-visual video parsing adopt hybrid attention network (HAN) as the multi-modal embedding to capture the cross-modal context.
Hu, Conghui, Lee, Gim Hee, Xu, Yating
core
Cross-Modality Fusion Transformer for Multispectral Object Detection
Multispectral image pairs can provide combined information, making object detection applications more reliable and robust in the open world. To fully exploit the different modalities, a simple yet effective cross-modality feature fusion approach, named CrossModality Fusion Transformer (CFT) is presented in this paper. Unlike prior CNNs-based works, our
Qingyun Fang, Dapeng Han, Zhaokui Wang
openaire +3 more sources
Cross-modal bias and perceptual fusion with auditory-visual spatial discordance [PDF]
Investigations of situations involving spatial discordance between auditory and visual data which can otherwise be attributed to a common origin have revealed two main phenomena:cross-modal bias and perceptual fusion (or ventriloquism).
Bertelson, Paul +3 more
core +1 more source
Automated extraction of buildings from earth observation (EO) data has long been a fundamental but challenging research topic. Combining data from different modalities (e.g., high-resolution imagery (HRI) and light detection and ranging (LiDAR) data) has
Peng Zhang +6 more
doaj +1 more source
Cross-Modality Attention and Multimodal Fusion Transformer for Pedestrian Detection
Pedestrian detection is an important challenge in computer vision due to its various applications. To achieve more accurate results, thermal images have been widely exploited as complementary information to assist conventional RGB-based detection. Although existing methods have developed numerous fusion strategies to utilize the complementary features,
Lee, Wei-Yu +2 more
openaire +2 more sources
Infrared-Visible Image Fusion Method Based on Differential Feature Enhancement and Cross-Modal Attention [PDF]
To address the issues of insufficient inter-modal information interaction in dual-stream encoders, inadequate deep feature fusion, and loss function failure in extreme environments like strong light in existing autoencoder-based infrared and visible ...
H. Zhang +6 more
doaj +1 more source
Proteostasis and the gut microbiota play a key role in shaping host physiology. Microbiota‐derived metabolites, vitamins, and RNA modulate host proteostasis. Findings from model systems, including C. elegans, indicate microbes can either stabilize or disrupt host proteostasis.
Abhishek Anil Dubey, Maria Ermolaeva
wiley +1 more source
Synergistic Lightweight Bilinear Pooling Fusion for Fake News Detection
To improve cross-modal interaction modeling while controlling the complexity of multimodal fusion, this paper proposes a multimodal fake news detection framework that integrates textual and visual information through cross-modal attention and a ...
Jun Li +3 more
doaj +1 more source

