Results 31 to 40 of about 5,997,557 (286)
Cross-modal sentiment analysis is an emerging research area in natural language processing. The core task of cross-modal fusion lies in cross-modal relationship extraction and joint feature learning. The existing research methods of cross-modal sentiment
Ping He +3 more
doaj +1 more source
Cross-Modal Message Passing for Two-Stream Fusion [PDF]
Processing and fusing information among multi-modal is a very useful technique for achieving high performance in many computer vision problems. In order to tackle multi-modal information more effectively, we introduce a novel framework for multi-modal fusion: Cross-modal Message Passing (CMMP).
Dong Wang 0028 +2 more
openaire +3 more sources
Two Headed Dragons: Multimodal Fusion And Cross Modal Transactions [PDF]
As the field of remote sensing is evolving, we witness the accumulation of information from several modalities, such as multispectral (MS), hyperspectral (HSI), LiDAR etc. Each of these modalities possess its own distinct characteristics and when combined synergistically, perform very well in the recognition and classification tasks.
Rupak Bose +2 more
openaire +3 more sources
CM-CIF: Cross-Modal for Unaligned Modality Fusion with Continuous Integrate-and-Fire
The purpose of Audio-Visual Speech Recognition is to identify the content of the spoken sentence by extracting the lip movement features and acoustic features from an input video file containing a person's conversation.
Yanyan Xu +8 more
core +1 more source
Deep Label Feature Fusion Hashing for Cross-Modal Retrieval
The rapid growth of multi-modal data in recent years has driven the strong demand for retrieving semantic-related data within different modalities. Therefore, cross-modal hashing has attracted extensive interest and studies due to its fast retrieval ...
Dongxiao Ren +3 more
doaj +1 more source
MCR: Multilayer cross‐fusion with reconstructor for multimodal abstractive summarisation
Multimodal abstractive summarisation (MAS) aims to generate a textual summary from multimodal data collection, such as video‐text pairs. Despite the success of recent work, the existing methods lack a thorough analysis for consistency across multimodal ...
Jingshu Yuan +4 more
doaj +1 more source
Robust Navigation with Cross-Modal Fusion and Knowledge Transfer
Accepted by ICRA ...
Wenzhe Cai +4 more
openaire +4 more sources
Cascaded Cross-Modality Fusion Network for 3D Object Detection [PDF]
We focus on exploring the LIDAR-RGB fusion-based 3D object detection in this paper. This task is still challenging in two aspects: (1) the difference of data formats and sensor positions contributes to the misalignment of reasoning between the semantic features of images and the geometric features of point clouds.
Zhiyu Chen 0004 +7 more
openaire +3 more sources
Vision-Text Cross-Modal Fusion for Accurate Video Captioning
In this paper, we introduce a novel end-to-end multimodal video captioning framework based on cross-modal fusion of visual and textual data. The proposed approach integrates a modality-attention module, which captures the visual-textual inter-model relationships using cross-correlation.
Kaouther Ouenniche +2 more
openaire +3 more sources
Cross-modal Search Method of Technology Video based on Adversarial Learning and Feature Fusion [PDF]
Technology videos contain rich multi-modal information. In cross-modal information search, the data features of different modalities cannot be compared directly, so the semantic gap between different modalities is a key problem that needs to be solved ...
Liang, Meiyu +3 more
core

