Results 31 to 40 of about 5,997,557 (286)

Cross-Modal Sentiment Analysis of Text and Video Based on Bi-GRU Cyclic Network and Correlation Enhancement

open access: yesApplied Sciences, 2023
Cross-modal sentiment analysis is an emerging research area in natural language processing. The core task of cross-modal fusion lies in cross-modal relationship extraction and joint feature learning. The existing research methods of cross-modal sentiment
Ping He   +3 more
doaj   +1 more source

Cross-Modal Message Passing for Two-Stream Fusion [PDF]

open access: yes2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2018
Processing and fusing information among multi-modal is a very useful technique for achieving high performance in many computer vision problems. In order to tackle multi-modal information more effectively, we introduce a novel framework for multi-modal fusion: Cross-modal Message Passing (CMMP).
Dong Wang 0028   +2 more
openaire   +3 more sources

Two Headed Dragons: Multimodal Fusion And Cross Modal Transactions [PDF]

open access: yes2021 IEEE International Conference on Image Processing (ICIP), 2021
As the field of remote sensing is evolving, we witness the accumulation of information from several modalities, such as multispectral (MS), hyperspectral (HSI), LiDAR etc. Each of these modalities possess its own distinct characteristics and when combined synergistically, perform very well in the recognition and classification tasks.
Rupak Bose   +2 more
openaire   +3 more sources

CM-CIF: Cross-Modal for Unaligned Modality Fusion with Continuous Integrate-and-Fire

open access: yes, 2022
The purpose of Audio-Visual Speech Recognition is to identify the content of the spoken sentence by extracting the lip movement features and acoustic features from an input video file containing a person's conversation.
Yanyan Xu   +8 more
core   +1 more source

Deep Label Feature Fusion Hashing for Cross-Modal Retrieval

open access: yesIEEE Access, 2022
The rapid growth of multi-modal data in recent years has driven the strong demand for retrieving semantic-related data within different modalities. Therefore, cross-modal hashing has attracted extensive interest and studies due to its fast retrieval ...
Dongxiao Ren   +3 more
doaj   +1 more source

MCR: Multilayer cross‐fusion with reconstructor for multimodal abstractive summarisation

open access: yesIET Computer Vision, 2023
Multimodal abstractive summarisation (MAS) aims to generate a textual summary from multimodal data collection, such as video‐text pairs. Despite the success of recent work, the existing methods lack a thorough analysis for consistency across multimodal ...
Jingshu Yuan   +4 more
doaj   +1 more source

Robust Navigation with Cross-Modal Fusion and Knowledge Transfer

open access: yes2023 IEEE International Conference on Robotics and Automation (ICRA), 2023
Accepted by ICRA ...
Wenzhe Cai   +4 more
openaire   +4 more sources

Cascaded Cross-Modality Fusion Network for 3D Object Detection [PDF]

open access: yesSensors, 2020
We focus on exploring the LIDAR-RGB fusion-based 3D object detection in this paper. This task is still challenging in two aspects: (1) the difference of data formats and sensor positions contributes to the misalignment of reasoning between the semantic features of images and the geometric features of point clouds.
Zhiyu Chen 0004   +7 more
openaire   +3 more sources

Vision-Text Cross-Modal Fusion for Accurate Video Captioning

open access: yesIEEE Access, 2023
In this paper, we introduce a novel end-to-end multimodal video captioning framework based on cross-modal fusion of visual and textual data. The proposed approach integrates a modality-attention module, which captures the visual-textual inter-model relationships using cross-correlation.
Kaouther Ouenniche   +2 more
openaire   +3 more sources

Cross-modal Search Method of Technology Video based on Adversarial Learning and Feature Fusion [PDF]

open access: yes, 2022
Technology videos contain rich multi-modal information. In cross-modal information search, the data features of different modalities cannot be compared directly, so the semantic gap between different modalities is a key problem that needs to be solved ...
Liang, Meiyu   +3 more
core  

Home - About - Disclaimer - Privacy