CMBF: Cross-Modal-Based Fusion Recommendation Algorithm [PDF]
A recommendation system is often used to recommend items that may be of interest to users. One of the main challenges is that the scarcity of actual interaction data between users and items restricts the performance of recommendation systems.
Xi Chen +3 more
doaj +6 more sources
Deep Multi-Semantic Fusion-Based Cross-Modal Hashing
Due to the low costs of its storage and search, the cross-modal retrieval hashing method has received much research interest in the big data era. Due to the application of deep learning, the cross-modal representation capabilities have risen markedly ...
Xinghui Zhu +3 more
doaj +2 more sources
Feature Fusion-Based Cross-Modal Proxy Hashing Retrieval
Due to its cost-effective and high-efficiency retrieval advantages, deep hashing has attracted extensive attention in the field of cross-modal retrieval.
Yan Zhao, Huaiying Li
doaj +2 more sources
Cross-Modal Complementarity Learning for Fish Feeding Intensity Recognition via Audio–Visual Fusion
Accurate evaluation of fish feeding intensity is crucial for optimizing aquaculture efficiency and the healthy growth of fish. Previous methods mainly rely on single-modal approaches (e.g., audio or visual).
Jian Li, Yanan Wei, Wenkai Ma, Tan Wang
doaj +2 more sources
TACFN: Transformer-Based Adaptive Cross-Modal Fusion Network for Multimodal Emotion Recognition [PDF]
The fusion technique is the key to the multimodal emotion recognition task. Recently, cross-modal attention-based fusion methods have demonstrated high performance and strong robustness.
Feng Liu +3 more
doaj +2 more sources
A Cross-Modal Attention-Driven Multi-Sensor Fusion Method for Semantic Segmentation of Point Clouds
To bridge the modality gap between camera images and LiDAR point clouds in autonomous driving systems—a critical challenge exacerbated by current fusion methods’ inability to effectively integrate cross-modal features—we propose the Cross-Modal Fusion ...
Huisheng Shi +3 more
doaj +2 more sources
Fusion-Mamba for Cross-modality Object Detection [PDF]
Cross-modality fusing complementary information from different modalities effectively improves object detection performance, making it more useful and robust for a wider range of applications. Existing fusion strategies combine different types of images or merge different backbone features through elaborated neural network modules.
Wenhao Dong +8 more
core +6 more sources
SACMFuse: Structure-Aware Cross-Modal Interaction Network for Multi-Modal Image Fusion
Multi-modal image fusion integrates complementary information from different modalities to generate a unified representation that is informative for human perception and beneficial to downstream vision tasks. However, existing methods often inefficiently
Quanrui Wen +3 more
doaj +2 more sources
Multi-modal Fusion Method Based on Dual Encoders [PDF]
The dual encoder model has faster inference speed than the fusion encoder model,and can pre-calculate images and text during the inference process.However,the shallow interaction module used in the dual encoder model is not sufficient to handle complex ...
HUANG Xiaofei, GUO Weibin
doaj +2 more sources
GCF2-Net: global-aware cross-modal feature fusion network for speech emotion recognition [PDF]
Emotion recognition plays an essential role in interpersonal communication. However, existing recognition systems use only features of a single modality for emotion recognition, ignoring the interaction of information from the different modalities ...
Feng Li +5 more
doaj +2 more sources

