Results 41 to 50 of about 43,272 (165)

CentralNet: A Multilayer Approach for Multimodal Fusion [PDF]

, 2019
This paper proposes a novel multimodal fusion approach, aiming to produce best possible decisions by integrating information coming from multiple media. While most of the past multimodal approaches either work by projecting the features of different modalities into the same space, or by coordinating the representations of each modality through the use ...
Vielzeuf, Valentin, Lechervy, Alexis, Pateux, Stéphane, Jurie, Frédéric   +3 more
openaire   +3 more sources

Multimodal sensor fusion in the latent representation space

Scientific Reports, 2023
A new method for multimodal sensor fusion is introduced. The technique relies on a two-stage process. In the first stage, a multimodal generative model is constructed from unlabelled training data.
Robert J. Piechocki, Xiaoyang Wang, Mohammud J. Bocus   +2 more
doaj   +1 more source

Multimodal Alignment and Fusion: A Survey

International Journal of Computer Vision
Accepted to IJCV ...
Songtao Li, Hao Tang
openaire   +2 more sources

DSF2-NAS: Dual-Stage Feature Fusion via Network Architecture Search for Classification of Multimodal Remote Sensing Images

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Recently, the classification of multimodal remote sensing images (RSIs) has garnered significant attention due to its ability to provide rich information for various scenes on Earth.
Shiyang Feng, Zhaowei Li, Bo Zhang, Tao Chen, Bin Wang   +4 more
doaj   +1 more source

Exploring The Current State of Multimodal Alignment and Fusion [PDF]

ITM Web of Conferences
Multimodal alignment and fusion technology is the core driving force for the transformation of artificial intelligence from single-modal perception to multimodal cognition.
Ye Leyi
doaj   +1 more source

Unbiased Dynamic Multimodal Fusion

CoRR
CVPR2026 Findings, 11 pages, 4 ...
Shicai Wei, Kaijie Zhang, Luyi Chen, Tao He, Guiduo Duan   +4 more
openaire   +2 more sources

A Multimodal Graph Recommendation Method Based on Cross-Attention Fusion

Mathematics
Research on recommendation methods using multimodal graph information presents a significant challenge within the realm of information services. Prior studies in this area have lacked precision in the purification and denoising of multimodal information ...
Kai Li, Long Xu, Cheng Zhu, Kunlun Zhang
doaj   +1 more source

Building a Practical Multimodal System with a Multimodal Fusion Module [PDF]

, 2009
A multimodal system is a system equipped with a multimodal interface through which a user can interact with the system by using his/her natural communication modalities, such as speech, gesture, eye gaze, etc. To understand a user's intension, multimodal input fusion, a critical component of a multimodal interface, integrates a user's multimodal inputs
Yong Sun, Yu (David) Shi, Fang Chen 0001, Vera Yuk Ying Chung   +3 more
openaire   +1 more source

Multimodal Representation Learning and Fusion

CoRR
Multi-modal learning is a fast growing area in artificial intelligence. It tries to help machines understand complex things by combining information from different sources, like images, text, and audio. By using the strengths of each modality, multi-modal learning allows AI systems to build stronger and richer internal representations.
Jin, Qihang, Ge, Enze, Xie, Yuhang, Luo, Hongying, Song, Junhao, Bi, Ziqian, Liang, Chia Xin, Guan, Jibin, Yeong, Joe, Song, Xinyuan, Hao, Junfeng   +10 more
openaire   +2 more sources

GCMA-Net: A Gated Cross-Modal Attention Network for Arabic Multimodal Sentiment Analysis

IEEE Access
Arabic multimodal sentiment analysis (MSA) remains challenging due to linguistic diversity, modality imbalance, and the limitations of traditional fusion techniques in capturing cross-modal interactions.
Ayoub Ben Cheikhi, El Habib Nfaoui
doaj   +1 more source