Results 21 to 30 of about 4,404,768 (300)

Dual-Layer Fusion Knowledge Reasoning with Enhanced Multi-modal Features [PDF]

Jisuanji kexue yu tansuo
Most of the existing multi-modal knowledge reasoning methods use splicing or attention to directly fuse the multi-modal features extracted from the pre-trained model, often ignoring the heterogeneity and interaction complexity between different modes ...
JING Boxiang, WANG Hairong, WANG Tong, YANG Zhenye
doaj   +1 more source

Visual Question Answering Model Based on Multi-modal Deep Feature Fusion [PDF]

Jisuanji kexue, 2023
In the era of big data,with the explosive growth of multi-source heterogeneous data,multi-modal data fusion has attracted much attention of researchers,and visual question answering(VQA) has become a hot topic in multi-modal data fusion due to its image ...
ZOU Yunzhu, DU Shengdong, TENG Fei, LI Tianrui
doaj   +1 more source

Deep Multi-Semantic Fusion-Based Cross-Modal Hashing

Mathematics, 2022
Due to the low costs of its storage and search, the cross-modal retrieval hashing method has received much research interest in the big data era. Due to the application of deep learning, the cross-modal representation capabilities have risen markedly ...
Xinghui Zhu, Liewu Cai, Zhuoyang Zou, Lei Zhu   +3 more
doaj   +1 more source

Fusion of children’s speech and 2D gestures when conversing with 3D characters [PDF]

, 2006
Most existing multi-modal prototypes enabling users to combine 2D gestures and speech input are task-oriented. They help adult users solve particular information tasks often in 2D standard Graphical User Interfaces. This paper describes the NICE Andersen
BERNSEN, Niels Ole, Jean-Claude Martin, BUISINE, Stéphanie, PITEL, Guillaume, Stéphanie Buisine, MARTIN, Jean-Claude, Niels Ole Bernsen, Guillaume Pitel   +7 more
core   +1 more source

Multi-Modal Recurrent Fusion for Indoor Localization

ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022
This paper considers indoor localization using multi-modal wireless signals including Wi-Fi, inertial measurement unit (IMU), and ultra-wideband (UWB). By formulating the localization as a multi-modal sequence regression problem, a multi-stream recurrent fusion method is proposed to combine the current hidden state of each modality in the context of ...
Yu, Jianyuan, Pu, Wang, Koike-Akino, Toshiaki, Orlik, Philip V.   +4 more
openaire   +4 more sources

Multi-resolution, multi-sensor image fusion: general fusion framework [PDF]

, 2011
Multi-resolution image fusion also known as pansharpening aims to include spatial information from a high resolution image, e.g. panchromatic or Synthetic Aperture Radar (SAR) image, into a low resolution image, e.g.
Palubinskas, Gintautas, Gintautas Palubinskas, Reinartz, Peter, Peter Reinartz   +3 more
core   +1 more source

Research Progress of Multimodal Named Entity Recognition [PDF]

Zhengzhou Daxue xuebao. Gongxue ban
In order to solve the problems in studies of multimodal named entity recognition, such as the lack of text feature semantics, the lack of visual feature semantics, and the difficulty of graphic feature fusion, a series of multimodal named entity ...
WANG Hairong, XU Xi, WANG Tong, JING Boxiang   +3 more
doaj   +1 more source

Multi-modal sensor networks for more effective sensing in Irish coastal and freshwater environments [PDF]

, 2012
The world’s oceans represent a vital resource to global economies and there exists huge economic opportunity that remains unexploited. However along with this huge potential there rests a responsibility into understanding the effects various ...
O\u27Connor, Edel, O'Connor, Noel E., N. E. O'Connor, O'Connor, Edel, A. F. Smeaton, F. Regan, Smeaton, Alan F., Regan, Fiona, O\u27Connor, Noel E., Edel O'Connor, Dian Zhang   +10 more
core   +3 more sources

Exponential Multi-Modal Discriminant Feature Fusion for Small Sample Size

IEEE Access, 2022
Multi-modal Canonical Correlation Analysis (MCCA) is an important information fusion method, and some discriminant variations of MCCA have been proposed.
Yanmin Zhu, Tianhao Peng, Shuzhi Su
doaj   +1 more source

Multi-modality Cascaded Fusion Technology for Autonomous Driving [PDF]

2020 4th International Conference on Robotics and Automation Sciences (ICRAS), 2020
Multi-modality fusion is the guarantee of the stability of autonomous driving systems. In this paper, we propose a general multi-modality cascaded fusion framework, exploiting the advantages of decision-level and feature-level fusion, utilizing target position, size, velocity, appearance and confidence to achieve accurate fusion results.
Hongwu Kuang, Xiaodong Liu, Jingwei Zhang, Zicheng Fang   +3 more
openaire   +3 more sources