Results 21 to 30 of about 256,814 (289)
Proceedings of the 16th conference on Computational linguistics -, 1996 This paper describes Multi-Modal-Method, a design method for building grammar-based multi modal systems. Multi-Modal-Method defines the procedure which interface designers may follow in developing multi-modal systems, and provides MM-DCG, a grammatical framework for multi-modal input interpretation.
Hideo Shimazu, Yosuke Takashima
openaire +1 more source
Multi-modal gated recurrent units for image description
, 2018 Using a natural language sentence to describe the content of an image is a challenging but very important task. It is challenging because a description must not only capture objects contained in the image and the relationships among them, but also be ...
Li, Xuelong, Lu, Xiaoqiang, Yuan, Aihong
core +1 more source
Latent Variable Model for Multi-modal Translation [PDF]
, 2019 In this work, we propose to model the interaction between visual and textual features for multi-modal neural machine translation (MMT) through a latent variable model. This latent variable can be seen as a multi-modal stochastic embedding of an image and
Aziz, Wilker +2 more
core +2 more sources
EntropyMultimodal datasets are ubiquitous in modern applications, and multimodal Variational Autoencoders are a popular family of models that aim to learn a joint representation of different modalities. However, existing approaches suffer from a coherence–quality tradeoff in which models with good generation quality lack generative coherence across modalities
Mustapha Bounoua +2 more
openaire +4 more sources
Affective Computing: Recent Advances, Challenges, and Future Trends
Intelligent ComputingAffective computing is a rapidly growing multidisciplinary field that encompasses computer science, engineering, psychology, neuroscience, and other related disciplines.
Guanxiong Pei +5 more
doaj +1 more source
Uncertainty quantification in stochastic ocean acoustic propagation using physics-informed neural network [PDF]
AIP AdvancesUncertainty in ocean acoustic field modeling propagates sequentially from stochastic ocean environments to the acoustic field, ultimately degrading the performance of underwater acoustic applications such as communication, target detection, and ocean ...
A. Jie Duan, B. Hangfang Zhao
doaj +1 more source
IEEE Access, 2020 Multi-modal sentiment analysis extends conventional text-based definition of sentiment analysis to a multi-modal setup where multiple relevant modalities are leveraged to perform sentiment analysis.
Dong Zhang +3 more
doaj +1 more source
MMKG: Multi-Modal Knowledge Graphs
, 2019 We present MMKG, a collection of three knowledge graphs that contain both numerical features and (links to) images for all entities as well as entity alignments between pairs of KGs.
Garcia-Duran, Alberto +5 more
core +1 more source
A sensing platform for physiological and contextual feedback to tennis athletes [PDF]
, 2009 In this paper we describe our work on creating a multi-modal sensing platform for providing feedback to tennis coaches and players. The platform includes a fixed installation around a tennis court consisting of a video camera network and a localisation ...
Connaghan, Damien +8 more
core +2 more sources
Cross-Modal Message Passing for Two-stream Fusion
, 2019 Processing and fusing information among multi-modal is a very useful technique for achieving high performance in many computer vision problems. In order to tackle multi-modal information more effectively, we introduce a novel framework for multi-modal ...
Wang, Dong, Wang, Qi, Yuan, Yuan
core +1 more source