Results 21 to 30 of about 129,892 (308)

Modeling multimodal integration with event logic charts [PDF]

Proceedings of the 14th ACM international conference on Multimodal interaction, 2012
In this paper we present a novel approach to the combined modeling of multimodal fusion and interaction management. The approach is based on a declarative multimodal event logic that allows the integration of inputs distributed over multiple modalities in accordance to spatial, temporal and semantic constraints. In conjunction with a visual state chart
Mehlmann, Gregor, André, Elisabeth
openaire   +3 more sources

Multimodal Logical Inference System for Visual-Textual Entailment [PDF]

arXiv, 2019
A large amount of research about multimodal inference across text and vision has been recently developed to obtain visually grounded word and sentence representations. In this paper, we use logic-based representations as unified meaning representations for texts and images and present an unsupervised multimodal logical inference system that can ...
Masashi Yoshikawa, Koji Mineshima, Riko Suzuki, Hitomi Yanaka, Daisuke Bekki   +4 more
arxiv   +5 more sources

Description Logics and Rules for Multimodal Situational Awareness in Healthcare [PDF]

, 2016
Comunicació presentada a: Video Browser Showdown (VBS'17) dins 23rd International Conference on MultiMedia Modeling (MMM'17); celebrats el 4 de gener de 2017 a Reykjavik, Islàndia. We present a framework for semantic situation understand- ing and interpretation of multimodal data using Description Logics (DL) and rules. More precisely, we use
Meditskos, Georgios, Vrochidis, Stefanos, Kompatsiaris, Ioannis   +2 more
openaire   +4 more sources

Cattle welfare assessment based on adaptive fuzzy logic and multimodal data fusion

Frontiers in Veterinary Science
This study proposes a cattle welfare evaluation method based on multi-modal data fusion, which integrates various data dimensions, such as cattle behavior characteristics, feeding management conditions, and environmental parameters, to achieve a ...
Lei Tong, Lei Tong, Lei Tong, Jiandong Fang, Jiandong Fang, Jiandong Fang, Xiuling Wang, Xiuling Wang, Xiuling Wang, Yudong Zhao, Yudong Zhao   +10 more
doaj   +2 more sources

Inferring combinatorial association logic networks in multimodal genome-wide screens [PDF]

Bioinformatics, 2010
Abstract Motivation: We propose an efficient method to infer combinatorial association logic networks from multiple genome-wide measurements from the same sample. We demonstrate our method on a genetical genomics dataset, in which we search for Boolean combinations of multiple genetic loci that associate with transcript levels.
De Ridder, J. (author), Gerrits, A. (author), Bot, J. (author), De Haan, G. (author), Reinders, M. (author), Wessels, L. (author)   +5 more
openaire   +7 more sources

FlowVQA: Mapping Multimodal Logic in Visual Question Answering with Flowcharts [PDF]

arXiv
Existing benchmarks for visual question answering lack in visual grounding and complexity, particularly in evaluating spatial reasoning skills. We introduce FlowVQA, a novel benchmark aimed at assessing the capabilities of visual question-answering multimodal language models in reasoning with flowcharts as visual contexts.
Shubhankar Singh, Purvi Chaurasia, Yerram Varun, Pranshu Pandya, Vatsal Gupta, Vivek Gupta, Dan Roth   +6 more
arxiv   +3 more sources

Exploiting adaptive neuro-fuzzy inference systems for cognitive patterns in multimodal brain signal analysis [PDF]

Scientific Reports
The analysis of cognitive patterns through brain signals offers critical insights into human cognition, including perception, attention, memory, and decision-making.
T. Thamaraimanalan, Dhanalakshmi Gopal, S. Vignesh, K Kishore kumar   +3 more
doaj   +2 more sources

On the Multimodal Logic of Normative Systems [PDF]

, 2008
We introduce Multimodal Logics of Normative Systems as a contribution to the development of a general logical framework for reasoning about normative systems over logics for Multi-Agent Systems. Given a multimodal logic L, for every modality □i and normative system η, we expand the language adding a new modality □iη with the intended meaning of □iηΦ ...
Pilar Dellunde
openaire   +3 more sources

Interpretable Multimodal Out-of-Context Detection with Soft Logic Regularization

ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
ICASSP 2024 lecture ...
Ma, Huanhuan, Zhang, Jinghao, Liu, Qiang, Wu, Shu, Wang, Liang   +4 more
openaire   +3 more sources

Graded modal logic and counting message passing automata [PDF]

arXiv
We examine the relationship of graded (multi)modal logic to counting (multichannel) message passing automata with applications to the Weisfeiler-Leman algorithm. We introduce the notion of graded multimodal types, which are formulae of graded multimodal logic that encode the local information of a pointed Kripke-model. We also introduce message passing
Ahvonen, Veeti, Heiman, Damian, Kuusisto, Antti   +2 more
arxiv   +2 more sources