Results 11 to 20 of about 504,050 (265)
Attention Networks and Consciousness [PDF]
The term consciousness is an important one in the vernacular of the western literature in many fields. It is no wonder that scientists have assumed that consciousness will be found as a component of the human brain and that we will come to understand ...
Michael ePosner
doaj +3 more sources
Code is available at https://github.com/Visual-Attention ...
Meng-Hao Guo 0001 +4 more
openaire +4 more sources
On the Interpretability of Attention Networks
Attention mechanisms form a core component of several successful deep learning architectures, and are based on one key idea: ''The output depends only on a small (but unknown) segment of the input.'' In several practical applications like image captioning and language translation, this is mostly true.
Lakshmi Narayan Pandey +2 more
openaire +4 more sources
Kronecker Attention Networks [PDF]
Attention operators have been applied on both 1-D data like texts and higher-order data such as images and videos. Use of attention operators on high-order data requires flattening of the spatial or spatial-temporal dimensions into a vector, which is assumed to follow a multivariate normal distribution.
Hongyang Gao +2 more
openaire +2 more sources
The Microstructure of Attentional Control in the Dorsal Attention Network [PDF]
Abstract The top–down control of attention involves command signals arising chiefly in the dorsal attention network (DAN) in frontal and parietal cortex and propagating to sensory cortex to enable the selective processing of incoming stimuli based on their behavioral relevance.
Abhijit Rajan +6 more
openaire +3 more sources
Since their introduction, graph attention networks achieved outstanding results in graph representation learning tasks. However, these networks consider only pairwise relationships among nodes and then they are not able to fully exploit higher-order interactions present in many real world data-sets.
Giusti, Lorenzo +5 more
openaire +4 more sources
Lightweight multilayer interactive attention network for aspect-based sentiment analysis
Aspect-based sentiment analysis (ABSA) aims to automatically identify the sentiment polarity of specific aspect words in a given sentence or document. Existing studies have recognised the value of interactive learning in ABSA and have developed various ...
Wenjun Zheng +3 more
doaj +1 more source
Illuminating the Neural Circuits Underlying Orienting of Attention
Human neuroimaging has revealed brain networks involving frontal and parietal cortical areas as well as subcortical areas, including the superior colliculus and pulvinar, which are involved in orienting to sensory stimuli.
Michael I. Posner, Cristopher M. Niell
doaj +1 more source
Graph representation learning methods have mostly been limited to the modelling of node-wise interactions. Recently, there has been an increased interest in understanding how higher-order structures can be utilised to further enhance the learning abilities of graph neural networks (GNNs) in combinatorial spaces.
Christopher Wei Jin Goh +2 more
openaire +2 more sources
The Evolution and Future Development of Attention Networks
The goal of this paper is to examine how the development of attention networks has left many important issues unsolved and to propose possible directions for solving them by combining human and animal studies. The paper starts with evidence from citation
Michael I Posner
doaj +1 more source

