Results 31 to 40 of about 13,220,426 (366)

Toward understanding the effectiveness of attention mechanism

AIP Advances, 2023
Attention mechanism (AM) is a widely used method for improving the performance of convolutional neural networks (CNNs) on computer vision tasks. Despite its pervasiveness, we have a poor understanding of what its effectiveness stems from. It is popularly
Xiang Ye, Zihang He, Wang Heng, Yong Li
doaj   +1 more source

Persistence pays off: Paying Attention to What the LSTM Gating Mechanism Persists [PDF]

, 2018
Language Models (LMs) are important components in several Natural Language Processing systems. Recurrent Neural Network LMs composed of LSTM units, especially those augmented with an external memory, have achieved state-of-the-art results. However, these
Kelleher, John D., Salton, Giancarlo D.
core   +3 more sources

Multiple-Attention Mechanism Network for Semantic Segmentation

Sensors, 2022
Contextual information and the dependencies between dimensions is vital in image semantic segmentation. In this paper, we propose a multiple-attention mechanism network (MANet) for semantic segmentation in a very effective and efficient way.
Dongli Wang, Shengliang Xiang, Yan Zhou, Jinzhen Mu, Haibin Zhou, Richard Irampaye   +5 more
doaj   +1 more source

Attention mechanisms in the CHREST cognitive architecture [PDF]

, 2008
In this paper, we describe the attention mechanisms in CHREST, a computational architecture of human visual expertise. CHREST organises information acquired by direct experience from the world in the form of chunks.
A. Newell, A.D. Groot de, A.D. Groot de, D. Freudenthal, E.A. Feigenbaum, F. Gobet, F. Gobet, F. Gobet, F. Gobet, F. Gobet, F. Gobet, F. Gobet, F. Gobet, F. Gobet, H.A. Simon, H.A. Simon, H.A. Simon, I. Biederman, J.K. Tsotsos, J.M. Wolfe, J.R. Anderson, M.C. Burl, P. Lindsay, P.C.R. Lane, P.C.R. Lane, S. Minton, U. Neisser, W.G. Chase   +27 more
core   +1 more source

Personalized Graph Neural Networks With Attention Mechanism for Session-Aware Recommendation

IEEE Transactions on Knowledge and Data Engineering, 2022
The problem of session-aware recommendation aims to predict users’ next click based on their current session and historical sessions. Existing session-aware recommendation methods have defects in capturing complex item transition relationships.
Mengqi Zhang, Shu Wu, Meng Gao, Xin Jiang, Ke Xu, Liang Wang   +5 more
semanticscholar   +1 more source

IDS-attention: an efficient algorithm for intrusion detection systems using attention mechanism

Journal of Big Data, 2021
Network attacks are illegal activities on digital resources within an organizational network with the express intention of compromising systems. A cyber attack can be directed by individuals, communities, states or even from an anonymous source.
FatimaEzzahra Laghrissi, Samira Douzi, Khadija Douzi, Badr Hssina   +3 more
doaj   +1 more source

Neural mechanisms of social attention [PDF]

Trends in Cognitive Sciences, 2009
Social attention is conveyed primarily by gaze, but also by head and body orientation. These cues not only signal a seen agent's direction of attention but are also used to infer their current goals and intentions. Here, we review recent research showing that different gaze, head and body orientations are represented by distinct neural mechanisms, and ...
Lauri Nummenmaa, Andrew J. Calder
openalex   +4 more sources

Attentional mechanisms in the generation of sympathy

Judgment and Decision Making, 2009
AbstractEmpathic responses, such as sympathy towards others, are a key ingredient in the decision to provide help to those in need. The determinants of empathic responses are usually thought to be the vividness, similarity, and proximity of the victim. However, recent research highlights the role that attention plays in the generation of feelings.
Dickert, Stephan, Slovic, Paul
openaire   +9 more sources

Attentional Colorization Networks with Adaptive Group-Instance Normalization

Information, 2020
We propose a novel end-to-end image colorization framework which integrates attention mechanism and a learnable adaptive normalization function. In contrast to previous colorization methods that directly generate the whole image, we believe that the ...
Yuzhen Gao, Youdong Ding, Fei Wang, Huan Liang   +3 more
doaj   +1 more source

An Ionospheric TEC Forecasting Model Based on a CNN-LSTM-Attention Mechanism Neural Network

Remote Sensing, 2022
Ionospheric forecasts are critical for space-weather anomaly detection. Forecasting ionospheric total electron content (TEC) from the global navigation satellite system (GNSS) is of great significance to near-earth space environment monitoring.
Jun Tang, Yinjian Li, Mingfei Ding, Heng Liu, Dengpan Yang, Xuequn Wu   +5 more
semanticscholar   +1 more source