Results 301 to 310 of about 13,220,426 (366)

LinRec: Linear Attention Mechanism for Long-term Sequential Recommender Systems

Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2023
Transformer models have achieved remarkable success in sequential recommender systems (SRSs). However, computing the attention matrix in traditional dot-product attention mechanisms results in a quadratic complexity with sequence lengths, leading to high
Langming Liu, Liu Cai, Chi Zhang, Xiangyu Zhao, Jingtong Gao, Wanyu Wang, Yifu Lv, Wenqi Fan, Yiqi Wang, Ming He, Zitao Liu, Qing Li   +11 more
semanticscholar   +1 more source

The mechanisms of involuntary attention. [PDF]

Journal of Experimental Psychology: Human Perception and Performance, 2010
We tested 3 mechanisms of involuntary attention: (1) a perceptual enhancement mechanism, (2) a response-decision mechanism, and (3) a serial-search mechanism. Experiment 1 used a response deadline technique to compare the perceptual enhancement and the decision mechanisms and found evidence consistent with the decision mechanism.
Ruby Ha, Aniss Khani, William Prinzmetal
openaire   +2 more sources

A deep learning semantic segmentation network with attention mechanism for concrete crack detection

Structural Health Monitoring, 2023
In this research, an attention-based feature fusion network (AFFNet), with a backbone residual network (ResNet101) enhanced with two attention mechanism modules, is proposed for automatic pixel-level detection of concrete crack.
Jiaqi Hang, Yingjie Wu, Yancheng Li, T. Lai, Jinge Zhang, Y. Li   +5 more
semanticscholar   +1 more source

Attention mechanism in neural networks: where it comes and where it goes

Neural computing & applications (Print), 2022
A long time ago in the machine learning literature, the idea of incorporating a mechanism inspired by the human visual system into neural networks was introduced.
Derya Soydaner
semanticscholar   +1 more source

Pushing the boundaries of molecular representation for drug discovery with graph attention mechanism.

Journal of Medicinal Chemistry, 2020
Hunting for chemicals with favourable pharmacological, toxicological and pharmacokinetic properties remains a formidable challenge for drug discovery. Deep learning provides us with powerful tools to build predictive models that are appropriate for the ...
Zhaoping Xiong, Dingyan Wang, Xiaohong Liu, Feisheng Zhong, X. Wan, Xutong Li, Zhaojun Li, Xiaomin Luo, Kaixian Chen, Hualiang Jiang, M. Zheng   +10 more
semanticscholar   +1 more source

Mechanisms of attention in touch

Somatosensory & Motor Research, 1999
A series of experiments demonstrated the role of higher level cognitive processes, such as attention, in tactile perception. The first series of experiments demonstrated that automatic orienting to a tactile stimulus resulted in inhibition of subsequent stimuli at that body site--inhibition of return (IOR).
Lloyd, Donna M., Bolanowski, Stanley J., Howard, Louise, McGlone, Francis   +3 more
openaire   +3 more sources

Mechanisms of attentional priority.

Journal of Experimental Psychology: Human Perception and Performance, 1990
When a single abrupt onset occurs in a multielement visual display, it captures attention, possibly by generating an attentional interrupt that designates onsets as being of high priority. In 3 experiments, the mechanisms subserving attentional priority setting were investigated.
Douglas N. Johnson, Steven Yantis
openaire   +3 more sources

Convolutional Neural Network With Attention Mechanism for SAR Automatic Target Recognition

IEEE Geoscience and Remote Sensing Letters, 2022
Synthetic aperture radar automatic target recognition (SAR ATR) is a key technique of remote-sensing image recognition, which has many potential applications in the fields of military surveillance, national defense, civil application, and so on. With the
Ming Zhang, Jubai An, D. Yu, L. Yang, Liang Wu, X. Lu   +5 more
semanticscholar   +1 more source

ELSA: Hardware-Software Co-design for Efficient, Lightweight Self-Attention Mechanism in Neural Networks

International Symposium on Computer Architecture, 2021
The self-attention mechanism is rapidly emerging as one of the most important key primitives in neural networks (NNs) for its ability to identify the relations within input entities.
Tae Jun Ham, Yejin Lee, Seong Hoon Seo, Soo-Uck Kim, Hyunji Choi, Sungjun Jung, Jae W. Lee   +6 more
semanticscholar   +1 more source

Vehicle Trajectory Prediction Method Coupled With Ego Vehicle Motion Trend Under Dual Attention Mechanism

IEEE Transactions on Instrumentation and Measurement, 2022
Predicting the trajectory of neighboring vehicles is closely related to the driving safety of intelligent vehicles and supports driving assistance. This article proposes a dual-attention mechanism trajectory prediction method based on long short-term ...
Hongyan Guo, Qingyu Meng, Dongpu Cao, Hong Chen, Jun Liu, Bingxu Shang   +5 more
semanticscholar   +1 more source