Direct coupling analysis and the attention mechanism. [PDF]
BMC BioinformaticsProteins are involved in nearly all cellular functions, encompassing roles in transport, signaling, enzymatic activity, and more. Their functionalities crucially depend on their complex three-dimensional arrangement.
Caredda F, Pagnani A.
europepmc +4 more sources
Image classification model based on large kernel attention mechanism and relative position self-attention mechanism [PDF]
PeerJ Computer Science, 2023 The Transformer has achieved great success in many computer vision tasks. With the in-depth exploration of it, researchers have found that Transformers can better obtain long-range features than convolutional neural networks (CNN). However, there will be
Siqi Liu +3 more
doaj +2 more sources
AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfer [PDF]
IEEE International Conference on Computer Vision, 2021 Fast arbitrary neural style transfer has attracted widespread attention from academic, industrial and art communities due to its flexibility in enabling various applications. Existing solutions either attentively fuse deep style feature into deep content
Songhua Liu +8 more
semanticscholar +1 more source
AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanism [PDF]
IEEE International Conference on Computer Vision, 2023 Generating 3D human motion based on textual descriptions has been a research focus in recent years. It requires the generated motion to be diverse, natural, and conform to the textual description. Due to the complex spatio-temporal nature of human motion
Chongyang Zhong +3 more
semanticscholar +1 more source
Max-Margin Token Selection in Attention Mechanism [PDF]
Neural Information Processing Systems, 2023 Attention mechanism is a central component of the transformer architecture which led to the phenomenal success of large language models. However, the theoretical principles underlying the attention mechanism are poorly understood, especially its ...
Davoud Ataee Tarzanagh +3 more
semanticscholar +1 more source
Self-Supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation [PDF]
Computer Vision and Pattern Recognition, 2020 Image-level weakly supervised semantic segmentation is a challenging problem that has been deeply studied in recent years. Most of advanced solutions exploit class activation map (CAM).
Yude Wang +4 more
semanticscholar +1 more source
Surface Defect Detection With Channel-Spatial Attention Modules and Bi-Directional Feature Pyramid
IEEE Access, 2023 The YOLOv5 network architecture prioritizes speed and efficiency, but this may limit its ability to capture intricate details of complex objects. To solve the problems of insufficient feature extraction ability and incomplete feature fusion in the YOLOv5
Haitao Xin, Kai Zhang
doaj +1 more source
User Trajectory Identification Model via Attention Mechanism [PDF]
Jisuanji kexue, 2022 Recently the application of location-based services has gradually become popular.It provides convenience in people's daily life,and also brings a great threat to personal privacy.The existing research shows that,with a large amount of historical ...
LI Hao, CAO Shu-yu, CHEN Ya-qing, ZHANG Min
doaj +1 more source
Multibranch Attention Mechanism Based on Channel and Spatial Attention Fusion
Mathematics, 2022 Recently, it has been demonstrated that the performance of an object detection network can be improved by embedding an attention module into it. In this work, we propose a lightweight and effective attention mechanism named multibranch attention (M3Att).
Guojun Mao +3 more
doaj +1 more source
Deep Learning Attention Mechanism in Medical Image Analysis: Basics and Beyonds
International Journal of Network Dynamics and Intelligence, 2023 Survey/review study Deep Learning Attention Mechanism in Medical Image Analysis: Basics and Beyonds Xiang Li 1, Minglei Li 1, Pengfei Yan 1, Guanyi Li 1, Yuchen Jiang 1, Hao Luo 1,*, and Shen Yin 2 1 Department of Control Science and Engineering ...
Xiang Li +6 more
semanticscholar +1 more source