Leveraging Self-Attention Mechanism for Attitude Estimation in Smartphones [PDF]
Sensors, 2022 Inertial attitude estimation is a crucial component of many modern systems and applications. Attitude estimation from commercial-grade inertial sensors has been the subject of an abundance of research in recent years due to the proliferation of Inertial ...
James Brotchie +3 more
doaj +6 more sources
A Crowded Object Counting System with Self-Attention Mechanism [PDF]
SensorsTraditional object counting systems use object detection methods to count objects. However, when objects are small, crowded, and dense, object detection may fail, leading to inaccuracies in counting.
Cheng-Chang Lien, Pei-Chen Wu
doaj +4 more sources
Research on Anomaly Network Detection Based on Self-Attention Mechanism [PDF]
Sensors, 2023 Network traffic anomaly detection is a key step in identifying and preventing network security threats. This study aims to construct a new deep-learning-based traffic anomaly detection model through in-depth research on new feature-engineering methods ...
Wanting Hu +3 more
doaj +4 more sources
Cross-modal self-attention mechanism for controlling robot volleyball motion [PDF]
Frontiers in Neurorobotics, 2023 IntroductionThe emergence of cross-modal perception and deep learning technologies has had a profound impact on modern robotics. This study focuses on the application of these technologies in the field of robot control, specifically in the context of ...
Meifang Wang, Zhange Liang
doaj +2 more sources
Image classification model based on large kernel attention mechanism and relative position self-attention mechanism [PDF]
PeerJ Computer Science, 2023 The Transformer has achieved great success in many computer vision tasks. With the in-depth exploration of it, researchers have found that Transformers can better obtain long-range features than convolutional neural networks (CNN). However, there will be
Siqi Liu +3 more
doaj +3 more sources
Multi-Sensor Data Fusion Method Based on Self-Attention Mechanism
Applied Sciences, 2023 In 3D reconstruction tasks, single-sensor data fusion based on deep learning is limited by the integrity and accuracy of the data, which reduces the accuracy and reliability of the fusion results. To address this issue, this study proposes a multi-sensor
Xuezhu Lin +5 more
doaj +3 more sources
Double Attention: An Optimization Method for the Self-Attention Mechanism Based on Human Attention [PDF]
BiomimeticsArtificial intelligence, with its remarkable adaptability, has gradually integrated into daily life. The emergence of the self-attention mechanism has propelled the Transformer architecture into diverse fields, including a role as an efficient and ...
Zeyu Zhang +4 more
doaj +2 more sources
Attributed network embedding based on self-attention mechanism for recommendation method [PDF]
Scientific Reports, 2023 Network embedding is a technique used to learn a low-dimensional vector representation for each node in a network. This method has been proven effective in network mining tasks, especially in the area of recommendation systems.
Shuo Wang, Jing Yang, Fanshu Shang
doaj +2 more sources
Cloudformer: A Cloud-Removal Network Combining Self-Attention Mechanism and Convolution
Remote Sensing, 2022 Optical remote-sensing images have a wide range of applications, but they are often obscured by clouds, which affects subsequent analysis. Therefore, cloud removal becomes a necessary preprocessing step.
Peiyang Wu +3 more
doaj +3 more sources
Combined Self-Attention Mechanism for Chinese Named Entity Recognition in Military
Future Internet, 2019 Military named entity recognition (MNER) is one of the key technologies in military information extraction. Traditional methods for the MNER task rely on cumbersome feature engineering and specialized domain knowledge.
Fei Liao +3 more
doaj +3 more sources