Results 11 to 20 of about 391,322 (253)
Sentiment Classification Based on Part-of-Speech and Self-Attention Mechanism [PDF]
IEEE Access, 2020 Currently, various attention-based neural networks have achieved successes in sentiment classification tasks, as attention mechanism is capable of focusing on those words contributing more to the sentiment polarity prediction than others.
Kefei Cheng, Yanan Yue, Zhiwen Song
doaj +2 more sources
Unsupervised Pansharpening Based on Self-Attention Mechanism [PDF]
IEEE Transactions on Geoscience and Remote Sensing, 2021 Pansharpening is to fuse a multispectral image (MSI) of low-spatial-resolution (LR) but rich spectral characteristics with a panchromatic image (PAN) of high-spatial-resolution (HR) but poor spectral characteristics. Traditional methods usually inject the extracted high-frequency details from PAN into the up-sampled MSI.
Ying Qu 0001 +3 more
openaire +2 more sources
Pixel Self-Attention Guided Real-Time Instance Segmentation for Group Raised Pigs
Animals, 2023 Instance segmentation is crucial to modern agriculture and the management of pig farms. In practical farming environments, challenges arise due to the mutual adhesion, occlusion, and dynamic changes in body posture among pigs, making accurate ...
Zongwei Jia +5 more
doaj +1 more source
Linear Complexity Randomized Self-attention Mechanism
CoRR, 2022 ICML 2022 camera ready with 37 ...
Lin Zheng, Chong Wang, Lingpeng Kong
openaire +3 more sources
Long Text Generation Adversarial Network Model with Self-Attention Mechanism [PDF]
Jisuanji kexue yu tansuo, 2022 In recent years, the communication between human and computer has reached the inseparable degree, so the natural language processing as interaction technology between human and machine attracts more and more attention from researchers. Text generation is
XIA Hongbin, XIAO Yifei, LIU Yuan
doaj +1 more source
Exploring Self-Attention Mechanisms for Speech Separation
IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2023 Transformers have enabled impressive improvements in deep learning. They often outperform recurrent and convolutional models in many tasks while taking advantage of parallel processing. Recently, we proposed the SepFormer, which obtains state-of-the-art performance in speech separation with the WSJ0-2/3 Mix datasets.
Cem Subakan +4 more
openaire +2 more sources
GIS partial discharge data enhancement method based on self attention mechanism VAE-GAN
Global Energy Interconnection, 2023 The reliability of geographic information system (GIS) partial discharge fault diagnosis is crucial for the safe and stable operation of power grids. This study proposed a data enhancement method based on a self-attention mechanism to optimize the VAE ...
Qinglin Qian +5 more
doaj +1 more source
Riemannian Self-Attention Mechanism for SPD Networks
CoRR, 2023 Symmetric positive definite (SPD) matrix has been demonstrated to be an effective feature descriptor in many scientific areas, as it can encode spatiotemporal statistics of the data adequately on a curved Riemannian manifold, i.e., SPD manifold. Although there are many different ways to design network architectures for SPD matrix nonlinear learning ...
Rui Wang 0050 +3 more
openaire +2 more sources
Self-Attention Guided Copy Mechanism for Abstractive Summarization [PDF]
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020 Copy module has been widely equipped in the recent abstractive summarization models, which facilitates the decoder to extract words from the source into the summary. Generally, the encoder-decoder attention is served as the copy distribution, while how to guarantee that important words in the source are copied remains a challenge.
Song Xu 0002 +5 more
openaire +1 more source
On the Global Self-attention Mechanism for Graph Convolutional Networks [PDF]
2020 25th International Conference on Pattern Recognition (ICPR), 2021 Applying Global Self-attention (GSA) mechanism over features has achieved remarkable success on Convolutional Neural Networks (CNNs). However, it is not clear if Graph Convolutional Networks (GCNs) can similarly benefit from such a technique. In this paper, inspired by the similarity between CNNs and GCNs, we study the impact of the Global Self ...
Chen Wang 0027, Chengyuan Deng
openaire +2 more sources