Results 21 to 30 of about 391,322 (253)
Research progress in attention mechanism in deep learning
工程科学学报, 2021 There are two challenges with the traditional encoder–decoder framework. First, the encoder needs to compress all the necessary information of a source sentence into a fixed-length vector.
Jian-wei LIU, Jun-wen LIU, Xiong-lin LUO
doaj +1 more source
Image Super-Resolution Using Dilated Window Transformer
IEEE Access, 2023 Transformer-based networks using attention mechanisms have shown promising results in low-level vision tasks, such as image super-resolution (SR). Specifically, recent studies that utilize window-based self-attention mechanisms have exhibited notable ...
Soobin Park, Yong Suk Choi
doaj +1 more source
Pyramid Scene Parsing Network Based on Improved Self-Attention Mechanism [PDF]
Jisuanji gongcheng, 2023 In pyramid Scene Parsing Network(PSPNet), image detail information is lost as the network depth deepens, resulting in poor semantic segmentation of small objects and object edges and inaccurate pixel category prediction.To solve this problem, this paper ...
ZHENG Qiumei, XU Linkang, WANG Fenghua, LIN Chao
doaj +1 more source
Inductive Biases and Variable Creation in Self-Attention Mechanisms
CoRR, 2021 Self-attention, an architectural motif designed to model long-range interactions in sequential data, has driven numerous recent breakthroughs in natural language processing and beyond. This work provides a theoretical analysis of the inductive biases of self-attention modules.
Benjamin L. Edelman +3 more
openaire +3 more sources
Cross-Modal Recipe Retrieval with Self-Attention Mechanism
Jisuanji kexue yu tansuo, 2020 Tracking food intake is a key point for diet management. To simplify the recording process, researchers have proposed recipe retrieval technology based on food pictures.
LIN Yang, CHU Xu, WANG Yasha, MAO Weijia, ZHAO Junfeng
doaj +1 more source
Prediction Model of Chinese Punctuation Based on Self-Attention Mechanism [PDF]
Jisuanji gongcheng, 2020 Chinese Punctuation Prediction(PP) is an important task of Natural Language Pprocessing(NLP),which can help people eliminate ambiguity and understand the text more accurately.In order to solve the problem that the self-attention mechanism cannot process ...
DUAN Dagao, LIANG Shaohu, ZHAO Zhendong, HAN Zhongming
doaj +1 more source
IET Intelligent Transport Systems, 2023 Pixel segmentation is one of the most commonly used deep learning methods for modern lane line detection. Although deep segmentation outperforms traditional methods, there are two main problems: slow speed and limited receptive field.
Qin Yang +7 more
doaj +1 more source
CycleGAN Clinical Image Augmentation Based on Mask Self-Attention Mechanism
IEEE Access, 2022 With the development of society and the advancement of science and technology, artificial intelligence has also emerged as the times require. In computer vision, deep learning based on convolutional neural networks(CNN) achieves state-of-the-art ...
Junzhuo Liu +6 more
doaj +1 more source
Ghost imaging object recognition based on self-attention mechanism network
AIP Advances, 2023 A network model based on the self-attention mechanism is proposed to address the difficulties in extracting features from ghost imaging targets, low recognition efficiency, and potential errors.
Yunting He, Sheng Yuan, Jiali Song
doaj +1 more source
Aesthetic Feature Image Generation Method Embedded with Self-Attention Mechanism
Jisuanji kexue yu tansuo, 2021 In order to solve the problems such as the single structure of the generated image, the lack of rich detail features, resulting in the lack of aesthetic sense, this paper proposes an aesthetic feature image generation method embedded with self-attention ...
MA Li, ZOU Yali
doaj +1 more source