Results 21 to 30 of about 25,150 (262)

Dual Vision Transformer

open access: yesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2023
Prior works have proposed several strategies to reduce the computational cost of self-attention mechanism. Many of these works consider decomposing the self-attention procedure into regional and local feature extraction procedures that each incurs a much smaller computational complexity.
Ting Yao 0003   +5 more
openaire   +3 more sources

Transformer-Based Semantic Segmentation for Extraction of Building Footprints from Very-High-Resolution Images

open access: yesSensors, 2023
Semantic segmentation with deep learning networks has become an important approach to the extraction of objects from very high-resolution remote sensing images.
Jia Song, A-Xing Zhu, Yunqiang Zhu
doaj   +1 more source

Super Vision Transformer

open access: yesInternational Journal of Computer Vision, 2023
We attempt to reduce the computational costs in vision transformers (ViTs), which increase quadratically in the token number. We present a novel training paradigm that trains only one ViT model at a time, but is capable of providing improved image recognition performance with various computational costs. Here, the trained ViT model, termed super vision
Mingbao Lin   +6 more
openaire   +2 more sources

Scaling Vision Transformers

open access: yes2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
Attention-based neural networks such as the Vision Transformer (ViT) have recently attained state-of-the-art results on many computer vision benchmarks. Scale is a primary ingredient in attaining excellent results, therefore, understanding a model's scaling properties is a key to designing future generations effectively.
Xiaohua Zhai   +3 more
openaire   +2 more sources

A Review of Transformer-Based Approaches for Image Captioning

open access: yesApplied Sciences, 2023
Visual understanding is a research area that bridges the gap between computer vision and natural language processing. Image captioning is a visual understanding task in which natural language descriptions of images are automatically generated using ...
Oscar Ondeng, Heywood Ouma, Peter Akuon
doaj   +1 more source

STHarDNet: Swin Transformer with HarDNet for MRI Segmentation

open access: yesApplied Sciences, 2022
In magnetic resonance imaging (MRI) segmentation, conventional approaches utilize U-Net models with encoder–decoder structures, segmentation models using vision transformers, or models that combine a vision transformer with an encoder–decoder model ...
Yeonghyeon Gu   +2 more
doaj   +1 more source

Building Extraction With Vision Transformer [PDF]

open access: yesIEEE Transactions on Geoscience and Remote Sensing, 2022
Submitted to ...
Libo Wang   +3 more
openaire   +2 more sources

Peripheral Vision Transformer

open access: yesAdvances in Neural Information Processing Systems 35, 2022
Human vision possesses a special type of visual processing systems called peripheral vision. Partitioning the entire visual field into multiple contour regions based on the distance to the center of our gaze, the peripheral vision provides us the ability to perceive various visual features at different regions.
Juhong Min   +3 more
openaire   +3 more sources

Vicinity Vision Transformer

open access: yesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2023
code: https://github.com/OpenNLPLab/Vicinity-Vision ...
Weixuan Sun   +9 more
openaire   +3 more sources

Vision Transformer with Progressive Sampling [PDF]

open access: yes2021 IEEE/CVF International Conference on Computer Vision (ICCV), 2021
Accepted to ICCV ...
Xiaoyu Yue   +6 more
openaire   +3 more sources

Home - About - Disclaimer - Privacy