Results 101 to 110 of about 1,512,599 (152)

Multi-Tailed Vision Transformer for Efficient Inference [PDF]

Recently, Vision Transformer (ViT) has achieved promising performance in image recognition and gradually serves as a powerful backbone in various vision tasks. To satisfy the sequential input of Transformer, the tail of ViT first splits each image into a
Wang, Yunke, Xu, Chang, Du, Bo, Wang, Wenyuan   +3 more
core  

HiViT: Hierarchical Vision Transformer Meets Masked Image Modeling

, 2022
Recently, masked image modeling (MIM) has offered a new methodology of self-supervised pre-training of vision transformers. A key idea of efficient implementation is to discard the masked image patches (or tokens) throughout the target network (encoder),
Dai, Qi, Zhang, Xiaosong, Huang, Wei, Ye, Qixiang, Tian, Qi, Tian, Yunjie, Xie, Lingxi   +6 more
core  

SVTSR: image super-resolution using scattering vision transformer

Scientific Reports
Vision transformers have garnered substantial attention and attained impressive performance in image super-resolution tasks. Nevertheless, these networks face challenges associated with attention complexity and the effective capture of intricate, fine ...
Jiabao Liang, Yutao Jin, Xiaoyan Chen, Haotian Huang, Yue Deng   +4 more
doaj   +1 more source

A Review of Transformer-Based Models for Computer Vision Tasks: Capturing Global Context and Spatial Relationships [PDF]

Transformer-based models have transformed the landscape of natural language processing (NLP) and are increasingly applied to computer vision tasks with remarkable success.
Pereira, Gracile Astlin, Hussain, Muhammad   +1 more
core  

On Vision Transformer for Ultra-short-term Forecasting of Photovoltaic Generation Using Sky Images

An accurate photovoltaic (PV) generation forecasting is important for grid scheduling and dispatching. However, ultra-short-term PV generation forecasting is rather challenging because weather conditions may change significantly in a short time period ...
Ekanayake, Chandima, Ma, Hui, Zhang, Ruiyuan, Xu, Shijie, Cui, Yi   +4 more
core   +1 more source

k-NN attention-based video vision transformer for action recognition

Action Recognition aims to understand human behavior and predict a label for each action. Recently, Vision Transformer (ViT) has achieved remarkable performance on action recognition, which models the long sequences token over spatial and temporal index ...
Wang R, Ma Y, Sun W
core   +1 more source

Flowchart for the proposed GNViT–Groundnut crop pest classification using Vision Transformer (ViT) model.

Flowchart for the proposed GNViT–Groundnut crop pest classification using Vision Transformer (ViT) model.
Venkatasaichandrakanth P. (18251607), Iyapparaja M. (18251610)   +1 more
core   +1 more source

IO Transformer: Evaluating SwinV2-Based Reward Models for Computer Vision

Transformers and their derivatives have achieved state-of-the-art performance across text, vision, and speech recognition tasks. However, minimal effort has been made to train transformers capable of evaluating the output quality of other models.
Spruyt, Jack, Meyer, Maxwell
core  

Explainable Vision Transformer for Diabetic Retinopathy Detection

Diabetic Retinopathy (DR) is a major cause of vision loss all over the world, and if diagnosed early, it can be prevented. In this paper, we propose an automated retinal image classifier using an Explainable Vision Transformer (ViT) model to classify ...
Malchalam Nikitha, Namani Deepika Rani, Pendlimadugu Hanish Reddy, Chanda Ravi Tejan Reddy   +3 more
core   +1 more source

Design and Development of Transformer Diagnostic System Application to Predict Purification Time and Transformer Life Based on Machine Learning

Transformers are equipment in high voltage engineering that often experience abnormalities originating from internal or external sources. This abnormality causes disturbances, so it is necessary to diagnose faults on the transformer as early as possible ...
Putra, Andre Yuanda
core