Results 11 to 20 of about 82,164 (262)
Quantum Vision Transformers [PDF]
In this work, quantum transformers are designed and analysed in detail by extending the state-of-the-art classical transformer neural network architectures known to be very performant in natural language processing and image analysis.
El Amine Cherrat +5 more
doaj +3 more sources
ViTT: Vision Transformer Tracker [PDF]
This paper presents a new model for multi-object tracking (MOT) with a transformer. MOT is a spatiotemporal correlation task among interest objects and one of the crucial technologies of multi-unmanned aerial vehicles (Multi-UAV). The transformer is a self-attentional codec architecture that has been successfully used in natural language processing and
Zhu, Xiaoning +4 more
openaire +3 more sources
Prior works have proposed several strategies to reduce the computational cost of self-attention mechanism. Many of these works consider decomposing the self-attention procedure into regional and local feature extraction procedures that each incurs a much smaller computational complexity.
Ting Yao +5 more
openaire +3 more sources
Multiscale Vision Transformers [PDF]
Technical ...
Fan, Haoqi +6 more
openaire +2 more sources
code: https://github.com/OpenNLPLab/Vicinity-Vision ...
Weixuan Sun +9 more
openaire +3 more sources
A Survey on Vision Transformer [PDF]
Transformer, first applied to the field of natural language processing, is a type of deep neural network mainly based on the self-attention mechanism. Thanks to its strong representation capabilities, researchers are looking at ways to apply transformer to computer vision tasks.
Kai Han +12 more
openaire +2 more sources
Self-Supervised Vision Transformers for Malware Detection
Malware detection plays a crucial role in cyber-security with the increase in malware growth and advancements in cyber-attacks. Previously unseen malware which is not determined by security vendors are often used in these attacks and it is becoming ...
Sachith Seneviratne +3 more
doaj +1 more source
Adjustment of model parameters to estimate distribution transformers remaining lifespan [PDF]
Currently, the electrical system in Argentina is working at its maximum capacity, decreasing the margin between the installed power and demanded consumption, and drastically reducing the service life of transformer substations due to overload (since the ...
Gotay SardiƱas, Jorge +3 more
core +1 more source
Reversible Vision Transformers
We present Reversible Vision Transformers, a memory efficient architecture design for visual recognition. By decoupling the GPU memory requirement from the depth of the model, Reversible Vision Transformers enable scaling up architectures with efficient memory usage.
Mangalam, Karttikeya +6 more
openaire +2 more sources
Building Extraction With Vision Transformer [PDF]
Submitted to ...
Libo Wang +3 more
openaire +2 more sources

