Dynamic Convolution: Attention Over Convolution Kernels [PDF]
Light-weight convolutional neural networks (CNNs) suffer performance degradation as their low computational budgets constrain both the depth (number of convolution layers) and the width (number of channels) of CNNs, resulting in limited representation ...
Yinpeng Chen+5 more
semanticscholar +5 more sources
Spectral characteristics of two parameter fifth degree polynomial convolution kernel [PDF]
In this paper, the spectral characteristic of a polynomial two parameter convolutional fifth-order interpolation kernel is determined. The spectral characteristic is determined as follows. First, the kernel is decomposed into components.
Milivojević Zoran+2 more
doaj +1 more source
Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognition [PDF]
Graph convolutional networks (GCNs) have been widely used and achieved remarkable results in skeleton-based action recognition. In GCNs, graph topology dominates feature aggregation and therefore is the key to extracting representative features.
Yuxin Chen+5 more
semanticscholar +1 more source
UniFormer: Unifying Convolution and Self-Attention for Visual Recognition [PDF]
It is a challenging task to learn discriminative representation from images and videos, due to large local redundancy and complex global dependency in these visual data.
Kunchang Li+7 more
semanticscholar +1 more source
PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Clouds [PDF]
We introduce Position Adaptive Convolution (PAConv), a generic convolution operation for 3D point cloud processing. The key of PAConv is to construct the convolution kernel by dynamically assembling basic weight matrices stored in Weight Bank, where the ...
Mutian Xu+3 more
semanticscholar +1 more source
Conformer: Convolution-augmented Transformer for Speech Recognition [PDF]
Recently Transformer and Convolution neural network (CNN) based models have shown promising results in Automatic Speech Recognition (ASR), outperforming Recurrent neural networks (RNNs).
Anmol Gulati+10 more
semanticscholar +1 more source
Omni-Dimensional Dynamic Convolution [PDF]
Learning a single static convolutional kernel in each convolutional layer is the common training paradigm of modern Convolutional Neural Networks (CNNs).
Chao Li, Aojun Zhou, Anbang Yao
semanticscholar +1 more source
Complexo respiratório bovino no contexto da sanidade animal
O Complexo das Doenças Respiratórias de Bovinos (CRB) é caracterizado pela infecção do trato respiratório dos animais podendo ser de origem viral, bacteriana ou através da associação de ambos.
Maycon Junior Heidmann+2 more
doaj +1 more source
Hardware Acceleration of a Generalized Fast 2-D Convolution Method for Deep Neural Networks
The hardware acceleration of Deep Neural Networks (DNN) is a highly effective and viable solution for running them on mobile devices. The power of DNNs is now available at the edge in a compact and power-efficient form factor with the aid of hardware ...
Anaam Ansari, Tokunbo Ogunfunmi
doaj +1 more source
Incorporating Convolution Designs into Visual Transformers [PDF]
Motivated by the success of Transformers in natural language processing (NLP) tasks, there emerge some attempts (e.g., ViT and DeiT) to apply Transformers to the vision domain.
Kun Yuan+5 more
semanticscholar +1 more source