Results 21 to 30 of about 142,324 (226)

A Deep Hierarchical Approach to Lifelong Learning in Minecraft

, 2016
We propose a lifelong learning system that has the ability to reuse and transfer knowledge from one task to another while efficiently retaining the previously learned knowledge-base.
Givony, Shahar, Mankowitz, Daniel J., Mannor, Shie, Tessler, Chen, Zahavy, Tom   +4 more
core   +1 more source

Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation

, 2019
Convolutional neural networks have been widely deployed in various application scenarios. In order to extend the applications' boundaries to some accuracy-crucial domains, researchers have been investigating approaches to boost accuracy through either ...
Bao, Chenglong, Chen, Jingwei, Gao, Anni, Ma, Kaisheng, Song, Jiebo, Zhang, Linfeng   +5 more
core   +1 more source

Decoupled Time-Dimensional Progressive Self-Distillation With Knowledge Calibration for Edge Computing-Enabled AIoT

IEEE Access
The time-dimensional self-distillation seeks to transfer knowledge from earlier historical models to subsequent ones with minimal computational overhead.
Yingchao Wang, Wenqi Niu, Hanpo Hou
doaj   +1 more source

Building and road detection from remote sensing images based on weights adaptive multi-teacher collaborative distillation using a fused knowledge

International Journal of Applied Earth Observations and Geoinformation, 2023
Knowledge distillation is one effective approach to compress deep learning models. However, the current distillation methods are relatively monotonous. There are still rare studies about the combination of distillation strategies using multiple types of ...
Ziyi Chen, Liai Deng, Jing Gou, Cheng Wang, Jonathan Li, Dilong Li   +5 more
doaj   +1 more source

Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons

, 2018
An activation boundary for a neuron refers to a separating hyperplane that determines whether the neuron is activated or deactivated. It has been long considered in neural networks that the activations of neurons, rather than their exact output values ...
Choi, Jin Young, Heo, Byeongho, Lee, Minsik, Yun, Sangdoo   +3 more
core   +1 more source

MKD: Mixup-Based Knowledge Distillation for Mandarin End-to-End Speech Recognition

Algorithms, 2022
Large-scale automatic speech recognition model has achieved impressive performance. However, huge computational resources and massive amount of data are required to train an ASR model.
Xing Wu, Yifan Jin, Jianjia Wang, Quan Qian, Yike Guo   +4 more
doaj   +1 more source

Knowledge Distillation with Adversarial Samples Supporting Decision Boundary

, 2018
Many recent works on knowledge distillation have provided ways to transfer the knowledge of a trained network for improving the learning process of a new one, but finding a good technique for knowledge distillation is still an open problem. In this paper,
Choi, Jin Young, Heo, Byeongho, Lee, Minsik, Yun, Sangdoo   +3 more
core   +1 more source

NeuRes: Highly Activated Neurons Responses Transfer via Distilling Sparse Activation Maps

IEEE Access, 2022
In recent years, Knowledge Distillation has obtained a significant interest in mobile, edge, and IoT devices due to its ability to transfer knowledge from the large and complex teacher to the lightweight student network.
Sharmen Akhter, Md Imtiaz Hossain, Md Delowar Hossain, Eui-Nam Huh   +3 more
doaj   +1 more source

Progressive Label Distillation: Learning Input-Efficient Deep Neural Networks [PDF]

, 2019
Much of the focus in the area of knowledge distillation has been on distilling knowledge from a larger teacher network to a smaller student network. However, there has been little research on how the concept of distillation can be leveraged to distill ...
Lin, Zhong Qiu, Wong, Alexander
core   +2 more sources

Mycobacterial cell division arrest and smooth‐to‐rough envelope transition using CRISPRi‐mediated genetic repression systems

FEBS Open Bio, EarlyView.
CRISPRI‐mediated gene silencing and phenotypic exploration in nontuberculous mycobacteria. In this Research Protocol, we describe approaches to control, monitor, and quantitatively assess CRISPRI‐mediated gene silencing in M. smegmatis and M. abscessus model organisms.
Vanessa Point, Wafaa Achache, Janïs Laudouze, Eliana Sepulveda Ramos, Mickaël Maziero, Céline Crauste, Stéphane Canaan, Pierre Santucci   +7 more
wiley   +1 more source