Results 301 to 310 of about 4,930,132 (374)

Self-Distillation of Hidden Layers for Self-Supervised Representation Learning

Scott Lowe, Anthony Fuller, Sageev Oore, Evan Shelhamer, Graham W. Taylor   +4 more
openalex   +1 more source

Adaptive Lightweight Network Construction Method for Self-Knowledge Distillation

siyuan lu, Weiliang Zeng, Xueshi Li, Jiajun Ou   +3 more
openalex   +1 more source

Hybrid model integrating LeViT transformer and distillation techniques for pattern detection and dance classification. [PDF]

Sci Rep
Wang Y.
europepmc   +1 more source

Ensemble Distribution Distillation for Self-Supervised Human Activity Recognition

Matthew Nolan, Lina Yao, Damien Robert
openalex   +1 more source

Dual-graph knowledge distillation for few-shot class-incremental microorganism recognition. [PDF]

Front Microbiol
Xu S, Hu Y, Zhang Y, Chen L, Yin Y.
europepmc   +1 more source

Some of the next articles are maybe not open access.

Related searches:

Intra-class progressive and adaptive self-distillation

Neural Networks
In recent years, knowledge distillation (KD) has become widely used in compressing models, training compact and efficient students to reduce computational load and training time due to the increasing parameters in deep neural networks. To minimize training costs, self-distillation has been proposed, with methods like offline-KD and online-KD requiring ...
Jianping Gou, Jiaye Lin, Lin Li, Weihua Ou, Baosheng Yu, Zhang Yi   +5 more
openaire   +3 more sources