Results 41 to 50 of about 21,351 (259)

Building and road detection from remote sensing images based on weights adaptive multi-teacher collaborative distillation using a fused knowledge

International Journal of Applied Earth Observations and Geoinformation, 2023
Knowledge distillation is one effective approach to compress deep learning models. However, the current distillation methods are relatively monotonous. There are still rare studies about the combination of distillation strategies using multiple types of ...
Ziyi Chen, Liai Deng, Jing Gou, Cheng Wang, Jonathan Li, Dilong Li   +5 more
doaj   +1 more source

CCDC80 suppresses high‐grade serous ovarian cancer migration via negative regulation of B7‐H3

Molecular Oncology, EarlyView.
PAX8 is a lineage‐specific master regulator of transcription in high‐grade serous ovarian cancer (HGSC) progression. We show for the first time that PAX8 facilitates proliferation and metastasis by repressing the cell autonomous tumor suppressor CCDC80 and inducing B7‐H3 expression.
Aya Saleh, Nitzan Medina‐Itzhaki, Milena Chekov, Eden Gal‐Swisa, Roba Gabesh‐Wahabi, Inbar Savyon, Inna Naroditsky, Hilary A. Kenny, Basem Fares, Lina Korsensky, Einav Girsh, Liron Berger, Ruth Perets   +12 more
wiley   +1 more source

MKD: Mixup-Based Knowledge Distillation for Mandarin End-to-End Speech Recognition

Algorithms, 2022
Large-scale automatic speech recognition model has achieved impressive performance. However, huge computational resources and massive amount of data are required to train an ASR model.
Xing Wu, Yifan Jin, Jianjia Wang, Quan Qian, Yike Guo   +4 more
doaj   +1 more source

Evaluating the involvement of autolysosomes in the nuclear translocation of fluorescent proteins

FEBS Open Bio, EarlyView.
Endogenously expressed fluorescent proteins can be degraded by autophagy and transported to cell nuclei via the nuclear pore complex. But in some cell lines, for example, HeLa cells which are positive for immunoreactivity of a receptor ligand, such as UCN I, in cell nuclei, fusion of autolysosome with the nuclear envelope is involved in the nuclear ...
Keiichi Ikeda
wiley   +1 more source

Counterclockwise block-by-block knowledge distillation for neural network compression

Scientific Reports
Model compression is a technique for transforming large neural network models into smaller ones. Knowledge distillation (KD) is a crucial model compression technique that involves transferring knowledge from a large teacher model to a lightweight student
Xiaowei Lan, Yalin Zeng, Xiaoxia Wei, Tian Zhang, Yiwen Wang, Chao Huang, Weikai He   +6 more
doaj   +1 more source

Knowledge Distillation in Image Classification: The Impact of Datasets

Computers
As the demand for efficient and lightweight models in image classification grows, knowledge distillation has emerged as a promising technique to transfer expertise from complex teacher models to simpler student models.
Ange Gabriel Belinga, Cédric Stéphane Tekouabou Koumetio, Mohamed El Haziti, Mohammed El Hassouni   +3 more
doaj   +1 more source

NeuRes: Highly Activated Neurons Responses Transfer via Distilling Sparse Activation Maps

IEEE Access, 2022
In recent years, Knowledge Distillation has obtained a significant interest in mobile, edge, and IoT devices due to its ability to transfer knowledge from the large and complex teacher to the lightweight student network.
Sharmen Akhter, Md Imtiaz Hossain, Md Delowar Hossain, Eui-Nam Huh   +3 more
doaj   +1 more source

From patient advocacy to patient‐driven research: Building active partnerships beginning at the bench to reach the bedside

FEBS Open Bio, EarlyView.
Research is strongest when conducted alongside patients, not just about them. Patient research organizations help integrate patient perspectives into research priorities, study design, and scientific meetings, leading to meaningful patient outcomes and development of relevant therapies.
Jenica H. Kakadia, Rachel Heilmann, Maximiliano Barrientos, Laura MacNeill, Ingrid Vallee, Sarah K. Schultz, Patrick O'Donoghue, Angelica A. Moresco, Victoria M. Siu, Ilka U. Heinemann   +9 more
wiley   +1 more source

A lightweight image classification method based on dual-source adaptive knowledge distillation

Xi'an Gongcheng Daxue xuebao, 2023
In the task of knowledge distillation, a dual-source adaptive knowledge distillation (DSAKD) method is proposed to address the issues of feature information loss during the feature alignment process and the lack of consideration for the differences in ...
ZHANG Kaibing, MA Dongtong, MENG Yalei
doaj   +1 more source

Is an Apple an Orange? A Large Language Model Benchmark for Candidate Term Extraction and Subclass Decisions Against Upper Ontologies in Engineering and Materials Science

Advanced Engineering Materials, EarlyView.
Building machine‐readable vocabularies for materials science is slow, expert‐driven work. This study benchmarks 13 large language models on two of its first steps: finding candidate terms in engineering articles and deciding where they belong in a class hierarchy.
Thomas Bjarsch, Maximilian Holland, Klaus Drechsler, Johannes Schilp   +3 more
wiley   +1 more source