Results 291 to 300 of about 219,795 (335)

SDXL-Lightning: Progressive Adversarial Diffusion Distillation

arXiv.org
We propose a diffusion distillation method that achieves new state-of-the-art in one-step/few-step 1024px text-to-image generation based on SDXL. Our method combines progressive and adversarial distillation to achieve a balance between quality and mode ...
Shanchuan Lin, Anran Wang, Xiao Yang
semanticscholar   +1 more source

A Survey on Knowledge Distillation of Large Language Models

arXiv.org
In the era of Large Language Models (LLMs), Knowledge Distillation (KD) emerges as a pivotal methodology for transferring advanced capabilities from leading proprietary LLMs, such as GPT-4, to their open-source counterparts like LLaMA and Mistral ...
Xiaohan Xu, Ming Li, Chongyang Tao, Tao Shen, Reynold Cheng, Jinyang Li, Can Xu, Dacheng Tao, Tianyi Zhou   +8 more
semanticscholar   +1 more source

Membrane Distillation and Osmotic Distillation

2010
.
Curcio E, Di Profio G, Drioli E
openaire   +4 more sources

Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation

International Conference on Machine Learning
We introduce Score identity Distillation (SiD), an innovative data-free method that distills the generative capabilities of pretrained diffusion models into a single-step generator.
Mingyuan Zhou, Huangjie Zheng, Zhendong Wang, Mingzhang Yin, Hai Huang   +4 more
semanticscholar   +1 more source

Distillation Processes and Distillates

2017
Distillation is the art and science of separating alcohol and its accompanying volatiles from its fermented base, purifying, and, ultimately, refining the spirit fraction for its intended use. The art and science of distillation is based on a combination of skills and experience, and an understanding of the processes that occur within a distillation ...
Frank Vriesekoop, Dawid Ostrowski
openaire   +1 more source

Experimental demonstration of logical magic state distillation

Nature
Realizing universal fault-tolerant quantum computation is a key goal in quantum information science1, 2, 3–4. By encoding quantum information into logical qubits using quantum error correcting codes, physical errors can be detected and corrected ...
Pedro Sales Rodriguez, John M. Robinson, P. N. Jepsen, Zhiyang He, Casey Duckering, Chen Zhao, Kai-Hsin Wu, Joseph Campo, Kevin Bagnall, Minho Kwon, Thomas Karolyshyn, Phillip Weinberg, M. Cain, S. Evered, A. Geim, Marcin Kalinowski, Sophie H. Li, T. Manovitz, J. Amato-Grill, J. Basham, Liane Bernstein, Boris Braverman, A. Bylinskii, Adam Choukri, Robert DeAngelo, Fang Fang, Connor Fieweger, Paige Frederick, David Haines, Majd Hamdan, Julian Hammett, Ning Hsu, Ming-Guang Hu, Florian Huber, Ningyuan Jia, D. Kedar, Milan Kornjavca, Fangli Liu, John Long, Jonathan Lopatin, Pedro L. S. Lopes, Xiu-Zhe Luo, Tommaso Macrì, Ognjen Markovi'c, Luis A. Mart'inez-Mart'inez, Xianmei Meng, S. Ostermann, E. Ostroumov, David Paquette, Zexuan Qiang, Vadim Shofman, Anshuman Singh, Manuj Singh, Nandan Sinha, Henry Thoreen, Noel Wan, Yiping Wang, Daniel Waxman-Lenz, Tak Wong, Jonathan Wurtz, Andrii Zhdanov, Laurent Zheng, Markus Greiner, A. Keesling, N. Gemelke, Vladan Vuleti'c, Takuya Kitagawa, Sheng-Tao Wang, D. Bluvstein, M. Lukin, Alexander Lukin, Hengyun Zhou, Sergio H. Cant'u   +72 more
semanticscholar   +1 more source

D4M: Dataset Distillation via Disentangled Diffusion Model

Computer Vision and Pattern Recognition
Dataset distillation offers a lightweight synthetic dataset for fast network training with promising test accuracy. To imitate the performance of the original dataset, most approaches employ bi-level optimization and the distillation space relies on the ...
Duo Su, Junjie Hou, Weizhi Gao, Ying-jie Tian, Bowen Tang   +4 more
semanticscholar   +1 more source

Reciprocal Teacher-Student Learning via Forward and Feedback Knowledge Distillation

IEEE transactions on multimedia
Knowledge distillation (KD) is a prevalent model compression technique in deep learning, aiming to leverage knowledge from a large teacher model to enhance the training of a smaller student model.
Jianping Gou, Yu Chen, Baosheng Yu, Jinhua Liu, Lan Du, Shaohua Wan, Zhang Yi   +6 more
semanticscholar   +1 more source

DISTILLATION

Industrial & Engineering Chemistry, 1966
William L. Bolles, James. R. Fair
openaire   +1 more source

Data, Distilled

Journal of the American College of Radiology, 2020
Sharon W, Kwan, Christoph I, Lee
openaire   +2 more sources