Results 301 to 310 of about 377,372 (346)

Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models

International Conference on Learning Representations
In this work, we investigate whether small language models can determine high-quality subsets of large-scale text datasets that improve the performance of larger language models.
Zachary Ankner, Cody Blakeney, Kartik K. Sreenivasan, Max Marion, Matthew L. Leavitt, Mansheej Paul   +5 more
semanticscholar   +1 more source

Shortened LLaMA: A Simple Depth Pruning for Large Language Models

arXiv.org
Structured pruning of modern large language models (LLMs) has emerged as a way of decreasing their high computational needs. Width pruning reduces the size of projection weight matrices (e.g., by removing attention heads) while maintaining the number of ...
Bo-Kyeong Kim, Geonmin Kim, Tae-Ho Kim, Thibault Castells, Shinkook Choi, Junho Shin, Hyoung-Kyu Song   +6 more
semanticscholar   +1 more source

Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for Large Language Models

International Conference on Machine Learning
Despite the remarkable capabilities, Large Language Models (LLMs) face deployment challenges due to their extensive size. Pruning methods drop a subset of weights to accelerate, but many of them require retraining, which is prohibitively expensive and ...
Peijie Dong, Lujun Li, Zhenheng Tang, Xiang Liu, Xinglin Pan, Qiang Wang, Xiaowen Chu   +6 more
semanticscholar   +1 more source

Fit and Prune: Fast and Training-free Visual Token Pruning for Multi-modal Large Language Models

AAAI Conference on Artificial Intelligence
Recent progress in Multimodal Large Language Models (MLLMs) often use large image tokens to compensate the visual shortcoming of MLLMs, which not only exhibits obvious redundancy but also greatly exacerbates the already high computation. Token pruning is
Weihao Ye, Qiong Wu, Wenhao Lin, Yiyi Zhou   +3 more
semanticscholar   +1 more source

“PRUNE BELLY” SYNDROME

Medical Journal of Australia, 1979
A large sonolucent mass was first revealed by the ultrasonic echography examination of a fetus at 18 1/2 weeks' gestation, but was no longer present at 28 1/2 weeks' gestation. The fetus was subsequently born with the "prune belly" syndrome. The case is described, and the possible causes, and possibilities of prevention, of "prune belly" are discussed.
J C, Anderson, K C, Faulder, J E, Moir
openaire   +2 more sources

Prune belly syndrome

Pediatric Surgery International, 2011
The majority of paediatric surgeons will encounter a patient with prune belly syndrome (PBS) only a few times in their clinical practice. There have been many opposing views in the literature regarding the pathogenesis and management of this complex condition. A detailed review was conducted using PubMed to identify key publications involving PBS. This
S, Hassett, G H H, Smith, A J A, Holland
openaire   +2 more sources

BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation

International Conference on Learning Representations
Large language models (LLMs) have demonstrated outstanding performance in various tasks, such as text summarization, text question-answering, and etc.
Peng Xu, Wenqi Shao, Mengzhao Chen, Shitao Tang, Kai-Chuang Zhang, Peng Gao, Fengwei An, Yu Qiao, Ping Luo   +8 more
semanticscholar   +1 more source

A guide to successful pruning. Pruning shrubs

2014
Discusses different pruning techniques for shrubs.
French, Sue (Sue C.), Appleton, Bonnie Lee, 1948-2012   +1 more
openaire   +2 more sources

Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes

arXiv.org
Structured pruning is a promising approach to create smaller, faster large language models. However, existing methods typically rely on computing the gradient via backward passes, which can inflate memory requirements and compute costs.
L. Dery, Steven Kolawole, Jean-Francois Kagey, Virginia Smith, Graham Neubig, Ameet Talwalkar   +5 more
semanticscholar   +1 more source

PRUNE-BELLY SYNDROME

Archives of Pediatrics & Adolescent Medicine, 1970
Sir .—We read with interest in theJournal(132:970-972, 1978) the article by Arena and Smith, "Sex Liability to Single Structural Defects"; however, we differ with the authors in their interpretation of the etiology of "prune belly" syndrome (PBS). The authors propose that PBS is most commonly a consequence of urethral obstruction at the prostatic ...
A D, Perlmutter, A B, Retik
openaire   +2 more sources