Results 31 to 40 of about 13,997,719 (325)
A Remote Sensing Image Destriping Model Based on Low-Rank and Directional Sparse Constraint
Remote Sensing, 2021 Stripe noise is a common condition that has a considerable impact on the quality of the images. Therefore, stripe noise removal (destriping) is a tremendously important step in image processing.
Xiaobin Wu +4 more
doaj +1 more source
Bayesian low-rank adaptation for large language models [PDF]
International Conference on Learning Representations, 2023 Low-rank adaptation (LoRA) has emerged as a new paradigm for cost-efficient fine-tuning of large language models (LLMs). However, fine-tuned LLMs often become overconfident especially when fine-tuned on small datasets.
Adam X. Yang +3 more
semanticscholar +1 more source
Delta-LoRA: Fine-Tuning High-Rank Parameters with the Delta of Low-Rank Matrices [PDF]
arXiv.org, 2023 In this paper, we present Delta-LoRA, which is a novel parameter-efficient approach to fine-tune large language models (LLMs). In contrast to LoRA and other low-rank adaptation methods such as AdaLoRA, Delta-LoRA not only updates the low-rank matrices ...
Bojia Zi +5 more
semanticscholar +1 more source
The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices [PDF]
Journal of Structural Biology, 2010 The limitation of using low electron doses in non-destructive cryo-electron tomography of biological specimens can be partially offset via averaging of aligned and structurally homogeneous subsets present in tomograms.
Zhouchen Lin, Minming Chen, Yi Ma
semanticscholar +1 more source
Language model compression with weighted low-rank factorization [PDF]
International Conference on Learning Representations, 2022 Factorizing a large matrix into small matrices is a popular strategy for model compression. Singular value decomposition (SVD) plays a vital role in this compression strategy, approximating a learned matrix with fewer parameters.
Yen-Chang Hsu +5 more
semanticscholar +1 more source
International Journal of Coal Science & Technology, 2017 Benzene carboxylic acid (BCAs) are common and useful chemical blocks, which can be derived from the abundant low rank coals (LRCs) via oxidative degradation. In this work, we proposed a novel strategy to utilize BCAs as raw materials to prepare catalysts
Huacong Zhou +8 more
doaj +1 more source
IEEE Open Journal of Control Systems, 2023 Several recent empirical studies demonstrate that important machine learning tasks such as training deep neural networks, exhibit a low-rank structure, where most of the variation in the loss function occurs only in a few directions of the input space ...
Romain Cosson +4 more
doaj +1 more source
Low-Rank Tensor Function Representation for Multi-Dimensional Data Recovery [PDF]
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022 Since higher-order tensors are naturally suitable for representing multi-dimensional data in real-world, e.g., color images and videos, low-rank tensor representation has become one of the emerging areas in machine learning and computer vision.
Yisi Luo +4 more
semanticscholar +1 more source
InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning [PDF]
Computer Vision and Pattern RecognitionContinual learning requires the model to learn multiple tasks sequentially. In continual learning, the model should possess the ability to maintain its performance on old tasks (stability) and the ability to adapt to new tasks continuously (plasticity ...
Yan-Shuo Liang, Wu-Jun Li
semanticscholar +1 more source
A Non-Local Low-Rank Algorithm for Sub-Bottom Profile Sonar Image Denoising
Remote Sensing, 2020 Due to the influence of equipment instability and surveying environment, scattering echoes and other factors, it is sometimes difficult to obtain high-quality sub-bottom profile (SBP) images by traditional denoising methods.
Shaobo Li +4 more
doaj +1 more source