Results 21 to 30 of about 459,286 (299)

Residual Parameter Transfer for Deep Domain Adaptation [PDF]

, 2017
The goal of Deep Domain Adaptation is to make it possible to use Deep Nets trained in one domain where there is enough annotated training data in another where there is little or none.
Fua, Pascal, Rozantsev, Artem, Salzmann, Mathieu   +2 more
core   +2 more sources

Continual Learning with Low Rank Adaptation

, 2023
Recent work using pretrained transformers has shown impressive performance when fine-tuned with data from the downstream problem of interest. However, they struggle to retain that performance when the data characteristics changes. In this paper, we focus on continual learning, where a pre-trained transformer is updated to perform well on new data ...
Wistuba, Martin, Sivaprasad, Prabhu Teja, Balles, Lukas, Zappella, Giovanni   +3 more
openaire   +2 more sources

Accurate Tensor Completion via Adaptive Low-Rank Representation [PDF]

IEEE Transactions on Neural Networks and Learning Systems, 2020
Low-rank representation-based approaches that assume low-rank tensors and exploit their low-rank structure with appropriate prior models have underpinned much of the recent progress in tensor completion. However, real tensor data only approximately comply with the low-rank requirement in most cases, viz., the tensor consists of low-rank (e.g ...
Lei Zhang, Wei Wei, Qinfeng Shi, Chunhua Shen, Anton van den Hengel, Yanning Zhang   +5 more
openaire   +3 more sources

Stochastic Analysis of the LMS Algorithm for System Identification with Subspace Inputs [PDF]

, 2008
This paper studies the behavior of the low rank LMS adaptive algorithm for the general case in which the input transformation may not capture the exact input subspace.
Bermudez, José Carlos Moreira, Bershad, Neil J., Tourneret, Jean-Yves   +2 more
core   +3 more sources

Low-Rank Constrained Latent Domain Adaptation Co-Regression for Robust Depression Recognition

IEEE Access, 2019
Focusing on the facial-based depression recognition where the feature distribution could be shifted due to unlimited variations in facial image acquisition, we propose a novel Low-rank constrained latent Domain Adaptation Depression Recognition (LDADR ...
Jianwen Tao, Haote Xu, Jianjing Fu
doaj   +1 more source

Transfer Learning via Contextual Invariants for One-to-Many Cross-Domain Recommendation

, 2020
The rapid proliferation of new users and items on the social web has aggravated the gray-sheep user/long-tail item challenge in recommender systems.
Bendre, Mangesh, Das, Mahashweta, Krishnan, Adit, Sundaram, Hari, Yang, Hao   +4 more
core   +1 more source

FouRA: Fourier Low-Rank Adaptation

Advances in Neural Information Processing Systems 37
While Low-Rank Adaptation (LoRA) has proven beneficial for efficiently fine-tuning large models, LoRA fine-tuned text-to-image diffusion models lack diversity in the generated images, as the model tends to copy data from the observed training samples. This effect becomes more pronounced at higher values of adapter strength and for adapters with higher ...
Borse, Shubhankar, Kadambi, Shreya, Pandey, Nilesh Prasad, Bhardwaj, Kartikeya, Ganapathy, Viswanath, Priyadarshi, Sweta, Garrepalli, Risheek, Esteves, Rafael, Hayat, Munawar, Porikli, Fatih   +9 more
openaire   +2 more sources

Enhanced Retrieval-Augmented Generation Using Low-Rank Adaptation

Applied Sciences
Recent advancements in retrieval-augmented generation (RAG) have substantially enhanced the efficiency of information retrieval. However, traditional RAG-based systems still encounter challenges, such as high latency in output decision making, the ...
Yein Choi, Sungwoo Kim, Yipene Cedric Francois Bassole, Yunsick Sung   +3 more
doaj   +1 more source

Implementasi Sistem Konfigurasi Router Berbasis Natural Language Processing dengan Pendekatan Low Rank Adaptation Finetuning dan 8-Bit Quantization

Journal of Internet and Software Engineering, 2023
Konfigurasi Router merupakan salah satu hal penting dalam jaringan komputer. Proses ini memerlukan pemahaman tentang bahasa dan sintaks khusus yang dapat memakan waktu lama bagi seseorang yang tidak terbiasa.
Hanung Addi Chandra Utomo, Yuris Mulya Saputra, Agi Prasetiadi   +2 more
doaj   +1 more source

Multiclass Diabetic Retinopathy Classification based on Low-Rank Adaptation

CLEI Electronic Journal
Diabetic retinopathy is a vision impairment associated with diabetes mellitus, a common medical condition. Retinographic imaging analysis of retinal fundus images is the predominant method of diagnosing this eye complication.
Sebastián Ferreria-Caballero, Diego P. Pinto-Roa, José Luis Vázquez Noguera, Jordan Ayala, Pastor Pérez-Estigarribia, Pedro E. Gardel-Sotomayor   +5 more
doaj   +1 more source