Results 31 to 40 of about 59,513 (222)
Dynamic fine‐tuning layer selection using Kullback–Leibler divergence
Engineering Reports, 2023 The selection of layers in the transfer learning fine‐tuning process ensures a pre‐trained model's accuracy and adaptation in a new target domain. However, the selection process is still manual and without clearly defined criteria. If the wrong layers in
Raphael Ngigi Wanjiku +2 more
doaj +1 more source
Model Fusion with Kullback--Leibler Divergence
CoRR, 2020 We propose a method to fuse posterior distributions learned from heterogeneous datasets. Our algorithm relies on a mean field assumption for both the fused model and the individual dataset posteriors and proceeds using a simple assign-and-average approach.
Sebastian Claici +3 more
openaire +3 more sources
Algorithms, 2022 The family of α-divergences including the oriented forward and reverse Kullback–Leibler divergences is often used in signal processing, pattern recognition, and machine learning, among others.
Frank Nielsen
doaj +1 more source
Optimism in reinforcement learning and Kullback-Leibler divergence [PDF]
2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton), 2010 We consider model-based reinforcement learning in finite Markov De- cision Processes (MDPs), focussing on so-called optimistic strategies. In MDPs, optimism can be implemented by carrying out extended value it- erations under a constraint of consistency with the estimated model tran- sition probabilities. The UCRL2 algorithm by Auer, Jaksch and Ortner (
Sarah Filippi +2 more
openaire +2 more sources
The AIC Criterion and Symmetrizing the Kullback–Leibler Divergence [PDF]
IEEE Transactions on Neural Networks, 2007 The Akaike information criterion (AIC) is a widely used tool for model selection. AIC is derived as an asymptotically unbiased estimator of a function used for ranking candidate models which is a variant of the Kullback-Leibler divergence between the true model and the approximating candidate model.
Abd-Krim Seghouane, Shun-ichi Amari
openaire +3 more sources
Kullback-Leibler divergence and the Pareto-Exponential approximation. [PDF]
Springerplus, 2016 Recent radar research interests in the Pareto distribution as a model for X-band maritime surveillance radar clutter returns have resulted in analysis of the asymptotic behaviour of this clutter model. In particular, it is of interest to understand when the Pareto distribution is well approximated by an Exponential distribution.
Weinberg GV.
europepmc +4 more sources
Algorithms for Nonnegative Matrix Factorization with the Kullback–Leibler Divergence [PDF]
Journal of Scientific Computing, 2021 Nonnegative matrix factorization (NMF) is a standard linear dimensionality reduction technique for nonnegative data sets. In order to measure the discrepancy between the input data and the low-rank approximation, the Kullback-Leibler (KL) divergence is one of the most widely used objective function for NMF.
Le, Thi Khanh Hien, Gillis, Nicolas
openaire +4 more sources
Zipf–Mandelbrot law, f-divergences and the Jensen-type interpolating inequalities
Journal of Inequalities and Applications, 2018 Motivated by the method of interpolating inequalities that makes use of the improved Jensen-type inequalities, in this paper we integrate this approach with the well known Zipf–Mandelbrot law applied to various types of f-divergences and distances, such ...
Neda Lovričević +2 more
doaj +1 more source
Android Malware Detection Using Kullback-Leibler Divergence
Advances in Distributed Computing and Artificial Intelligence Journal, 2015 Many recent reports suggest that mareware applications cause high billing to victims by sending and receiving hidden SMS messages. Given that, there is a need to develop necessary technique to identify malicious SMS operations as well as differentiate ...
Vanessa N. COOPER +2 more
doaj +1 more source
Divergence Measure of Belief Function and Its Application in Data Fusion
IEEE Access, 2019 Divergence measure is widely used in many applications. To efficiently deal with uncertainty in real applications, basic probability assignment (BPA) in Dempster-Shafer evidence theory, instead of probability distribution, is adopted.
Yutong Song, Yong Deng
doaj +1 more source