R\'enyi Divergence and Kullback-Leibler Divergence [PDF]
IEEE Transactions on Information Theory, 2013 R\'enyi divergence is related to R\'enyi entropy much like Kullback-Leibler divergence is related to Shannon's entropy, and comes up in many settings.
Harremoës, Peter, van Erven, Tim
core +3 more sources
Kullback Leibler divergence in complete bacterial and phage genomes [PDF]
PeerJ, 2017 The amino acid content of the proteins encoded by a genome may predict the coding potential of that genome and may reflect lifestyle restrictions of the organism.
Sajia Akhter +5 more
doaj +3 more sources
Local inconsistency detection using the Kullback–Leibler divergence measure [PDF]
Systematic ReviewsBackground The standard approach to local inconsistency assessment typically relies on testing the conflict between the direct and indirect evidence in selected treatment comparisons.
Loukia M. Spineli
doaj +2 more sources
Divergence Measure of Belief Function and Its Application in Data Fusion
IEEE Access, 2019 Divergence measure is widely used in many applications. To efficiently deal with uncertainty in real applications, basic probability assignment (BPA) in Dempster-Shafer evidence theory, instead of probability distribution, is adopted.
Yong Deng
exaly +3 more sources
Some Order Preserving Inequalities for Cross Entropy and Kullback–Leibler Divergence [PDF]
Entropy, 2018 Cross entropy and Kullback⁻Leibler (K-L) divergence are fundamental quantities of information theory, and they are widely used in many fields. Since cross entropy is the negated logarithm of likelihood, minimizing cross entropy is equivalent to ...
Mateu Sbert +3 more
doaj +2 more sources
Balancing Reconstruction Error and Kullback-Leibler Divergence in Variational Autoencoders [PDF]
IEEE Access, 2020 Likelihood-based generative frameworks are receiving increasing attention in the deep learning community, mostly on account of their strong probabilistic foundation.
Andrea Asperti, Matteo Trentin
doaj +2 more sources
GPS-Spoofing Attack Detection Technology for UAVs Based on Kullback–Leibler Divergence
Drones, 2021 Here, we developed a method for detecting cyber security attacks aimed at spoofing the Global Positioning System (GPS) signal of an Unmanned Aerial Vehicle (UAV).
Elena Basan +5 more
doaj +2 more sources
A Deep-Learning-Based Health Indicator Constructor Using Kullback-Leibler Divergence for Predicting the Remaining Useful Life of Concrete Structures. [PDF]
Sensors (Basel), 2022 This paper proposes a new technique for the construction of a concrete-beam health indicator based on the Kullback–Leibler divergence (KLD) and deep learning.
Nguyen TK, Ahmad Z, Kim JM.
europepmc +2 more sources
Identifying critical state of complex diseases by single-sample Kullback-Leibler divergence. [PDF]
BMC Genomics, 2020 Developing effective strategies for signaling the pre-disease state of complex diseases, a state with high susceptibility before the disease onset or deterioration, is urgently needed because such state usually followed by a catastrophic transition into ...
Zhong J, Liu R, Chen P.
europepmc +2 more sources
Decoupled Kullback-Leibler Divergence Loss [PDF]
Neural Information Processing Systems, 2023 In this paper, we delve deeper into the Kullback-Leibler (KL) Divergence loss and mathematically prove that it is equivalent to the Decoupled Kullback-Leibler (DKL) Divergence loss that consists of 1) a weighted Mean Square Error (wMSE) loss and 2) a ...
Jiequan Cui +5 more
semanticscholar +1 more source