Results 201 to 210 of about 10,772 (218)

Estimating the Kullback–Leibler Divergence

2014
We now investigate how the KLD rate can be estimated from a single empirical stationary trajectory, obtained from a stochastic stationary process whose dynamics is unknown. We assume that the empirical stationary trajectory contains \(n\) data of one or several random variables denoted by the letter \(X\).
openaire   +1 more source

Kullback-Leibler Divergence for Nonnegative Matrix Factorization

2011
The I-divergence or unnormalized generalization of Kullback-Leibler (KL) divergence is commonly used in Nonnegative Matrix Factorization (NMF). This divergence has the drawback that its gradients with respect to the factorizing matrices depend heavily on the scales of the matrices, and learning the scales in gradient-descent optimization may require ...
Zhirong Yang, He Zhang 0009, Zhijian Yuan, Erkki Oja   +3 more
openaire   +1 more source

Dissipation and Kullback–Leibler Divergence

2014
In this chapter, we introduce the theoretical framework of the first part of our work, in which we study of the relationship between dissipation and irreversibility quantitatively in microscopic systems in the stationary state.
openaire   +1 more source

Kullback-Leibler divergence estimation of continuous distributions

2008 IEEE International Symposium on Information Theory, 2008
We present a method for estimating the KL divergence between continuous densities and we prove it converges almost surely. Divergence estimation is typically solved estimating the densities first. Our main result shows this intermediate step is unnecessary and that the divergence can be either estimated using the empirical cdf or k-nearest-neighbour ...
openaire   +1 more source

Generalized Kullback-Leibler Divergence

2017
The Kullback-Leibler divergence is a measure of how one probability distribution diverges from another, expected probability distribution. It is also called relative entropy and K-L distance. However, the word distance is incorrectly used, since K-L divergence does not have all metric properties.
Pokaz, Dora, Pečarić, Josip
openaire   +1 more source

Kullback–Leibler Divergence

2013
  +4 more sources

GPS-Spoofing Attack Detection Technology for UAVs Based on Kullback–Leibler Divergence

Drones, 2022
Elena Basan, Colin Fidge, Alexey Nekrasov   +2 more
exaly  

Active contour model based on local Kullback–Leibler divergence for fast image segmentation

Engineering Applications of Artificial Intelligence, 2023
Yiyang Chen, Guirong Weng
exaly  

The extended Kullback-Leibler divergence measure in the unknown probability density function cases and applications

International Journal of Intelligent Information and Database Systems, 2021
exaly   +2 more sources

A modified Kullback–Leibler divergence for non-additive measures based on Choquet integral

Fuzzy Sets and Systems, 2019
Hamzeh Agahi
exaly