Results 81 to 90 of about 1,354 (166)

Rényi Divergence rates of Ergodic Markov Chains: existence, explicit expressions and properties

, 2020
International audienceThe Kullback-Leibler divergence rate of two finite or countable ergodic Markov chains is well-known to exist and have an explicit expression as a function of the transition matrices of the chains, allowing access to classical tools ...
Girardin, Valérie, Regnault, Philippe
core   +1 more source

On Dynamic Generalized Measures of Inaccuracy

Statistica, 2017
Generalized information measures play an important role in the measurement of uncertainty of certain random variables, where the standard practice of applying ordinary uncertainty measures fails to fit.
Suchandan Kayal, Sunoj S. Madhavan, Rajesh Ganapathy   +2 more
doaj   +1 more source

Quantifying Data Dependencies with Rényi Mutual Information and Minimum Spanning Trees

Entropy, 2019
In this study, we present a novel method for quantifying dependencies in multivariate datasets, based on estimating the Rényi mutual information by minimum spanning trees (MSTs). The extent to which random variables are dependent is an important question,
Anne Eggels, Daan Crommelin
doaj   +1 more source

Rényi Divergence Variational Inference

, 2016
This paper introduces the $\textit{variational Rényi bound}$ (VR) that extends traditional variational inference to Rényi’s $\alpha$-divergences. This new family of variational methods unifies a number of existing approaches, and enables a smooth ...
Turner, RE, Li, Y, ,
core  

Approximations of Shannon Mutual Information for Discrete Variables with Applications to Neural Population Coding

Entropy, 2019
Although Shannon mutual information has been widely used, its effective calculation is often difficult for many practical problems, including those in neural population coding.
Wentao Huang, Kechen Zhang
doaj   +1 more source

Information criteria for selecting parton distribution function solutions

European Physical Journal C: Particles and Fields
In data-driven determination of Parton Distribution Functions (PDFs) in global QCD analyses, uncovering the true underlying distributions is complicated by a highly convoluted inverse problem.
Aurore Courtoy, Arturo Ibsen
doaj   +1 more source

Divergences Induced by the Cumulant and Partition Functions of Exponential Families and Their Deformations Induced by Comparative Convexity

Entropy
Exponential families are statistical models which are the workhorses in statistics, information theory, and machine learning, among others. An exponential family can either be normalized subtractively by its cumulant or free energy function, or ...
Frank Nielsen
doaj   +1 more source

Estimation of Different Entropies via Taylor One Point and Taylor Two Points Interpolations Using Jensen Type Functionals

International Journal of Analysis and Applications, 2019
In this work, we estimated the different entropies like Shannon entropy, Renyi divergences, Csiszar divergence by using the Jensen’s type functionals.
Tasadduq Niaz, Khuram Ali Khan, Dilda Pecaric, Josip Pecaric   +3 more
doaj   +2 more sources

Mechanisms for Robust Local Differential Privacy

Entropy
We consider privacy mechanisms for releasing data X=(S,U), where S is sensitive and U is non-sensitive. We introduce the robust local differential privacy (RLDP) framework, which provides strong privacy guarantees, while preserving utility.
Milan Lopuhaä-Zwakenberg, Jasper Goseling   +1 more
doaj   +1 more source

Divergence Measures Estimation and Its Asymptotic Normality Theory Using Wavelets Empirical Processes III

Journal of Statistical Theory and Applications (JSTA)
In the two previous papers of this series, the main results on the asymptotic behaviors of empirical divergence measures based on wavelets theory have been established and particularized for important families of divergence measures like Rényi and ...
Amadou Diadié Bâ, Gane Samb Lo, Diam Bâ   +2 more
doaj   +1 more source