Results 91 to 100 of about 1,354 (166)
Rényi Divergence Deep Mutual Learning
This paper revisits Deep Mutual Learning (DML), a simple yet effective computing paradigm. We propose using Rényi divergence instead of the KL divergence, which is more flexible and tunable, to improve vanilla DML.
Piao, Guangyuan +6 more
core
The Rényi divergence enables accurate and precise cluster analysis for localization microscopy
, 2020 Motivation: Clustering analysis is a key technique for quantitatively characterizing structures in localization microscopy images. To build up accurate information about biological structures, it is critical that the quantification is both accurate ...
Patrick Fox-Roberts (9352415) +6 more
core
Geometric relative entropies and barycentric Rényi divergences
, 2023 We give systematic ways of defining monotone quantum relative entropies and (multi-variate) quantum Rényi divergences starting from a set of monotone quantum relative entropies. Despite its central importance in information theory, only two additive and
Mosonyi, Milán +2 more
core
Estimations of f- and Rényi divergences by using a cyclic refinement of the Jensen's inequality
, 2019 The Jensen's inequality plays a crucial role to obtain inequalities for divergences between probability distributions. In this paper we introduce a new functional, based on the f-divergence functional, and then we obtain some estimates for the new ...
Horváth, László +2 more
core +1 more source
A duality relation connecting different quantum generalizations of the conditional Rényi entropy
, 2014 Recently a new quantum generalization of the Rényi divergence and the corresponding conditional Rényi entropies was proposed. Here we report on a surprising relation between conditional Rényi entropies based on this new generalization and conditional ...
Hayashi, M, Berta, M, Tomamichel, M
core +1 more source
Investigating properties of a family of quantum Rényi divergences
, 2015 © 2015, Springer Science+Business Media New York. Audenaert and Datta recently introduced a two-parameter family of relative Rényi entropies, known as the $$\alpha $$α–$$z$$z-relative Rényi entropies.
Lin, SM, Tomamichel, M
core +1 more source
Estimation of Rényi information divergence via pruned minimal spanning trees
, 1999 In this paper we develop robust estimators of the Rényi information divergence (I-divergence) given a reference distribution and a random sample from an unknown distribution.
Alfred Hero
core
A REFERENCE-INVARIANT HEALTH DISPARITY INDEX BASED ON RÉNYI DIVERGENCE. [PDF]
Ann Appl Stat, 2013 Talih M.
europepmc +1 more source
Regularized Rényi divergence minimization through Bregman proximal gradient algorithms
International audienceWe study the variational inference problem of minimizing a regularized Rényi divergence over an exponential family, and propose a relaxed moment-matching algorithm, which includes a proximal-like step.
Guilmeau, Thomas +2 more
core +1 more source
On the Conditional Rényi Entropy
, 2014 The Rényi entropy of general order unifies the well-known Shannon entropy with several other entropy notions, like the min-entropy or the collision entropy.
Berens, S. (Stefan) +3 more
core