Results 21 to 30 of about 492,681 (274)
Training Autoencoders Using Relative Entropy Constraints
Applied Sciences, 2022 Autoencoders are widely used for dimensionality reduction and feature extraction. The backpropagation algorithm for training the parameters of the autoencoder model suffers from problems such as slow convergence.
Yanjun Li, Yongquan Yan
doaj +1 more source
Relative cluster entropy for power-law correlated sequences
SciPost Physics, 2022 We propose an information-theoretical measure, the \textit{relative cluster entropy} $\mathcal{D_{C}}[P \| Q] $, to discriminate among cluster partitions characterised by probability distribution functions $P$ and $Q$.
Anna Carbone, Linda Ponta
doaj +1 more source
Relative model of the logical entropy of sub-$\sigma_\Theta$-algebras [PDF]
Journal of Mahani Mathematical Research, 2023 In the context of observers, any mathematical model according to the viewpoint of an observer $ \Theta $ is called a relative model. The purpose of the present paper is to study the relative model of logical entropy. Given an observer $ \Theta $,
Uosef Mohammadi
doaj +1 more source
Relative entropy equals bulk relative entropy
Journal of High Energy Physics, 2016 23 pages, 3 ...
Jafferis, Daniel +3 more
openaire +3 more sources
Asymptotic Relative Entropy of Entanglement [PDF]
Physical Review Letters, 2001 We present an analytical formula for the asymptotic relative entropy of entanglement for Werner states of arbitrary dimension. We then demonstrate its validity using methods from convex optimization. To our knowledge, this is the first case in which the value of a subadditive entanglement measure has been obtained in the asymptotic limit.
Audenaert, K. +5 more
openaire +8 more sources
Parametric Bayesian Estimation of Differential Entropy and Relative Entropy
Entropy, 2010 Given iid samples drawn from a distribution with known parametric form, we propose the minimization of expected Bregman divergence to form Bayesian estimates of differential entropy and relative entropy, and derive such estimators for the uniform ...
Maya Gupta, Santosh Srivastava
doaj +1 more source
A Novel Distance Metric: Generalized Relative Entropy
Entropy, 2017 Information entropy and its extension, which are important generalizations of entropy, are currently applied to many research domains. In this paper, a novel generalized relative entropy is constructed to avoid some defects of traditional relative ...
Shuai Liu +3 more
doaj +1 more source
A limit of the quantum Renyi divergence [PDF]
, 2013 Recently, an interesting quantity called the quantum Renyi divergence (or "sandwiched" Renyi relative entropy) was defined for pairs of positive semi-definite operators $\rho$ and $\sigma$. It depends on a parameter $\alpha$ and acts as a parent quantity
Datta, Nilanjana, Leditzky, Felix
core +1 more source
A Bayesian characterization of relative entropy
Theory and Applications of Categories, 2014 We give a new characterization of relative entropy, also known as the Kullback-Leibler divergence. We use a number of interesting categories related to probability theory. In particular, we consider a category FinStat where an object is a finite set equipped with a probability distribution, while a morphism is a measure-preserving function $f: X \to Y$
Baez, John C, Fritz, Tobias
openaire +4 more sources
The improved relative entropy for face recognition
MATEC Web of Conferences, 2016 The relative entropy is least sensitive to noise. In this paper, we propose the improved relative entropy for face recognition (IRE). The IRE method of recognition rate is far higher than the LDA, LPP method, by experimental results on CMU PIE face ...
Zhang Qi Rong, Zhang Ji Yan, Wang Yan
doaj +1 more source