Results 161 to 170 of about 11,611 (196)

Renyi Entropy Properties of Order Statistics

Communications in Statistics - Theory and Methods, 2010
In this article, we discuss some properties of Renyi entropy and Renyi information of order statistics. Some bounds for Renyi entropy of order statistics are obtained. Also, we relate Renyi entropy ordering of order statistics to Renyi entropy ordering and other well known orderings of parent random variables.
M. Abbasnejad, N. R. Arghami
openaire   +3 more sources

Renyi entropy as a statistical entropy for complex systems

Theoretical and Mathematical Physics, 2006
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
openaire   +3 more sources

Clustering using Renyi's entropy

Proceedings of the International Joint Conference on Neural Networks, 2003., 2004
We propose a new clustering algorithm using Renyi's entropy as our similarity metric. The main idea is to assign a data pattern to the cluster, which among all possible clusters, increases its within-cluster entropy the least, upon inclusion of the pattern. We refer to this procedure as differential entropy clustering.
R. Jenssen, K.E. Hild, D. Erdogmus, J.C. Principe, T. Eltoft   +4 more
openaire   +1 more source

A recursive Renyi's entropy estimator

Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing, 2003
Estimating the entropy of a sample set is required, in solving numerous learning scenarios involving information theoretic optimization criteria. A number of entropy estimators are available in the literature; however, these require a batch of samples to operate on in order to yield an estimate.
D. Erdogmus, J.C. Principe, null Sung-Phil Kim, J.C. Sanchez   +3 more
openaire   +1 more source

Smooth renyi entropy and applications

International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings., 2004
We introduce a new entropy measure, called smooth Renyi entropy. The measure characterizes fundamental properties of a random variable Z, such as the amount of uniform randomness that can be extracted from Z or the minimum length of an encoding of Z.
R. Renner, S. Wolf
openaire   +1 more source

Renyi entropy and conditional Renyi entropy of partitions of algebraic structures

Journal of Algebraic Hyperstructures and Logical Algebras
The present paper is devoted to the study of Renyi entropy in algebraic structures. We define Renyi entropy of order q and its conditional version for a partition of an algebraic structure, and we study their properties. In particular, we show that the Renyi entropy of a partition is monotonically decreasing.
H.M.H. Zarenezhad, J. Jamalzadeh
openaire   +1 more source

Rényi Entropies of Projections

2006 IEEE International Symposium on Information Theory, 2006
In this paper we are interested in n-dimensional uniform distributions on a triangle and a sphere. We show that their marginal distributions are maximizers of Renyi entropy under a constraint of variance and expectation in the respective cases of the sphere and of the triangle. Moreover, using an example, we show that a distribution on a triangle with (
Harremoës, P., Vignat, Christophe
openaire   +2 more sources

Statistical mechanics based on Renyi entropy

Physica A: Statistical Mechanics and its Applications, 2000
In this work we show that it is possible to obtain a generalized statistical mechanics (thermostatistics) based on Renyi entropy, to be maximized with adequate constraints. The equilibrium probability distribution thus obtained has a very interesting property. Indeed, it reminds us the statistical distribution proposed by Tsallis, known to conveniently
E.K. Lenzi, R.S. Mendes, L.R. da Silva
openaire   +1 more source

Weighted Renyi's entropy for lifetime distributions

Communications in Statistics - Theory and Methods, 2017
Recently, Di Crescenzo and Longobardi (2006) have studied “length-biased” shift-dependent information measure and its dynamic versions.
Mohammadreza Nourbakhsh, Gholamhoseein Yari   +1 more
openaire   +1 more source

Renyi's entropy for residual lifetime distribution

Statistical Papers, 2006
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
Abraham, B., Sankaran, P. G.
openaire   +2 more sources