Results 261 to 270 of about 3,082,804 (300)

Continuity of Generalized Entropy

2020 IEEE International Symposium on Information Theory (ISIT), 2020
We study the continuity property of the generalized entropy as a functional of probability distribution, defined with an action space and a loss function. Upper and lower bounds for the entropy difference of two distributions are derived in terms of several commonly used f-divergences, the Wasserstein distance, and a distance that depends on the action
openaire   +1 more source

GENERAL ENTROPY OF GENERAL MEASURES

International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 2002
The concept of entropy is an important part of the theory of additive measures. In this paper, a definition of entropy is introduced for general (not necessarily additive) measures as the infinum of the Shannon entropies of "subordinate" additive measures. Several properties of the general entropy are discussed and proved.
openaire   +1 more source

On a Geometric Generalization of Entropy

Problems of Information Transmission, 2003
The geometrized entropy is introduced as a generalization of Shannon's entropy and some of its properties are studied.
openaire   +1 more source

ON GENERALIZED CUMULATIVE ENTROPIES

Probability in the Engineering and Informational Sciences, 2016
In the present paper, we introduce a generalization of the cumulative entropy proposed by Di Crescenzo and Longobardi [8]. This new notion is related to the lower records and the reversed relevation transform. Dynamic version of the newly proposed measure is considered.
openaire   +2 more sources

Generalized entropies

Mathematical Notes, 1996
The purpose of this note is to study Renyi entropies from the ergodic theory viewpoint. Applications of the Renyi entropies to dynamical systems seem to have first appeared in the physical literature in order to define chaotic behaviour numerically. Here the authors present an elegant and mathematically rigorous approach to Renyi entropies.
Verbitskij, E. A., Takens, F.
openaire   +2 more sources

A generalization of entropy equation: homogeneous entropies

Kybernetika, 1985
The general continuous, positively homogeneous (of degree \(\alpha\), \(\alpha >0)\) and symmetric solutions of the equation \[ H(x,y,z)- H(x+y,0,z) =G(x,y) \qquad (x\geq 0, y\geq 0, z\geq 0, xy+yz+zx>0) \] are determined by means of distributions (in the sense of Schwartz). The corresponding homogeneous entropies are defined and characterized.
Bhu Dev Sharma, R. P. Singh
openaire   +2 more sources

Entropies, Generalized Entropies, Inequalities, and the Maximum Entropy Principle

1987
Different entropy concepts (increasingly general or particular depending on one’s point of view), the underlying knowledge (conditions, information) and inequalities associated to them are reviewed. Among the latter is the maximum entropy principle. It is proposed that entropies (in particular newly introduced ones) should be justified by showing that ...
János Aczél, Bruno Forte
openaire   +1 more source

Generalized entropies

Mathematical notes, 1998
We study the generalized Renyi entropies which were introduced in the physics literature. The proper defintion of these entropies needs, in our opinion, further clarification. We show that the Renyi entropies do not contain any new information. On the other hand, we introduce the notion of the correlation entropies, which are not invariants of the ...
Verbitskii, E.A., Takens, F.
openaire   +1 more source

A generating function for entropy

Information Processing Letters, 1975
openaire   +3 more sources

Entropy Generation of Nanofluid and Hybrid Nanofluid Flow in Thermal Systems: A Review

Journal of Molecular Liquids, 2020
Angel Huminic, Gabriela HUMINIC
exaly