Results 11 to 20 of about 23,193 (253)
Tsallis Entropy and Generalized Shannon Additivity [PDF]
Axioms, 2017 The Tsallis entropy given for a positive parameter α can be considered as a generalization of the classical Shannon entropy. For the latter, corresponding to α = 1 , there exist many axiomatic characterizations. One of them based on the well-
Sonja Jäckle, Karsten Keller
doaj +4 more sources
Introduction to logical entropy and its relationship to Shannon entropy [PDF]
4 open, 2022 We live in the information age. Claude Shannon, as the father of the information age, gave us a theory of communications that quantified an “amount of information,” but, as he pointed out, “no concept of information itself was defined.” Logical entropy ...
Ellerman David
doaj +5 more sources
Estimating the variance of Shannon entropy [PDF]
Physical Review E, 2021 The statistical analysis of data stemming from dynamical systems, including, but not limited to, time series, routinely relies on the estimation of information theoretical quantities, most notably Shannon entropy. To this purpose, possibly the most widespread tool is provided by the so-called plug-in estimator, whose statistical properties in terms of ...
Ricci, Leonardo +2 more
openaire +3 more sources
On the Characterization of Shannon’s Entropy by Shannon’s Inequality [PDF]
Journal of the Australian Mathematical Society, 1973 1. In [2,5,6,7] a.o. several interpretations of the inequalityfor allsuch thatwere given and the following was proved.
Aczél, János, Ostrowski, A. M.
openaire +2 more sources
Few generalized entropic relations related to Rydberg atoms
Scientific Reports, 2022 We calculate the analytical and numerical values of the position space Shannon entropy, momentum space Shannon entropy, and total Shannon entropy, $$S_\rho$$ S ρ , $$S_\gamma$$ S γ , and $$S_T$$ S T , respectively, of free and trapped Rydberg hydrogen ...
Kirtee Kumar, Vinod Prasad
doaj +1 more source
Shannon entropy: axiomatic characterization and application [PDF]
International Journal of Mathematics and Mathematical Sciences, 2005 We have presented a new axiomatic derivation of Shannon entropy for a discrete probability distribution on the basis of the postulates of additivity and concavity of the entropy function. We have then modified Shannon entropy to take account of observational uncertainty.The modified entropy reduces, in the limiting case, to the form of Shannon ...
C. G. Chakrabarti, Indranil Chakrabarty
doaj +4 more sources
Adaptive estimation of Shannon entropy [PDF]
2015 IEEE International Symposium on Information Theory (ISIT), 2015 We consider estimating the Shannon entropy of a discrete distribution $P$ from $n$ i.i.d. samples. Recently, Jiao, Venkat, Han, and Weissman, and Wu and Yang constructed approximation theoretic estimators that achieve the minimax $L_2$ rates in estimating entropy.
Yanjun Han +2 more
openaire +2 more sources
On convergence properties of Shannon entropy [PDF]
Problems of Information Transmission, 2009 Convergence properties of Shannon Entropy are studied. In the differential setting, it is shown that weak convergence of probability measures, or convergence in distribution, is not enough for convergence of the associated differential entropies. A general result for the desired differential entropy convergence is provided, taking into account both ...
Piera Ugarte, Francisco +1 more
openaire +2 more sources
Tsallis Wavelet Entropy and Its Application in Power Signal Analysis
Entropy, 2014 As a novel data mining approach, a wavelet entropy algorithm is used to perform entropy statistics on wavelet coefficients (or reconstructed signals) at various wavelet scales on the basis of wavelet decomposition and entropy statistic theory.
Jikai Chen, Guoqing Li
doaj +1 more source
Maximal Shannon entropy in the vicinity of an exceptional point in an open microcavity
Scientific Reports, 2020 The Shannon entropy as a measure of information contents is investigated around an exceptional point (EP) in an open elliptical microcavity as a non-Hermitian system. The Shannon entropy is maximized near the EP in the parameter space for two interacting
Kyu-Won Park +3 more
doaj +1 more source