Results 11 to 20 of about 22,146 (252)
Shannon entropy: axiomatic characterization and application [PDF]
International Journal of Mathematics and Mathematical Sciences, 2005 We have presented a new axiomatic derivation of Shannon entropy for a discrete probability distribution on the basis of the postulates of additivity and concavity of the entropy function. We have then modified Shannon entropy to take account of observational uncertainty.The modified entropy reduces, in the limiting case, to the form of Shannon ...
C. G. Chakrabarti, Indranil Chakrabarty
doaj +3 more sources
Harnessing Shannon entropy-based descriptors in machine learning models to enhance the prediction accuracy of molecular properties [PDF]
Journal of Cheminformatics, 2023 Accurate prediction of molecular properties is essential in the screening and development of drug molecules and other functional materials. Traditionally, property-specific molecular descriptors are used in machine learning models.
Rajarshi Guha, Darrell Velegol
doaj +2 more sources
Entropy, 2016 In a power system, the analysis of transient signals is the theoretical basis of fault diagnosis and transient protection theory. Shannon wavelet entropy (SWE) and Shannon wavelet packet entropy (SWPE) are powerful mathematics tools for transient signal ...
Jikai Chen, Yang Li, Jiang Li
exaly +3 more sources
Multi-Level Thresholding Based on Composite Local Contour Shannon Entropy Under Multiscale Multiplication Transform [PDF]
EntropyImage segmentation is a crucial step in image processing and analysis, with multi-level thresholding being one of the important techniques for image segmentation.
Xianzhao Li, Yaobin Zou
doaj +2 more sources
Estimating the variance of Shannon entropy [PDF]
Physical Review E, 2021 The statistical analysis of data stemming from dynamical systems, including, but not limited to, time series, routinely relies on the estimation of information theoretical quantities, most notably Shannon entropy. To this purpose, possibly the most widespread tool is provided by the so-called plug-in estimator, whose statistical properties in terms of ...
Ricci, Leonardo +2 more
openaire +3 more sources
On the Characterization of Shannon’s Entropy by Shannon’s Inequality [PDF]
Journal of the Australian Mathematical Society, 1973 1. In [2,5,6,7] a.o. several interpretations of the inequalityfor allsuch thatwere given and the following was proved.
Aczél, János, Ostrowski, A. M.
openaire +2 more sources
Few generalized entropic relations related to Rydberg atoms
Scientific Reports, 2022 We calculate the analytical and numerical values of the position space Shannon entropy, momentum space Shannon entropy, and total Shannon entropy, $$S_\rho$$ S ρ , $$S_\gamma$$ S γ , and $$S_T$$ S T , respectively, of free and trapped Rydberg hydrogen ...
Kirtee Kumar, Vinod Prasad
doaj +1 more source
Adaptive estimation of Shannon entropy [PDF]
2015 IEEE International Symposium on Information Theory (ISIT), 2015 We consider estimating the Shannon entropy of a discrete distribution $P$ from $n$ i.i.d. samples. Recently, Jiao, Venkat, Han, and Weissman, and Wu and Yang constructed approximation theoretic estimators that achieve the minimax $L_2$ rates in estimating entropy.
Yanjun Han +2 more
openaire +2 more sources
On convergence properties of Shannon entropy [PDF]
Problems of Information Transmission, 2009 Convergence properties of Shannon Entropy are studied. In the differential setting, it is shown that weak convergence of probability measures, or convergence in distribution, is not enough for convergence of the associated differential entropies. A general result for the desired differential entropy convergence is provided, taking into account both ...
Piera Ugarte, Francisco +1 more
openaire +2 more sources
Application of Positional Entropy to Fast Shannon Entropy Estimation for Samples of Digital Signals
Entropy, 2020 This paper introduces a new method of estimating Shannon entropy. The proposed method can be successfully used for large data samples and enables fast computations to rank the data samples according to their Shannon entropy.
Marcin Cholewa, Bartłomiej Płaczek
doaj +1 more source