Results 51 to 60 of about 750,957 (181)

Weighted entropy: basic inequalities

, 2017
This paper represents an extended version of an earlier note [10]. The concept of weighted entropy takes into account values of different outcomes, i.e., makes entropy context-dependent, through the weight function.
Kelbert, Mark, Stuhl, Izabella, Suhov, Yuri   +2 more
core   +1 more source

On Entropy of Some Fractal Structures

Fractal and Fractional, 2023
Shannon entropy, also known as information entropy or entropy, measures the uncertainty or randomness of probability distribution. Entropy is measured in bits, quantifying the average amount of information required to identify an event from the ...
Haleemah Ghazwani, Muhammad Faisal Nadeem, Faiza Ishfaq, Ali N. A. Koam   +3 more
doaj   +1 more source

Local information transfer as a spatiotemporal filter for complex systems

, 2008
We present a measure of local information transfer, derived from an existing averaged information-theoretical measure, namely transfer entropy. Local transfer entropy is used to produce profiles of the information transfer into each spatiotemporal point ...
A. S. Klyubin, Albert Y. Zomaya, D. Eppstein, D. J. MacKay, J. H. Conway, J. T. Lizier, Joseph T. Lizier, M. Mitchell, M. Mitchell, M. Prokopenko, Mikhail Prokopenko, N. Bertschinger, O. Miramontes, R. V. Solé, S. Wolfram, T. Helvik   +15 more
core   +1 more source

Exploring critical fluctuation phenomenon according to net-proton multiplicity information entropy in AMPT model

Physics Letters B, 2023
Information entropy can be used for investigating the critical fluctuation phenomenon by describing multiplicity fluctuations in heavy-ion collisions.
Jie Pu, Yong-Bo Yu, Kai-Xuan Cheng, Yu-Ting Wang, Ya-Fei Guo, Chun-Wang Ma   +5 more
doaj   +1 more source

Structural Information in Two-Dimensional Patterns: Entropy Convergence and Excess Entropy

, 2002
We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can be efficiently and accurately estimated via a converging sequence of ...
A. Lempel, A.G. Schlijper, A.G. Schlijper, A.G. Schlijper, A.N. Pavlov, B. Baumgartner, C. Andraud, C. Andraud, C.D.Van Siclen, D. Arnold, D. Sheinwald, D.P. Feldman, D.P. Varn, David P. Feldman, E. Olbrich, E. Soljanin, E.M. Sal’nikova, H. Meirovitch, H. Meirovitch, H. Meirovitch, H. Meirovitch, H. Meirovitch, J.D. Farmer, J.L. McCauley, J.P. Crutchfield, J.P. Crutchfield, J.P. Crutchfield, J.P. Crutchfield, J.P. Crutchfield, James P. Crutchfield, K. Lindgren, K. Lindgren, K. Young, P. Grassberger, P.-M. Binder, R. Piasecki, R. Piasecki, R. Piasecki, R.L.C. Vink, S. Goldstein, S. Marcelja, T. Schürmann, V. Spirin, V. Spirin, W. Bialek, W. Ebeling, W. Li, Y.A. Andrienko, Z. Alexandrowicz, Z. Alexandrowicz   +49 more
core   +1 more source

Ultrasound Detection of Scatterer Concentration by Weighted Entropy

Entropy, 2015
Ultrasound backscattering signals depend on the microstructures of tissues. Some studies have applied Shannon entropy to analyze the uncertainty of raw radiofrequency (RF) data.
Po-Hsiang Tsui
doaj   +1 more source

Analysis of the phase transition in the $2D$ Ising ferromagnet using a Lempel-Ziv string parsing scheme and black-box data-compression utilities

, 2014
In this work we consider information-theoretical observables to analyze short symbolic sequences, comprising time-series that represent the orientation of a single spin in a $2D$ Ising ferromagnet on a square lattice of size $L^2=128^2$, for different ...
Hartmann, A. K., Melchert, O.
core   +1 more source

An Alternative to Entropy in the Measurement of Information [PDF]

Entropy, 2004
Entropy has been the main tool in the analysis of the concept of information since information theory was conceived in the work of Shannon more than fifty years ago. There were some attempts to find more general measure of information, but their outcomes were more of formal, theoretical interest, and neither has provided better insight into the nature ...
openaire   +2 more sources

Philosophical Analysis of the Meaning and Nature of Entropy and Negative Entropy Theories

Complexity, 2020
The interpretation of entropy and negative entropy theories on the nature of information is the first scientific paradigm on the interpretation of the nature of information at the beginning of the rise of contemporary information science. The information
Kun Wu, Qiong Nan, Tianqi Wu
doaj   +1 more source

Hessian and concavity of mutual information, differential entropy, and entropy power in linear vector Gaussian channels

, 2009
Within the framework of linear vector Gaussian channels with arbitrary signaling, closed-form expressions for the Jacobian of the minimum mean square error and Fisher information matrices with respect to arbitrary parameters of the system are calculated ...
Daniel P. Palomar, Miquel Payaró, Senior Member   +2 more
core   +3 more sources