Results 11 to 20 of about 1,885,677 (275)
Normalized Mutual Information Feature Selection
IEEE Transactions on Neural Networks, 2009 A filter method of feature selection based on mutual information, called normalized mutual information feature selection (NMIFS), is presented. NMIFS is an enhancement over Battiti's MIFS, MIFS-U, and mRMR methods. The average normalized mutual information is proposed as a measure of redundancy among features.
Estevez, Pablo. A. +3 more
openaire +6 more sources
Error Exponents and α-Mutual Information
Entropy, 2021 Over the last six decades, the representation of error exponent functions for data transmission through noisy channels at rates below capacity has seen three distinct approaches: (1) Through Gallager’s E0 functions (with and without cost constraints); (2)
Sergio Verdú
doaj +1 more source
Finite Sample Based Mutual Information
IEEE Access, 2021 Mutual information is a popular metric in machine learning. In case of a discrete target variable and a continuous feature variable the mutual information can be calculated as a sum-integral of weighted log likelihood ratio of joint and marginal density ...
Khairan Rajab, Firuz Kamalov
doaj +1 more source
Estimating mutual information [PDF]
Physical Review E, 2004 We present two classes of improved estimators for mutual information $M(X,Y)$, from samples of random points distributed according to some joint probability density $ (x,y)$. In contrast to conventional estimators based on binnings, they are based on entropy estimates from $k$-nearest neighbour distances. This means that they are data efficient (with $
Kraskov, A. +2 more
openaire +4 more sources
Mutual Information and Multi-Agent Systems
Entropy, 2022 We consider the use of Shannon information theory, and its various entropic terms to aid in reaching optimal decisions that should be made in a multi-agent/Team scenario.
Ira S. Moskowitz +2 more
doaj +1 more source
Mutual information for fermionic systems
Physical Review Research, 2022 We study the behavior of the mutual information (MI) in various quadratic fermionic chains, with and without pairing terms and both with short- and long-range hoppings.
Luca Lepori +3 more
doaj +1 more source
Entropy, 2022 The nature of dependence between random variables has always been the subject of many statistical problems for over a century. Yet today, there is a great deal of research on this topic, especially focusing on the analysis of nonlinearity. Shannon mutual
Elif Tuna +4 more
doaj +1 more source
Information Bottleneck Analysis by a Conditional Mutual Information Bound
Entropy, 2021 Task-nuisance decomposition describes why the information bottleneck loss I(z;x)−βI(z;y) is a suitable objective for supervised learning. The true category y is predicted for input x using latent variables z.
Taro Tezuka, Shizuma Namekawa
doaj +1 more source
Achievable information rate optimization in C-band optical fiber communication system
Frontiers of Optoelectronics, 2023 Optical fiber communication networks play an important role in the global telecommunication network. However, nonlinear effects in the optical fiber and transceiver noise greatly limit the performance of fiber communication systems.
Zheng Liu +5 more
doaj +1 more source
An Axiomatic Characterization of Mutual Information
Entropy, 2023 We characterize mutual information as the unique map on ordered pairs of discrete random variables satisfying a set of axioms similar to those of Faddeev’s characterization of the Shannon entropy.
James Fullwood
doaj +1 more source