Results 11 to 20 of about 318,408 (265)
Error Exponents and α-Mutual Information
Entropy, 2021 Over the last six decades, the representation of error exponent functions for data transmission through noisy channels at rates below capacity has seen three distinct approaches: (1) Through Gallager’s E0 functions (with and without cost constraints); (2)
Sergio Verdú
doaj +2 more sources
Curiosity-Driven Exploration with Information Bottleneck Representations and Matrix-Based Mutual Information [PDF]
EntropyCuriosity empowers humans to ask questions about the world and explore it without relying on extrinsic, encouraging rewards such as money. To investigate how this mechanism drives exploration, we implement a curiosity-based approach and test it in a ...
Zhaoxu Meng, Yong Cui
doaj +2 more sources
Mutual information maximizing quantum generative adversarial networks [PDF]
Scientific ReportsOne of the most promising applications in the era of Noisy Intermediate-Scale Quantum (NISQ) computing is quantum generative adversarial networks (QGANs), which offer significant quantum advantages over classical machine learning in various domains ...
Mingyu Lee +3 more
doaj +2 more sources
Finite Sample Based Mutual Information
IEEE Access, 2021 Mutual information is a popular metric in machine learning. In case of a discrete target variable and a continuous feature variable the mutual information can be calculated as a sum-integral of weighted log likelihood ratio of joint and marginal density ...
Khairan Rajab, Firuz Kamalov
doaj +1 more source
Mutual Information and Multi-Agent Systems
Entropy, 2022 We consider the use of Shannon information theory, and its various entropic terms to aid in reaching optimal decisions that should be made in a multi-agent/Team scenario.
Ira S. Moskowitz +2 more
doaj +1 more source
Generalized Mutual Information
Stats, 2020 Mutual information is one of the essential building blocks of information theory. It is however only finitely defined for distributions in a subclass of the general class of all distributions on a joint alphabet.
Zhiyi Zhang
doaj +1 more source
Mutual information for fermionic systems
Physical Review Research, 2022 We study the behavior of the mutual information (MI) in various quadratic fermionic chains, with and without pairing terms and both with short- and long-range hoppings.
Luca Lepori +3 more
doaj +1 more source
Entropy, 2022 The nature of dependence between random variables has always been the subject of many statistical problems for over a century. Yet today, there is a great deal of research on this topic, especially focusing on the analysis of nonlinearity. Shannon mutual
Elif Tuna +4 more
doaj +1 more source
Information Bottleneck Analysis by a Conditional Mutual Information Bound
Entropy, 2021 Task-nuisance decomposition describes why the information bottleneck loss I(z;x)−βI(z;y) is a suitable objective for supervised learning. The true category y is predicted for input x using latent variables z.
Taro Tezuka, Shizuma Namekawa
doaj +1 more source
An Axiomatic Characterization of Mutual Information
Entropy, 2023 We characterize mutual information as the unique map on ordered pairs of discrete random variables satisfying a set of axioms similar to those of Faddeev’s characterization of the Shannon entropy.
James Fullwood
doaj +1 more source