Results 21 to 30 of about 15,770,233 (254)
Entropy, 2022 The nature of dependence between random variables has always been the subject of many statistical problems for over a century. Yet today, there is a great deal of research on this topic, especially focusing on the analysis of nonlinearity. Shannon mutual
Elif Tuna +4 more
doaj +1 more source
Factorized mutual information maximization [PDF]
Kybernetika, 2020 We investigate the sets of joint probability distributions that maximize the average multi-information over a collection of margins. These functionals serve as proxies for maximizing the multi-information of a set of variables or the mutual information of two subsets of variables, at a lower computation and estimation complexity.
Thomas Merkh, Guido Montúfar
openaire +5 more sources
Distribution of mutual information [PDF]
Physics Letters A, 2001 In the analysis of time series from nonlinear sources, mutual information (MI) is used as a nonlinear statistical criterion for the selection of an appropriate time delay in time delay reconstruction of the state space. MI is a statistic over the sets of sequences associated with the dynamical source, and we examine here the distribution of MI, thus ...
Abarbanel, Henry D. I. +3 more
openaire +2 more sources
Information Bottleneck Analysis by a Conditional Mutual Information Bound
Entropy, 2021 Task-nuisance decomposition describes why the information bottleneck loss I(z;x)−βI(z;y) is a suitable objective for supervised learning. The true category y is predicted for input x using latent variables z.
Taro Tezuka, Shizuma Namekawa
doaj +1 more source
Achievable information rate optimization in C-band optical fiber communication system
Frontiers of Optoelectronics, 2023 Optical fiber communication networks play an important role in the global telecommunication network. However, nonlinear effects in the optical fiber and transceiver noise greatly limit the performance of fiber communication systems.
Zheng Liu +5 more
doaj +1 more source
Fisher Information and Mutual Information Constraints [PDF]
2021 IEEE International Symposium on Information Theory (ISIT), 2021 We consider the processing of statistical samples $X\sim P_θ$ by a channel $p(y|x)$, and characterize how the statistical information from the samples for estimating the parameter $θ\in\mathbb{R}^d$ can scale with the mutual information or capacity of the channel.
Leighton Pate Barnes, Ayfer Özgür
openaire +3 more sources
Mutual Information between Order Book Layers
Entropy, 2022 The order book is a list of all current buy or sell orders for a given financial security. The rise of electronic stock exchanges introduced a debate about the relevance of the information it encapsulates of the activity of traders.
Daniel Libman +3 more
doaj +1 more source
DEM REGISTRATION BASED ON MUTUAL INFORMATION [PDF]
ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2012 The registration process forms an important step in the integration of Digital Elevation Models (DEMs) of resolution. DEM registration invariably involves what is effectively an 'image matching' process utilising similarity number of prospective image ...
M. Ravanbakhsh, C. S. Fraser
doaj +1 more source
Mutual Information Analysis [PDF]
, 2008 We propose a generic information-theoretic distinguisher for differential side-channel analysis. Our model of side-channel leakage is a refinement of the one given by Standaert et al.An embedded device containing a secret key is modeled as a black box with a leakage function whose output is captured by an adversary through the noisy measurement of a ...
Benedikt Gierlichs +3 more
openaire +2 more sources
Hashing with Mutual Information [PDF]
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2019 Binary vector embeddings enable fast nearest neighbor retrieval in large databases of high-dimensional objects, and play an important role in many practical applications, such as image and video retrieval. We study the problem of learning binary vector embeddings under a supervised setting, also known as hashing.
Fatih Çakir +3 more
openaire +4 more sources