Results 21 to 30 of about 402,756 (276)
Error Exponents and α-Mutual Information
Entropy, 2021 Over the last six decades, the representation of error exponent functions for data transmission through noisy channels at rates below capacity has seen three distinct approaches: (1) Through Gallager’s E0 functions (with and without cost constraints); (2)
Sergio Verdú
doaj +1 more source
The Time Evolution of Mutual Information between Disjoint Regions in the Universe
Entropy, 2023 We study the time evolution of mutual information between mass distributions in spatially separated but casually connected regions in an expanding universe.
Biswajit Pandey
doaj +1 more source
Research on Spam Filtering Technology Based on IMI-WNB Algorithm [PDF]
Jisuanji gongcheng, 2020 The application of Mutual Information(MI) and Naive Bayes(NB) algorithm to spam filtering is faced with feature redundancy and invalid independence assumption.To address the problem,this paper proposes an Improved Mutual Information-Weighted Naive Bayes ...
LIU Jie, WANG Zheng, WANG Hui
doaj +1 more source
Entropy, 2023 Information-theoretic quantities reveal dependencies among variables in the structure of joint, marginal, and conditional entropies while leaving certain fundamentally different systems indistinguishable. Furthermore, there is no consensus on the correct
Abel Jansma
doaj +1 more source
A method for continuous-range sequence analysis with Jensen-Shannon divergence
Papers in Physics, 2021 Mutual Information (MI) is a useful Information Theory tool for the recognition of mutual dependence between data sets. Several methods have been developed fore estimation of MI when both data sets are of the discrete type or when both are of the ...
Miguel Ángel Ré +1 more
doaj +1 more source
On the α-q-Mutual Information and the α-q-Capacities
Entropy, 2021 The measures of information transfer which correspond to non-additive entropies have intensively been studied in previous decades. The majority of the work includes the ones belonging to the Sharma–Mittal entropy class, such as the Rényi, the Tsallis ...
Velimir M. Ilić, Ivan B. Djordjević
doaj +1 more source
On the Difference between the Information Bottleneck and the Deep Information Bottleneck
Entropy, 2020 Combining the information bottleneck model with deep learning by replacing mutual information terms with deep neural nets has proven successful in areas ranging from generative modelling to interpreting deep neural networks. In this paper, we revisit the
Aleksander Wieczorek, Volker Roth
doaj +1 more source
Comparing Regression Techniques for Temperature Downscaling in Different Climate Classifications
Engineering Proceedings, 2023 This study aims to identify the optimal regression techniques for downscaling among ten commonly used methods in climatology, including SVR, LinearSVR, LASSO, LASSOCV, Elastic Net, Bayesian Ridge, RandomForestRegressor, AdaBoost Regressor, KNeighbors ...
Ali Ilghami Kkhosroshahi +3 more
doaj +1 more source
On the Estimation of Mutual Information
Proceedings, 2020 In this paper we focus on the estimation of mutual information from finite samples ( X × Y ) . The main concern with estimations of mutual information (MI) is their robustness under the class of transformations for which it remains invariant:
Nicholas Carrara, Jesse Ernst
doaj +1 more source
On Achievable Rates for Long-Haul Fiber-Optic Communications [PDF]
, 2015 Lower bounds on mutual information (MI) of long-haul optical fiber systems for hard-decision and soft-decision decoding are studied. Ready-to-use expressions to calculate the MI are presented.
Alvarado, Alex +3 more
core +3 more sources