Results 1 to 10 of about 21,713 (152)

An Information-Theoretic Analysis of High-Frequency Load Disaggregation [PDF]

open access: yesEntropy
High-frequency non-intrusive load monitoring provides detailed harmonic information for appliances’ power disaggregation, and machine-learning approaches have demonstrated good performance in this task.
Gabriel Arquelau Pimenta Rodrigues   +4 more
doaj   +2 more sources

Adaptive Radar Waveform Design Based on Weighted MI and the Difference of Two Mutual Information Metrics

open access: yesComplexity, 2021
This study deals with the problem of radar waveform design based on the weighted mutual information (MI) and the difference of two mutual information metrics (DMI) in signal-dependent interference. Since the target and clutter information are included in
Fengming Xin   +4 more
doaj   +2 more sources

On Normalized Mutual Information: Measure Derivations and Properties

open access: yesEntropy, 2017
Starting with a new formulation for the mutual information (MI) between a pair of events, this paper derives alternative upper bounds and extends those to the case of two discrete random variables.
Tarald O Kvålseth
exaly   +3 more sources

Uncovering Neural Learning Dynamics Through Latent Mutual Information [PDF]

open access: yesEntropy
We study how convolutional neural networks reorganize information during learning in natural image classification tasks by tracking mutual information (MI) between inputs, intermediate representations, and labels. Across VGG-16, ResNet-18, and ResNet-50,
Arianna Issitt   +4 more
doaj   +2 more sources

Error Exponents and α-Mutual Information

open access: yesEntropy, 2021
Over the last six decades, the representation of error exponent functions for data transmission through noisy channels at rates below capacity has seen three distinct approaches: (1) Through Gallager’s E0 functions (with and without cost constraints); (2)
Sergio Verdú
doaj   +1 more source

The Time Evolution of Mutual Information between Disjoint Regions in the Universe

open access: yesEntropy, 2023
We study the time evolution of mutual information between mass distributions in spatially separated but casually connected regions in an expanding universe.
Biswajit Pandey
doaj   +1 more source

Research on Spam Filtering Technology Based on IMI-WNB Algorithm [PDF]

open access: yesJisuanji gongcheng, 2020
The application of Mutual Information(MI) and Naive Bayes(NB) algorithm to spam filtering is faced with feature redundancy and invalid independence assumption.To address the problem,this paper proposes an Improved Mutual Information-Weighted Naive Bayes ...
LIU Jie, WANG Zheng, WANG Hui
doaj   +1 more source

Higher-Order Interactions and Their Duals Reveal Synergy and Logical Dependence beyond Shannon-Information

open access: yesEntropy, 2023
Information-theoretic quantities reveal dependencies among variables in the structure of joint, marginal, and conditional entropies while leaving certain fundamentally different systems indistinguishable. Furthermore, there is no consensus on the correct
Abel Jansma
doaj   +1 more source

A method for continuous-range sequence analysis with Jensen-Shannon divergence

open access: yesPapers in Physics, 2021
Mutual Information (MI) is a useful Information Theory tool for the recognition of mutual dependence between data sets. Several methods have been developed fore estimation of MI when both data sets are of the discrete type or when both are of the ...
Miguel Ángel Ré   +1 more
doaj   +1 more source

MI-DPG: Decomposable Parameter Generation Network Based on Mutual Information for Multi-Scenario Recommendation

open access: yesProceedings of the 32nd ACM International Conference on Information and Knowledge Management, 2023
Conversion rate (CVR) prediction models play a vital role in recommendation and advertising systems. Recent research on multi-scenario recommendation shows that learning a unified model to serve multiple scenarios is effective for improving overall performance.
Wenzhuo Cheng   +5 more
openaire   +2 more sources

Home - About - Disclaimer - Privacy