Results 11 to 20 of about 20,567 (255)

Uncovering Neural Learning Dynamics Through Latent Mutual Information [PDF]

Entropy
We study how convolutional neural networks reorganize information during learning in natural image classification tasks by tracking mutual information (MI) between inputs, intermediate representations, and labels. Across VGG-16, ResNet-18, and ResNet-50,
Arianna Issitt, Alex Merino, Lamine Deen, Ryan T. White, Mackenzie J. Meni   +4 more
doaj   +2 more sources

Pengenalan Aktivitas Manusia dengan Seleksi Fitur Analysis of Variance (ANOVA) dan Mutual Information (MI) pada Data Sensor Accelerometer Berbasis Machine Learning

Jurnal Sistem dan Informatika (JSI)
Pengenalan aktivitas manusia telah banyak dikembangkan untuk berbagai keperluan, seperti kesehatan, olahraga, hingga pengawasan lanjut usia. Penggunaan perangkat sensor menjadi salah satu pilihan dalam melakukan pengenalan aktivitas manusia. Sensor accelerometer adalah salah satu perangkat yang umum digunakan dalam pengenalan aktivitas. Data sensor ini
Made Liandana, I Made Darma Susila, Yohanes Priyo Atmojo   +2 more
openalex   +3 more sources

GCNS-MI: EEG Recognition of Depression Based on Graph Mutual Information Maximization

SSRN Electronic Journal, 2022
Wei Li, Hong Wang, Luhe Zhuang, Hui Zhang, Shu Han, Yuanjie Zheng   +5 more
openalex   +2 more sources

An epilepsy prediction and management system based on federated learning combined with hybrid harmony search and mutual information (HAS-MI)-based feature selection approach. [PDF]

Sci Rep
Khan MAR, Heba KM, Abbass AH, Shaikh MA, Tejani GG, Sharma SK, Ma'aitah MKS.   +6 more
europepmc   +2 more sources

Error Exponents and α-Mutual Information

Entropy, 2021
Over the last six decades, the representation of error exponent functions for data transmission through noisy channels at rates below capacity has seen three distinct approaches: (1) Through Gallager’s E0 functions (with and without cost constraints); (2)
Sergio Verdú
doaj   +1 more source

The Time Evolution of Mutual Information between Disjoint Regions in the Universe

Entropy, 2023
We study the time evolution of mutual information between mass distributions in spatially separated but casually connected regions in an expanding universe.
Biswajit Pandey
doaj   +1 more source

Research on Spam Filtering Technology Based on IMI-WNB Algorithm [PDF]

Jisuanji gongcheng, 2020
The application of Mutual Information(MI) and Naive Bayes(NB) algorithm to spam filtering is faced with feature redundancy and invalid independence assumption.To address the problem,this paper proposes an Improved Mutual Information-Weighted Naive Bayes ...
LIU Jie, WANG Zheng, WANG Hui
doaj   +1 more source

Higher-Order Interactions and Their Duals Reveal Synergy and Logical Dependence beyond Shannon-Information

Entropy, 2023
Information-theoretic quantities reveal dependencies among variables in the structure of joint, marginal, and conditional entropies while leaving certain fundamentally different systems indistinguishable. Furthermore, there is no consensus on the correct
Abel Jansma
doaj   +1 more source

A method for continuous-range sequence analysis with Jensen-Shannon divergence

Papers in Physics, 2021
Mutual Information (MI) is a useful Information Theory tool for the recognition of mutual dependence between data sets. Several methods have been developed fore estimation of MI when both data sets are of the discrete type or when both are of the ...
Miguel Ángel Ré, Guillermo Gabriel Aguirre Varela   +1 more
doaj   +1 more source

On the α-q-Mutual Information and the α-q-Capacities

Entropy, 2021
The measures of information transfer which correspond to non-additive entropies have intensively been studied in previous decades. The majority of the work includes the ones belonging to the Sharma–Mittal entropy class, such as the Rényi, the Tsallis ...
Velimir M. Ilić, Ivan B. Djordjević
doaj   +1 more source