Results 21 to 30 of about 20,567 (255)

On the Difference between the Information Bottleneck and the Deep Information Bottleneck

Entropy, 2020
Combining the information bottleneck model with deep learning by replacing mutual information terms with deep neural nets has proven successful in areas ranging from generative modelling to interpreting deep neural networks. In this paper, we revisit the
Aleksander Wieczorek, Volker Roth
doaj   +1 more source

Comparing Regression Techniques for Temperature Downscaling in Different Climate Classifications

Engineering Proceedings, 2023
This study aims to identify the optimal regression techniques for downscaling among ten commonly used methods in climatology, including SVR, LinearSVR, LASSO, LASSOCV, Elastic Net, Bayesian Ridge, RandomForestRegressor, AdaBoost Regressor, KNeighbors ...
Ali Ilghami Kkhosroshahi, Mohammad Bejani, Hadi Pourali, Arman Hosseinpour Salehi   +3 more
doaj   +1 more source

On the Estimation of Mutual Information

Proceedings, 2020
In this paper we focus on the estimation of mutual information from finite samples ( X × Y ) . The main concern with estimations of mutual information (MI) is their robustness under the class of transformations for which it remains invariant:
Nicholas Carrara, Jesse Ernst
doaj   +1 more source

Video Summarization Based on Mutual Information and Entropy Sliding Window Method

Entropy, 2020
This paper proposes a video summarization algorithm called the Mutual Information and Entropy based adaptive Sliding Window (MIESW) method, which is specifically for the static summary of gesture videos.
WenLin Li, DeYu Qi, ChangJian Zhang, Jing Guo, JiaJun Yao   +4 more
doaj   +1 more source

Reviewing Evolution of Learning Functions and Semantic Information Measures for Understanding Deep Learning

Entropy, 2023
A new trend in deep learning, represented by Mutual Information Neural Estimation (MINE) and Information Noise Contrast Estimation (InfoNCE), is emerging. In this trend, similarity functions and Estimated Mutual Information (EMI) are used as learning and
Chenguang Lu
doaj   +1 more source

Spatial Mutual Information as Similarity Measure for 3-D Brain Image Registration

IEEE Journal of Translational Engineering in Health and Medicine, 2014
Information theoretic-based similarity measures, in particular mutual information, are widely used for intermodal/intersubject 3-D brain image registration.
Qolamreza R. Razlighi, Nasser Kehtarnavaz   +1 more
doaj   +1 more source

Two Measures of Dependence

Entropy, 2019
Two families of dependence measures between random variables are introduced. They are based on the Rényi divergence of order α and the relative
Amos Lapidoth, Christoph Pfister
doaj   +1 more source

A Hybrid Mi-Msa-Lstm Framework for Railway Freight Volume Forecasting: Integrating Mutual Information and Bio-Inspired Optimization

婉怡 董, Zhouyi Guo
openalex   +2 more sources

ClearF++: Improved Supervised Feature Scoring Using Feature Clustering in Class-Wise Embedding and Reconstruction

Bioengineering, 2023
Feature selection methods are essential for accurate disease classification and identifying informative biomarkers. While information-theoretic methods have been widely used, they often exhibit limitations such as high computational costs. Our previously
Sehee Wang, So Yeon Kim, Kyung-Ah Sohn
doaj   +1 more source

Fast scrambling of mutual information in Kerr- AdS4 spacetime

Physical Review D, 2023
We compute the disruption of mutual information between the hemispherical subsystems on the left and right conformal field theories of a thermofield double state described by a Kerr geometry in AdS4 due to shock waves along the equatorial plane. The shock waves and the subsystems considered respect the axisymmetry of the geometry.
Vinay Malvimat, Rohan R. Poojary
openaire   +1 more source