Theory and Application of the Information Bottleneck Method [PDF]
EntropyIn 1999, Naftali Tishby et al [...]
Jan Lewandowsky, Gerhard Bauch
doaj +6 more sources
Information-Optimum LDPC Decoders Based on the Information Bottleneck Method
IEEE Access, 2018 The Information Bottleneck method is a powerful and generic tool from the field of machine learning. It compresses an observation to a quantized variable while attempting to preserve the mutual information shared with a relevant random variable.
Jan Lewandowsky, Gerhard Bauch
doaj +5 more sources
Shared-Private Information Bottleneck Method for Cross-Modal Clustering [PDF]
IEEE Access, 2019 Recently, the cross-modal analysis has drawn much attention due to the rapid growth and widespread emergence of multimodal data. It integrates multiple modalities to improve learning and generalization performance.
Xiaoqiang Yan +3 more
doaj +4 more sources
Distributed Quantization for Partially Cooperating Sensors Using the Information Bottleneck Method [PDF]
Entropy, 2022 This paper addresses the optimization of distributed compression in a sensor network with partial cooperation among sensors. The widely known Chief Executive Officer (CEO) problem, where each sensor has to compress its measurements locally in order to ...
Steffen Steiner +2 more
doaj +4 more sources
Decoding of Non-Binary LDPC Codes using the Information Bottleneck Method [PDF]
ICC 2019 - 2019 IEEE International Conference on Communications (ICC), 2018 Recently, a novel lookup table based decoding method for binary low-density parity-check codes has attracted considerable attention. In this approach, mutual-information-maximizing lookup tables replace the conventional operations of the variable nodes ...
Maximilian Stark +3 more
semanticscholar +5 more sources
Objective Classification of Galaxy Spectra using the Information Bottleneck Method [PDF]
Monthly Notices of the Royal Astronomical Society, 2000 A new method for classification of galaxy spectra is presented, based on a recently introduced information theoretical principle, the information bottleneck.
N. Slonim +3 more
semanticscholar +10 more sources
Training quantum neural networks using the quantum information bottleneck method [PDF]
Journal of Physics A: Mathematical and Theoretical, 2022 We provide in this paper a concrete method for training a quantum neural network to maximize the relevant information about a property that is transmitted through the network. This is significant because it gives an operationally well founded quantity to
Ahmet Burak Çatlı, N. Wiebe
semanticscholar +4 more sources
Information Bottleneck as Optimisation Method for SSVEP-Based BCI [PDF]
Frontiers in Human Neuroscience, 2021 In this study, the information bottleneck method is proposed as an optimisation method for steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI).
Anti Ingel, Raul Vicente
doaj +3 more sources
Information-theoretic analysis of Hierarchical Temporal Memory-Spatial Pooler algorithm with a new upper bound for the standard information bottleneck method [PDF]
Frontiers in Computational Neuroscience, 2023 Hierarchical Temporal Memory (HTM) is an unsupervised algorithm in machine learning. It models several fundamental neocortical computational principles.
Shiva Sanati +2 more
doaj +2 more sources
IEEE Open Journal of the Communications Society, 2020 Increased data rates and very low-latency requirements place strict constraints on the computational complexity of channel decoders in the new 5G communications standard.
Maximilian Stark +3 more
doaj +2 more sources