Information-Optimum LDPC Decoders Based on the Information Bottleneck Method
IEEE Access, 2018 The Information Bottleneck method is a powerful and generic tool from the field of machine learning. It compresses an observation to a quantized variable while attempting to preserve the mutual information shared with a relevant random variable.
Jan Lewandowsky, Gerhard Bauch
doaj +7 more sources
Theory and Application of the Information Bottleneck Method [PDF]
EntropyIn 1999, Naftali Tishby et al [...]
Jan Lewandowsky, Gerhard Bauch
doaj +6 more sources
Distributed Quantization for Partially Cooperating Sensors Using the Information Bottleneck Method [PDF]
Entropy, 2022 This paper addresses the optimization of distributed compression in a sensor network with partial cooperation among sensors. The widely known Chief Executive Officer (CEO) problem, where each sensor has to compress its measurements locally in order to ...
Steffen Steiner +2 more
doaj +5 more sources
Discrete BP Polar Decoder Using Information Bottleneck Method [PDF]
IEEE Access, 2021 Polar code is one of the channel codes and is used in the 5th generation of mobile communication system (5G). This encoding scheme is based on the operation of channel polarization, and it is possible to achieve the capacity of arbitrary binary-input ...
Akira Yamada, Tomoaki Ohtsuki
doaj +3 more sources
Information Bottleneck as Optimisation Method for SSVEP-Based BCI [PDF]
Frontiers in Human Neuroscience, 2021 In this study, the information bottleneck method is proposed as an optimisation method for steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI).
Anti Ingel, Raul Vicente
doaj +3 more sources
Information-theoretic analysis of Hierarchical Temporal Memory-Spatial Pooler algorithm with a new upper bound for the standard information bottleneck method [PDF]
Frontiers in Computational Neuroscience, 2023 Hierarchical Temporal Memory (HTM) is an unsupervised algorithm in machine learning. It models several fundamental neocortical computational principles.
Shiva Sanati +2 more
doaj +2 more sources
Shared-Private Information Bottleneck Method for Cross-Modal Clustering [PDF]
IEEE Access, 2019 Recently, the cross-modal analysis has drawn much attention due to the rapid growth and widespread emergence of multimodal data. It integrates multiple modalities to improve learning and generalization performance.
Xiaoqiang Yan +3 more
doaj +3 more sources
Faithful Explanation Regeneration via Cauchy–Schwarz Mixture Information Bottleneck [PDF]
EntropyLarge pretrained language models can generate fluent free-text explanations for natural language reasoning tasks, but these explanations may contain redundant, irrelevant, or unsupported information.
Ziyang Wang, Junliang Du
doaj +2 more sources
Coarsely Quantized Decoding and Construction of Polar Codes Using the Information Bottleneck Method
Algorithms, 2019 The information bottleneck method is a generic clustering framework from the field of machine learning which allows compressing an observed quantity while retaining as much of the mutual information it shares with the quantity of primary relevance as ...
Syed Aizaz Ali Shah +2 more
doaj +3 more sources
Physical Review ResearchEfficient signal representation is essential for the functioning of living and artificial systems operating under resource constraints. A widely recognized framework for deriving such representations is the information bottleneck method, which yields the
Vahe Galstyan +2 more
doaj +4 more sources