Results 21 to 30 of about 15,576,316 (273)

Pareto-Optimal Clustering with the Primal Deterministic Information Bottleneck [PDF]

Entropy, 2022
At the heart of both lossy compression and clustering is a trade-off between the fidelity and size of the learned representation. Our goal is to map out and study the Pareto frontier that quantifies this trade-off.
Andrew K. Tan, Max Tegmark, Isaac L. Chuang   +2 more
doaj   +2 more sources

The density connectivity information bottleneck [PDF]

2008 The 9th International Conference for Young Computer Scientists, 2008
Clustering with the agglomerative information bottleneck (aIB) algorithm suffers from the sub-optimality problem, which cannot guarantee to preserve as much relative information as possible.
Yangdong Ye (13474279), Gang Li (34549), Yongli Ren (18026080)   +2 more
core   +3 more sources

Theory and Application of the Information Bottleneck Method [PDF]

Entropy
In 1999, Naftali Tishby et al [...]
Jan Lewandowsky, Gerhard Bauch
doaj   +2 more sources

Dual-Branch Multi-View Learning with Dual-Contrastive Information Bottleneck

Technologies
Multi-view learning can effectively exploit the consistency and complementarity among multiple data sources and has become a major research direction in semi-supervised classification.
Hongzhi He, Zichen Kang, Zixi Kang, Shide Du, Renjie Lin   +4 more
doaj   +2 more sources

Markov Information Bottleneck to Improve Information Flow in Stochastic Neural Networks [PDF]

Entropy, 2019
While rate distortion theory compresses data under a distortion constraint, information bottleneck (IB) generalizes rate distortion theory to learning problems by replacing a distortion constraint with a constraint of relevant information.
Thanh Tang Nguyen, Jaesik Choi
doaj   +2 more sources

High-Throughput Polar Code Decoders with Information Bottleneck Quantization [PDF]

Entropy
In digital baseband processing, the forward error correction (FEC) unit belongs to the most demanding components in terms of computational complexity and power consumption.
Claus Kestel, Lucas Johannsen, Norbert Wehn   +2 more
doaj   +2 more sources

Mining Causality via Information Bottleneck [PDF]

Jisuanji kexue, 2022
Causal discovery from observational data is a fundamental problem in many disciplines.However,existing methods such as constraint-based methods and causal function-based methods have strong assumptions on the causal mechanism of data,and are only ...
QIAO Jie, CAI Rui-chu, HAO Zhi-feng
doaj   +1 more source

Efficient algorithms for quantum information bottleneck [PDF]

Quantum, 2023
The ability to extract relevant information is critical to learning. An ingenious approach as such is the information bottleneck, an optimisation problem whose solution corresponds to a faithful and memory-efficient representation of relevant information
Masahito Hayashi, Yuxiang Yang
doaj   +1 more source

Information Bottleneck Message Passing for Military Applications

, 2021
S.9-16Military communication systems naturally have strong requirements concerning the reliability and the robustness of their physical layer data transmission schemes.
Lewandowsky, J., Gerhard Bauch, Marc Adrat, Jan Lewandowsky, Bauch, G., Adrat, M.   +5 more
core   +3 more sources

The Deterministic Information Bottleneck [PDF]

Neural Computation, 2017
Lossy compression and clustering fundamentally involve a decision about which features are relevant and which are not. The information bottleneck method (IB) by Tishby, Pereira, and Bialek ( 1999 ) formalized this notion as an information-theoretic optimization problem and proposed an optimal trade-off between throwing away as many bits as possible ...
DJ Strouse, David J. Schwab
openaire   +5 more sources