Results 21 to 30 of about 90,344 (240)
Perturbation Theory for the Information Bottleneck. [PDF]
Adv Neural Inf Process Syst, 2021 NeurIPS ...
Ngampruetikorn V, Schwab DJ.
europepmc +5 more sources
Gaussian information bottleneck and the non-perturbative renormalization group [PDF]
New Journal of Physics, 2022 The renormalization group (RG) is a class of theoretical techniques used to explain the collective physics of interacting, many-body systems. It has been suggested that the RG formalism may be useful in finding and interpreting emergent low-dimensional ...
Adam G Kline, Stephanie E Palmer
doaj +2 more sources
High-Throughput Polar Code Decoders with Information Bottleneck Quantization [PDF]
EntropyIn digital baseband processing, the forward error correction (FEC) unit belongs to the most demanding components in terms of computational complexity and power consumption.
Claus Kestel +2 more
doaj +2 more sources
Mining Causality via Information Bottleneck [PDF]
Jisuanji kexue, 2022 Causal discovery from observational data is a fundamental problem in many disciplines.However,existing methods such as constraint-based methods and causal function-based methods have strong assumptions on the causal mechanism of data,and are only ...
QIAO Jie, CAI Rui-chu, HAO Zhi-feng
doaj +1 more source
Efficient algorithms for quantum information bottleneck [PDF]
Quantum, 2023 The ability to extract relevant information is critical to learning. An ingenious approach as such is the information bottleneck, an optimisation problem whose solution corresponds to a faithful and memory-efficient representation of relevant information
Masahito Hayashi, Yuxiang Yang
doaj +1 more source
Disentangled Information Bottleneck
Proceedings of the AAAI Conference on Artificial Intelligence, 2021 The information bottleneck (IB) method is a technique for extracting information that is relevant for predicting the target random variable from the source random variable, which is typically implemented by optimizing the IB Lagrangian that balances the compression and prediction terms.
Ziqi Pan +3 more
openaire +2 more sources
The Deterministic Information Bottleneck [PDF]
Neural Computation, 2017 Lossy compression and clustering fundamentally involve a decision about which features are relevant and which are not. The information bottleneck method (IB) by Tishby, Pereira, and Bialek ( 1999 ) formalized this notion as an information-theoretic optimization problem and proposed an optimal trade-off between throwing away as many bits as possible ...
DJ Strouse, David J. Schwab
openaire +4 more sources
State predictive information bottleneck [PDF]
The Journal of Chemical Physics, 2021 The ability to make sense of the massive amounts of high-dimensional data generated from molecular dynamics simulations is heavily dependent on the knowledge of a low-dimensional manifold (parameterized by a reaction coordinate or RC) that typically distinguishes between relevant metastable states, and which captures the relevant slow dynamics of ...
Dedi Wang, Pratyush Tiwary
openaire +3 more sources
Multivariate Information Bottleneck [PDF]
Neural Computation, 2006 The information bottleneck (IB) method is an unsupervised model independent data organization technique. Given a joint distribution, p(X, Y), this method constructs a new variable, T, that extracts partitions, or clusters, over the values of X that are informative about Y. Algorithms that are motivated by the IB method have already been applied to text
Noam Slonim +2 more
openaire +2 more sources
Recognizable Information Bottleneck
Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, 2023 Information Bottlenecks (IBs) learn representations that generalize to unseen data by information compression. However, existing IBs are practically unable to guarantee generalization in real-world scenarios due to the vacuous generalization bound. The recent PAC-Bayes IB uses information complexity instead of information compression to establish a ...
Yilin Lyu +6 more
openaire +2 more sources