Results 31 to 40 of about 333,329 (255)
Multivariate Information Bottleneck [PDF]
Neural Computation, 2006 The information bottleneck (IB) method is an unsupervised model independent data organization technique. Given a joint distribution, p(X, Y), this method constructs a new variable, T, that extracts partitions, or clusters, over the values of X that are informative about Y. Algorithms that are motivated by the IB method have already been applied to text
Noam, Slonim +2 more
openaire +2 more sources
Disentangled Information Bottleneck
Proceedings of the AAAI Conference on Artificial Intelligence, 2021 The information bottleneck (IB) method is a technique for extracting information that is relevant for predicting the target random variable from the source random variable, which is typically implemented by optimizing the IB Lagrangian that balances the compression and prediction terms.
Pan, Ziqi +3 more
openaire +2 more sources
The Deterministic Information Bottleneck [PDF]
Neural Computation, 2017 Lossy compression and clustering fundamentally involve a decision about which features are relevant and which are not. The information bottleneck method (IB) by Tishby, Pereira, and Bialek ( 1999 ) formalized this notion as an information-theoretic optimization problem and proposed an optimal trade-off between throwing away as many bits as possible ...
Strouse, Daniel J., Schwab, David J.
openaire +3 more sources
Embo: a Python package for empirical data analysis using the Information Bottleneck
Journal of Open Research Software, 2021 We present 'embo', a Python package to analyze empirical data using the Information Bottleneck (IB) method and its variants, such as the Deterministic Information Bottleneck (DIB).
Eugenio Piasini +3 more
doaj +1 more source
Heterogeneous Graph Information Bottleneck [PDF]
Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, 2021 Most attempts on extending Graph Neural Networks (GNNs) to Heterogeneous Information Networks (HINs) implicitly take the direct assumption that the multiple homogeneous attributed networks induced by different meta-paths are complementary. The doubts about the hypothesis of complementary motivate an alternative assumption of consensus. That is, the
Liang Yang +7 more
openaire +1 more source
Recognizable Information Bottleneck
Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, 2023 Information Bottlenecks (IBs) learn representations that generalize to unseen data by information compression. However, existing IBs are practically unable to guarantee generalization in real-world scenarios due to the vacuous generalization bound. The recent PAC-Bayes IB uses information complexity instead of information compression to establish a ...
Lyu, Yilin +6 more
openaire +2 more sources
Collaborative Information Bottleneck [PDF]
IEEE Transactions on Information Theory, 2019 Submitted to IEEE Transactions on Information Theory (revised, 29, 7 figures)
Matias Vera +2 more
openaire +3 more sources
Variational Information Bottleneck for Semi-Supervised Classification
Entropy, 2020 In this paper, we consider an information bottleneck (IB) framework for semi-supervised classification with several families of priors on latent space representation. We apply a variational decomposition of mutual information terms of IB.
Slava Voloshynovskiy +4 more
doaj +1 more source
Objective Classification of Galaxy Spectra using the Information Bottleneck Method [PDF]
, 2000 A new method for classification of galaxy spectra is presented, based on a recently introduced information theoretical principle, the `Information Bottleneck'.
Bell +5 more
core +6 more sources
Where are Bottlenecks in NK Fitness Landscapes? [PDF]
, 2003 Usually the offspring-parent fitness correlation is used to visualize and analyze some caracteristics of fitness landscapes such as evolvability. In this paper, we introduce a more general representation of this correlation, the Fitness Cloud (FC).
Clergue, Manuel +2 more
core +3 more sources