Results 21 to 30 of about 335,764 (251)

The information bottleneck method [PDF]

open access: yes, 1999
We define the relevant information in a signal $x\in X$ as being the information that this signal provides about another signal $y\in \Y$. Examples include the information that face images provide about the names of the people portrayed, or the ...
Bialek, William   +2 more
core   +7 more sources

High-Throughput Polar Code Decoders with Information Bottleneck Quantization [PDF]

open access: yesEntropy
In digital baseband processing, the forward error correction (FEC) unit belongs to the most demanding components in terms of computational complexity and power consumption.
Claus Kestel   +2 more
doaj   +2 more sources

Information Bottleneck as Optimisation Method for SSVEP-Based BCI [PDF]

open access: yesFrontiers in Human Neuroscience, 2021
In this study, the information bottleneck method is proposed as an optimisation method for steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI).
Anti Ingel, Raul Vicente
doaj   +2 more sources

Optimal Kullback-Leibler Aggregation via Information Bottleneck [PDF]

open access: yesIEEE Transactions on Automatic Control, 2015
In this paper, we present a method for reducing a regular, discrete-time Markov chain (DTMC) to another DTMC with a given, typically much smaller number of states.
Geiger, Bernhard C.   +3 more
core   +4 more sources

State predictive information bottleneck [PDF]

open access: yesThe Journal of Chemical Physics, 2021
The ability to make sense of the massive amounts of high-dimensional data generated from molecular dynamics simulations is heavily dependent on the knowledge of a low-dimensional manifold (parameterized by a reaction coordinate or RC) that typically distinguishes between relevant metastable states, and which captures the relevant slow dynamics of ...
Dedi Wang, Pratyush Tiwary
openaire   +3 more sources

Recognizing Predictive Substructures With Subgraph Information Bottleneck [PDF]

open access: yesIEEE Transactions on Pattern Analysis and Machine Intelligence
The emergence of Graph Convolutional Network (GCN) has greatly boosted the progress of graph learning. However, two disturbing factors, noise and redundancy in graph data, and lack of interpretation for prediction results, impede further development of GCN.
Junchi Yu   +5 more
openaire   +5 more sources

Mining Causality via Information Bottleneck [PDF]

open access: yesJisuanji kexue, 2022
Causal discovery from observational data is a fundamental problem in many disciplines.However,existing methods such as constraint-based methods and causal function-based methods have strong assumptions on the causal mechanism of data,and are only ...
QIAO Jie, CAI Rui-chu, HAO Zhi-feng
doaj   +1 more source

Efficient algorithms for quantum information bottleneck [PDF]

open access: yesQuantum, 2023
The ability to extract relevant information is critical to learning. An ingenious approach as such is the information bottleneck, an optimisation problem whose solution corresponds to a faithful and memory-efficient representation of relevant information
Masahito Hayashi, Yuxiang Yang
doaj   +1 more source

Multivariate Information Bottleneck [PDF]

open access: yesNeural Computation, 2006
The information bottleneck (IB) method is an unsupervised model independent data organization technique. Given a joint distribution, p(X, Y), this method constructs a new variable, T, that extracts partitions, or clusters, over the values of X that are informative about Y. Algorithms that are motivated by the IB method have already been applied to text
Noam, Slonim   +2 more
openaire   +2 more sources

Disentangled Information Bottleneck

open access: yesProceedings of the AAAI Conference on Artificial Intelligence, 2021
The information bottleneck (IB) method is a technique for extracting information that is relevant for predicting the target random variable from the source random variable, which is typically implemented by optimizing the IB Lagrangian that balances the compression and prediction terms.
Pan, Ziqi   +3 more
openaire   +2 more sources

Home - About - Disclaimer - Privacy