Results 51 to 60 of about 15,576,316 (273)

Justices for Information Bottleneck Theory

CoRR, 2023
This study comes as a timely response to mounting criticism of the information bottleneck (IB) theory, injecting fresh perspectives to rectify misconceptions and reaffirm its validity. Firstly, we introduce an auxiliary function to reinterpret the maximal coding rate reduction method as a special yet local optimal case of IB theory.
Faxian Cao, Yongqiang Cheng 0001, Adil Mehmood Khan, Zhijing Yang   +3 more
openaire   +2 more sources

PAC-Bayes Information Bottleneck

CoRR, 2021
ICLR'22 (Spotlight)
Zifeng Wang 0008, Shao-Lun Huang, Ercan E. Kuruoglu, Jimeng Sun 0001, Xi Chen 0003, Yefeng Zheng 0001   +5 more
openaire   +4 more sources

Information Bottleneck Approach to Predictive Inference

Entropy, 2014
This paper synthesizes a recent line of work on automated predictive model making inspired by Rate-Distortion theory, in particular by the Information Bottleneck method. Predictive inference is interpreted as a strategy for efficient communication.
Susanne Still
doaj   +1 more source

Information Bottleneck Theory Based Exploration of Cascade Learning

Entropy, 2021
In solving challenging pattern recognition problems, deep neural networks have shown excellent performance by forming powerful mappings between inputs and targets, learning representations (features) and making subsequent predictions.
Xin Du, Katayoun Farrahi, Mahesan Niranjan   +2 more
doaj   +1 more source

Discrete BP Polar Decoder Using Information Bottleneck Method

IEEE Access, 2021
Polar code is one of the channel codes and is used in the 5th generation of mobile communication system (5G). This encoding scheme is based on the operation of channel polarization, and it is possible to achieve the capacity of arbitrary binary-input ...
Akira Yamada, Tomoaki Ohtsuki
doaj   +1 more source

Information-Optimum LDPC Decoders Based on the Information Bottleneck Method

IEEE Access, 2018
The Information Bottleneck method is a powerful and generic tool from the field of machine learning. It compresses an observation to a quantized variable while attempting to preserve the mutual information shared with a relevant random variable.
Jan Lewandowsky, Gerhard Bauch
doaj   +1 more source

The Mathematical Structure of Information Bottleneck Methods

Entropy, 2012
Information Bottleneck-based methods use mutual information as a distortion function in order to extract relevant details about the structure of a complex system by compression. One of the approaches used to generate optimal compressed representations is
Albert E. Parker, Tomáš Gedeon, Alexander G. Dimitrov   +2 more
doaj   +1 more source

CEB Improves Model Robustness

Entropy, 2020
Intuitively, one way to make classifiers more robust to their input is to have them depend less sensitively on their input. The Information Bottleneck (IB) tries to learn compressed representations of input that are still predictive.
Ian Fischer, Alexander A. Alemi
doaj   +1 more source

The strength and timing of the mitochondrial bottleneck in salmon suggests a conserved mechanism in vertebrates

, 2011
In most species mitochondrial DNA (mtDNA) is inherited maternally in an apparently clonal fashion, although how this is achieved remains uncertain.
Wolff, Jonci N., Daniel J White, Michael Woodhams, Neil J. Gemmell, Gemmell, Neil J., White Daniel J., Daniel J. White, Woodhams, Michael, White, Helen E., White, Helen, White, Daniel, Wolff Jonci N., Woodhams Michael, Gemmell Neil J., Neil J Gemmell, Helen E White, White, Daniel J., Wolff, Jonci, Jonci N. Wolff, Jonci N Wolff, Gemmell, Neil, Helen E. White, White Helen E.   +22 more
core   +1 more source

The Compound Information Bottleneck Program

2022 IEEE International Symposium on Information Theory (ISIT), 2022
2022 IEEE International Symposium on Information Theory (ISIT)
Dikshtein, Michael, Weinberger, Nir, Shitz, Shlomo Shamai   +2 more
openaire   +3 more sources