Results 31 to 40 of about 3,629,477 (294)
Nonlinear Information Bottleneck
Entropy, 2019 Information bottleneck (IB) is a technique for extracting information in one random variable $X$ that is relevant for predicting another random variable $Y$.
Kolchinsky, Artemy +2 more
core +3 more sources
Discrete BP Polar Decoder Using Information Bottleneck Method
IEEE Access, 2021 Polar code is one of the channel codes and is used in the 5th generation of mobile communication system (5G). This encoding scheme is based on the operation of channel polarization, and it is possible to achieve the capacity of arbitrary binary-input ...
Akira Yamada, Tomoaki Ohtsuki
doaj +1 more source
The Mathematical Structure of Information Bottleneck Methods [PDF]
Entropy, 2012 Information Bottleneck-based methods use mutual information as a distortion function in order to extract relevant details about the structure of a complex system by compression. One of the approaches used to generate optimal compressed representations is by annealing a parameter.
Gedeon, Tomáš +2 more
openaire +3 more sources
Mining Causality via Information Bottleneck [PDF]
Jisuanji kexue, 2022 Causal discovery from observational data is a fundamental problem in many disciplines.However,existing methods such as constraint-based methods and causal function-based methods have strong assumptions on the causal mechanism of data,and are only ...
QIAO Jie, CAI Rui-chu, HAO Zhi-feng
doaj +1 more source
Entropy, 2022 Digital communication receivers extract information about the transmitted data from the received signal in subsequent processing steps, such as synchronization, demodulation and channel decoding.
Jan Lewandowsky +2 more
doaj +1 more source
Information Bottleneck Methods for Distributed Learning [PDF]
2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton), 2018 We study a distributed learning problem in which Alice sends a compressed distillation of a set of training data to Bob, who uses the distilled version to best solve an associated learning problem. We formalize this as a rate-distortion problem in which the training set is the source and Bob's cross-entropy loss is the distortion measure.
Farajiparvar, Parinaz +2 more
openaire +2 more sources
Deformed statistics formulation of the information bottleneck method [PDF]
2009 IEEE International Symposium on Information Theory, 2009 6 pages.
Venkatesan, R. C., Plastino, A.
openaire +2 more sources
Entropy, 2022 In this paper, a generalized information-theoretic framework for the emergence of multi-resolution hierarchical tree abstractions is developed. By leveraging ideas from information-theoretic signal encoding with side information, this paper develops a ...
Daniel T. Larsson +2 more
doaj +1 more source
Identifying informative subsets of the Gene Ontology with information bottleneck methods [PDF]
Bioinformatics, 2010 Abstract Motivation: The Gene Ontology (GO) is a controlled vocabulary designed to represent the biological concepts pertaining to gene products. This study investigates the methods for identifying informative subsets of GO terms in an automatic and objective fashion.
Bo, Jin, Xinghua, Lu
openaire +2 more sources
Transportation Research Interdisciplinary Perspectives, 2023 Bottleneck roads with narrowed width often only allow one vehicle to pass at once. In this situation, human drivers need to negotiate their right-of-way via, e.g., hand gestures and eye contact.
Yang Li +4 more
doaj +1 more source