Results 71 to 80 of about 335,764 (251)

Head information bottleneck (HIB): leveraging information bottleneck for efficient transformer head attribution and pruning

open access: yesEURASIP Journal on Audio, Speech, and Music Processing
Multi-head attention mechanisms have been widely applied in speech pre-training. However, their roles and effectiveness in various downstream tasks have not been fully explored. Attention heads may vary in importance depending on the downstream task.
Yukun Qian, Xuyi Zhuang, Mingjiang Wang
doaj   +1 more source

Neurovascular Contacts in the Pathophysiology of Neuralgic Amyotrophy: An Observational Study

open access: yesAnnals of Clinical and Translational Neurology, EarlyView.
ABSTRACT Objective Neuralgic amyotrophy (NA) is a prevalent, monophasic, multifocal immune‐mediated neuropathy. A distinctive characteristic of the disease is the occurrence of nerve or fascicle constrictions and torsions (NA‐associated focal nerve lesions, NAFL). The pathophysiology underlying this phenomenon remains to be fully elucidated.
Johannes Fabian Holle   +4 more
wiley   +1 more source

Independent Component Analysis Based on Information Bottleneck

open access: yesAbstract and Applied Analysis, 2015
The paper is mainly used to provide the equivalence of two algorithms of independent component analysis (ICA) based on the information bottleneck (IB). In the viewpoint of information theory, we attempt to explain the two classical algorithms of ICA by ...
Qiao Ke   +4 more
doaj   +1 more source

Perturbation Theory for the Information Bottleneck. [PDF]

open access: yesAdv Neural Inf Process Syst, 2021
NeurIPS ...
Ngampruetikorn V, Schwab DJ.
europepmc   +4 more sources

Elinvar Materials: Recent Progress and Challenges

open access: yesAdvanced Engineering Materials, EarlyView.
Elinvar materials, exhibiting temperature‐invariant elastic modulus, are critical for precision instruments and emerging technologies. This article reviews recent progress in the field, with a focus on the anomalous thermoelastic behavior observed in key material systems.
Wenjie Li, Yang Ren
wiley   +1 more source

Chernoff information of bottleneck Gaussian trees [PDF]

open access: yes2016 IEEE International Symposium on Information Theory (ISIT), 2016
Submitted to ISIT2016, and this version contains proofs of the propositions in the ...
Li, Binglin   +3 more
openaire   +2 more sources

Function Identification in Neuron Populations via Information Bottleneck

open access: yesEntropy, 2013
It is plausible to hypothesize that the spiking responses of certain neurons represent functions of the spiking signals of other neurons. A natural ensuing question concerns how to use experimental data to infer what kind of a function is being computed.
S. Kartik Buddha   +3 more
doaj   +1 more source

Toward Low‐Consumable Anodes: Process Simulation and Prospective Life Cycle Assessment of NiFe2O4‐NiO‐Ni‐Cu vs. Prebaked Anodes for Aluminum Production with use of Molten Salt Electrolysis

open access: yesAdvanced Engineering Materials, EarlyView.
Low‐consumable nickel ferrite‐based anodes for the Hall–Héroult process are compared with conventional prebaked carbon anodes using thermodynamic simulation and prospective life cycle assessment under contrasting future electricity system pathways from 2025 to 2050.
Felipe Alejandro Garcia Paz   +6 more
wiley   +1 more source

Discrete profile comparison using information bottleneck [PDF]

open access: yesBMC Bioinformatics, 2006
Sequence homologs are an important source of information about proteins. Amino acid profiles, representing the position-specific mutation probabilities found in profiles, are a richer encoding of biological sequences than the individual sequences themselves. However, profile comparisons are an order of magnitude slower than sequence comparisons, making
O'Rourke, Sean   +3 more
openaire   +4 more sources

A Topology Optimization Framework for the Inverse Design of Nonlinear Mechanical Metamaterials

open access: yesAdvanced Engineering Materials, EarlyView.
This work uses topology optimization to design unit cells for mechanical metamaterials with a prescribed nonlinear stress–strain response. The framework adds contact and postbuckling modeling to synthesize microstructures for three highly nonlinear responses, including pseudoductile behavior, monostable with snap‐through buckling, and bistable ...
Charlie Aveline   +2 more
wiley   +1 more source

Home - About - Disclaimer - Privacy