Results 81 to 90 of about 527,249 (162)

True Asymptotic Natural Gradient Optimization

, 2017
We introduce a simple algorithm, True Asymptotic Natural Gradient Optimization (TANGO), that converges to a true natural gradient descent in the limit of small learning rates, without explicit Fisher matrix estimation. For quadratic models the algorithm is also an instance of averaged stochastic gradient, where the parameter is a moving average of a ...
openaire   +2 more sources

Facilitating Bayesian Continual Learning by Natural Gradients and Stein Gradients

, 2019
Continual learning aims to enable machine learning models to learn a general solution space for past and future tasks in a sequential manner. Conventional models tend to forget the knowledge of previous tasks while learning a new task, a phenomenon known as catastrophic forgetting.
Chen, Yu, Diethe, Tom, Lawrence, Neil
openaire   +3 more sources

ONG: Orthogonal Natural Gradient Descent

Publicly available code at https://github.com/yajatyadav/orthogonal-natural ...
Yadav, Yajat, Mendoza, Patrick, Korrapati, Jathin   +2 more
openaire   +2 more sources

Why natural gradient?

Why natural gradient?
Gradient adaptation is a useful technique for adjusting a set of parameters to minimize a cost function. While often easy to implement, the convergence speed of gradient adaptation can be slow when the slope of the cost function varies widely for small changes in the parameters.
openaire  

Dual Stochastic Natural Gradient Descent

, 2020
[EN] Although theoretically appealing, Stochastic Natural Gradient Descent (SNGD) is computationally expensive, it has been shown to be highly sensitive to the learning rate, and it is not guaranteed to be convergent. Convergent Stochastic Natural Gradient Descent (CSNGD) aims at solving the last two problems.
Sánchez-López, Borja, Cerquides, Jesús   +1 more
openaire   +1 more source

Attempts to preserve and visualize protein corona on the surface of biological nanoparticles in blood serum using photomodification

Beilstein Journal of Nanotechnology
A protein corona is present on any nanoparticle (NP) entering biological fluids; however, the existence of a natural protein corona on natural NPs has not been experimentally confirmed. We used our previously developed photomodification method to fix the
Julia E. Poletaeva, Anastasiya V. Tupitsyna, Alina E. Grigor’eva, Ilya S. Dovydenko, Elena I. Ryabchikova   +4 more
doaj   +1 more source

Changes in coral reef communities across a natural gradient in seawater pH. [PDF]

Sci Adv, 2015
Barkley HC, Cohen AL, Golbuu Y, Starczak VR, DeCarlo TM, Shamberger KE.   +5 more
europepmc   +1 more source

Characterizing Model Robustness via Natural Input Gradients

28 pages; 14 figures; 9 tables; to be published in ECCV ...
Adrián Rodríguez-Muñoz, Tongzhou Wang, Antonio Torralba   +2 more
openaire   +2 more sources

Radiomics-Based Machine Learning with Natural Gradient Boosting for Continuous Survival Prediction in Glioblastoma. [PDF]

Cancers (Basel)
Karabacak M, Patil S, Gersey ZC, Komotar RJ, Margetis K.   +4 more
europepmc   +1 more source

Coral growth along a natural gradient of seawater temperature, pH, and oxygen in a nearshore seagrass bed on Dongsha Atoll, Taiwan. [PDF]

PLoS One
Pezner AK, Courtney TA, Chou WC, Chu HC, Frable BW, Kekuewa SAH, Soong K, Wei Y, Andersson AJ.   +8 more
europepmc   +1 more source