Results 1 to 10 of about 580,652 (288)
Natural-gradient learning for spiking neurons [PDF]
eLife, 2022 In many normative theories of synaptic plasticity, weight updates implicitly depend on the chosen parametrization of the weights. This problem relates, for example, to neuronal morphology: synapses which are functionally equivalent in terms of their ...
Elena Kreutzer +2 more
doaj +8 more sources
QuantumHybrid quantum-classical algorithms appear to be the most promising approach for near-term quantum applications. An important bottleneck is the classical optimization loop, where the multiple local minima and the emergence of barren plateaux make these ...
Ioannis Kolotouros, Petros Wallden
doaj +5 more sources
Thermodynamic natural gradient descent (NGD-T) regulates natural-gradient steps by a geometric speed-cost bound [PDF]
Scientific ReportsWe introduce Thermodynamic Natural Gradient Descent (NGD-T), an optimizer that enforces a physical speed-cost constraint by combining Fisher-preconditioned updates with a dissipation-aware step-size regulator.
Barco Jie You
doaj +2 more sources
Adaptive Natural Gradient Method for Learning of Stochastic Neural Networks in Mini-Batch Mode
Applied Sciences, 2019 Gradient descent method is an essential algorithm for learning of neural networks. Among diverse variations of gradient descent method that have been developed for accelerating learning speed, the natural gradient learning is based on the theory of ...
Hyeyoung Park, Kwanyong Lee
doaj +3 more sources
Variational Bayesian Kalman filter using natural gradient
Chinese Journal of Aeronautics, 2022 We propose a technique based on the natural gradient method for variational lower bound maximization for a variational Bayesian Kalman filter. The natural gradient approach is applied to the Kullback-Leibler divergence between the parameterized ...
Xuezhi Wang, Quan Pan, Zhentao Hu
exaly +3 more sources
Design and Fabrication of Biomimetic Gradient Bone Tissue Engineering Scaffolds: Evolution from Single-Gradient to Multi-Gradient [PDF]
GelsThe regeneration of bone and the repair of large segmental bone defects represent critical challenges in regenerative medicine. Natural bone tissue is an anisotropic material characterized by an intricate gradient distribution in structure, mechanical ...
Haitao Liu +5 more
doaj +2 more sources
Parametrisation Independence of the Natural Gradient in Overparametrised Systems
Lecture Notes in Computer Science, 2021 In this paper we study the natural gradient method for overparametrised systems. This method is based on the natural gradient field which is invariant with respect to coordinate transformations.
Jesse Van Oostrum, Nihat Ay, Ay Nihat
exaly +1 more source
Reinforcement Learning: Theory and Applications in HEMS
Energies, 2022 The steep rise in reinforcement learning (RL) in various applications in energy as well as the penetration of home automation in recent years are the motivation for this article.
Omar Al-Ani, Sanjoy Das
doaj +1 more source
Entropy, 2023 The variational Bayesian method solves nonlinear estimation problems by iteratively computing the integral of the marginal density. Many researchers have demonstrated the fact its performance depends on the linear approximation in the computation of the ...
Yumei Hu +5 more
doaj +1 more source
Temperature gradient of the natural water surface thermal radiation [PDF]
E3S Web of Conferences, 2023 The dependence of the thermal radiation of natural water on its kinetic temperature in the temperature range of 7-70 degrees Celsius was experimentally investigated.
Gavrilin Sergey N.
doaj +1 more source