Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup. [PDF]
J Stat Mech, 2020 Goldt S +4 more
europepmc +1 more source
A dual enhanced stochastic gradient descent method with dynamic momentum and step size adaptation for improved optimization performance. [PDF]
Sci RepMokhtar MA, Fathy M, Dahab YA, Sayed EA.
europepmc +1 more source
Efficient high-resolution refinement in cryo-EM with stochastic gradient descent. [PDF]
Acta Crystallogr D Struct BiolToader B, Brubaker MA, Lederman RR.
europepmc +1 more source
Gradient Descent Methods for Training Neural Networks [PDF]
This thesis explore algorithms to optimize the training process of a neural network for deep learning purposes, where the focus will be on gradient descent algorithms such as SGD ("Stochastic Gradient Descent") and ADAM (”Adaptive Moment Estimation ...
Slettevold, Simon
core
Dual module- wider and deeper stochastic gradient descent and dropout based dense neural network for movie recommendation. [PDF]
Sci RepC K R, K C S, C K S.
europepmc +1 more source
Nonparametric budgeted stochastic gradient descent
, 2016 One of the most challenging problems in kernel online learning is to bound the model size. Budgeted kernel online learning addresses this issue by bounding the model size to a predefined budget.
V Nguyen (9860309) +3 more
core
Accelerating stochastic gradient descent using predictive variance reduction
, 2013 Stochastic gradient descent is popular for large scale optimization but has slow convergence asymptotically due to the inherent variance. To remedy this problem, we introduce an explicit variance reduction method for stochastic gradient descent which we ...
Zhang, Tong, Johnson, Rie
core
Estimation of simultaneous equation models by backpropagation method using stochastic gradient descent. [PDF]
PeerJ Comput SciPérez-Sánchez B +3 more
europepmc +1 more source
Pangenome graph layout by Path-Guided Stochastic Gradient Descent. [PDF]
BioinformaticsHeumos S +8 more
europepmc +1 more source