Results 121 to 130 of about 1,424,164 (189)

An Improved Reacceleration Optimization Algorithm Based on the Momentum Method for Image Recognition

Mathematics
The optimization algorithm plays a crucial role in image recognition by neural networks. However, it is challenging to accelerate the model’s convergence and maintain high precision.
Haijing Sun, Ying Cai, Ran Tao, Yichuan Shao, Lei Xing, Can Zhang, Qian Zhao   +6 more
doaj   +1 more source

SGD-QN: Careful Quasi-Newton Stochastic Gradient Descent

, 2009
International audienceThe SGD-QN algorithm is a stochastic gradient descent algorithm that makes careful use of second-order information and splits the parameter update into independently scheduled components.
Gallinari, Patrick, Bottou, Léon, Bordes, Antoine   +2 more
core  

Spectral Control of Stochastic Gradient Descent via Operator Geometry

We study the asymptotic behavior of stochastic gradient descent (SGD) in the vicinity of a local minimum under a quadratic loss ...
Juan Balanzó Cerdà
core  

Stochastic Gradient Descent Revisited

Stochastic gradient descent (SGD) has been a go-to algorithm for nonconvex stochastic optimization problems arising in machine learning. Its theory however often requires a strong framework to guarantee convergence properties.
Louzi, Azar
core  

A Geometric Interpretation of Stochastic Gradient Descent Using Diffusion Metrics. [PDF]

Entropy (Basel), 2020
Fioresi R, Chaudhari P, Soatto S.
europepmc   +1 more source

Is Learning in Biological Neural Networks based on Stochastic Gradient Descent? An analysis using stochastic processes

In recent years, there has been an intense debate about how learning in biological neural networks (BNNs) differs from learning in artificial neural networks.
Christensen, Sören, Kallsen, Jan
core   +1 more source

Tighter privacy auditing of differentially private stochastic gradient descent in the hidden state threat model. [PDF]

Sci Rep
Bhuekar A.
europepmc   +1 more source

SSGD: SPARSITY-PROMOTING STOCHASTIC GRADIENT DESCENT ALGORITHM FOR UNBIASED DNN PRUNING. [PDF]

Proc IEEE Int Conf Acoust Speech Signal Process, 2020
Lee CH, Fedorov I, Rao BD, Garudadri H.
europepmc   +1 more source

Mutual Information Based Learning Rate Decay for Stochastic Gradient Descent Training of Deep Neural Networks. [PDF]

Entropy (Basel), 2020
Vasudevan S.
europepmc   +1 more source

Stochastic gradient descent estimation of generalized matrix factorization models with application to single-cell RNA sequencing data. [PDF]

Biostatistics
Castiglione C, Segers A, Clement L, Risso D.   +3 more
europepmc   +1 more source