Results 21 to 30 of about 1,235,951 (289)

Exact Mean Square Linear Stability Analysis for SGD

open access: yes, 2023
The dynamical stability of optimization methods at the vicinity of minima of the loss has recently attracted significant attention. For gradient descent (GD), stable convergence is possible only to minima that are sufficiently flat w.r.t. the step size, and those have been linked with favorable properties of the trained model.
Mulayoff, Rotem, Michaeli, Tomer
openaire   +2 more sources

Mean-Square Stability of Milstein Methods for Stochastic Pantograph Equations [PDF]

open access: yesMathematical Problems in Engineering, 2013
This paper deals with nonlinear stochastic pantograph equations. For solving the equations, a class of extended Milstein methods are suggested. A mean-square stability criterion for this type of equations is presented. It is proved that under the suitable conditions the Milstein methods preserve the mean-square stability.
Feiyan Xiao   +2 more
openaire   +2 more sources

Mean-square stability of Riemann–Liouville fractional Hopfield’s graded response neural networks with random impulses

open access: yesAdvances in Difference Equations, 2021
In this paper a model of Hopfield’s graded response neural network is investigated. A network whose neurons are subject to a certain impulsive state displacement at random times is considered. The model is set up and studied.
R. Agarwal   +3 more
doaj   +1 more source

Instabilities of the harmonic oscillator with fluctuating damping [PDF]

open access: yes, 2011
We investigate the instabilities of a linear damped oscillator due to fluctuations of the damping parameter. The fluctuations are driven either by Gaussian white noise or Poisson white noise (white shot noise). We consider three notions of stability. The
Campos, Daniel   +3 more
core   +2 more sources

Distributed Local Linear Parameter Estimation using Gaussian SPAWN [PDF]

open access: yes, 2014
We consider the problem of estimating local sensor parameters, where the local parameters and sensor observations are related through linear stochastic models. Sensors exchange messages and cooperate with each other to estimate their own local parameters
Leng, Mei   +3 more
core   +1 more source

The Improved Stability Analysis of Numerical Method for Stochastic Delay Differential Equations

open access: yesMathematics, 2022
In this paper, the improved split-step θ method, named the split-step composite θ method, is proposed to study the mean-square stability for stochastic differential equations with a fixed time delay.
Yu Zhang, Enying Zhang, Longsuo Li
doaj   +1 more source

Practical exponential stability in mean square of stochastic partial differential equations [PDF]

open access: yes, 2014
The main aim of this paper is to establish some criteria for the mean square and almost sure practical exponential stability of a nonlinear monotone stochastic partial differential ...
Caraballo Garrido, Tomás   +2 more
core   +1 more source

Multi-condition of stability for nonlinear stochastic non-autonomous delay differential equation [PDF]

open access: yes, 2018
A nonlinear stochastic differential equation with the order of nonlinearity higher than one, with several discrete and distributed delays and time varying coefficients is considered.
Shaikhet, Leonid
core   +2 more sources

Mean Square Exponential Stability of Stochastic Switched System with Interval Time-Varying Delays

open access: yesAbstract and Applied Analysis, 2012
This paper is concerned with mean square exponential stability of switched stochastic system with interval time-varying delays. The time delay is any continuous function belonging to a given interval, but not necessary to be differentiable.
Manlika Rajchakit, Grienggrai Rajchakit
doaj   +1 more source

Diffusion LMS for clustered multitask networks [PDF]

open access: yes, 2013
Recent research works on distributed adaptive networks have intensively studied the case where the nodes estimate a common parameter vector collaboratively.
Chen, Jie, Richard, Cédric, Sayed, Ali
core   +1 more source

Home - About - Disclaimer - Privacy