Decentralized Quasi-Newton Methods [PDF]
We introduce the decentralized Broyden-Fletcher-Goldfarb-Shanno (D-BFGS) method as a variation of the BFGS quasi-Newton method for solving decentralized optimization problems. The D-BFGS method is of interest in problems that are not well conditioned, making first order decentralized methods ineffective, and in which second order information is not ...
Mark Eisen +2 more
openaire +3 more sources
Greedy Quasi-Newton Methods with Explicit Superlinear Convergence [PDF]
In this paper, we study greedy variants of quasi-Newton methods. They are based on the updating forulas from a certain subclass of the Broyden family. In particular, this subclass includes the well-known DFP, BFGS ans SR1 updates. However, in contrast to
Anton Rodomanov, Y. Nesterov
semanticscholar +1 more source
THE NEW RANK ONE CLASS FOR UNCONSTRAINED PROBLEMS SOLVING
One of the most well-known methods for unconstrained problems is the quasi-Newton approach, iterative solutions. The great precision and quick convergence of the quasi-Newton methods are well recognized. In this work, the new algorithm for the symmetric
Ahmed Mustafa
doaj +1 more source
Adaptive sampling quasi-Newton methods for zeroth-order stochastic optimization [PDF]
We consider unconstrained stochastic optimization problems with no available gradient information. Such problems arise in settings from derivative-free simulation optimization to reinforcement learning. We propose an adaptive sampling quasi-Newton method
Raghu Bollapragada, Stefan M. Wild
semanticscholar +1 more source
Quasi-Newton Methods for Saddle Point Problems and Beyond [PDF]
This paper studies quasi-Newton methods for solving strongly-convex-strongly-concave saddle point problems (SPP). We propose greedy and random Broyden family updates for SPP, which have explicit local superlinear convergence rate of ${\mathcal O}\big ...
Chengchang Liu, Luo Luo
semanticscholar +1 more source
On the Convergence Rate of Quasi-Newton Methods on Strongly Convex Functions with Lipschitz Gradient
The main results of the study of the convergence rate of quasi-Newton minimization methods were obtained under the assumption that the method operates in the region of the extremum of the function, where there is a stable quadratic representation of the ...
Vladimir Krutikov +3 more
doaj +1 more source
A New Globally Convergent Self-Scaling Vm Algorithm for Convex and Nonconvex Optimization [PDF]
In unconstrained optimization, the original quasi-Newton condition where is the difference of the gradients at two successive iterations. Li and Fukushima proposed a modified BFGS methods based on a new Quasi –Newton equation where , where is a
Abbas Y. AL-Bayati, Basim A. Hassan
doaj +1 more source
Rates of superlinear convergence for classical quasi-Newton methods [PDF]
We study the local convergence of classical quasi-Newton methods for nonlinear optimization. Although it was well established a long time ago that asymptotically these methods converge superlinearly, the corresponding rates of convergence still remain ...
Anton Rodomanov, Y. Nesterov
semanticscholar +1 more source
Phase field fracture modelling using quasi-Newton methods and a new adaptive step scheme [PDF]
We investigate the potential of quasi-Newton methods in facilitating convergence of monolithic solution schemes for phase field fracture modelling. Several paradigmatic boundary value problems are addressed, spanning the fields of quasi-static fracture ...
Philip K. Kristensen +1 more
semanticscholar +1 more source
Surrogate-based acceleration of quasi-Newton techniques for fluid-structure interaction simulations
Quasi-Newton methods have proven to be an efficient way to couple partitioned solvers in fluid-structure interaction problems, as they are able to stabilize cases with high added-mass, as well as accelerate the convergence.
N. Delaissé +3 more
semanticscholar +1 more source

