Convergence of ADAM for Lipschitz Objective Functions. arXiv:2403.08470
Preprint, arXiv:2403.08470 [math.OC] (2024).
Summary: The aim of this paper is to prove the exponential convergence, local and global, of Adam algorithm under precise conditions on the parameters, when the objective function lacks differentiability. More precisely, we require Lipschitz continuity, and control on the gradient whenever it exists. We provide also examples of interesting functions that satisfies the required restrictions.
MSC:
| 49J52 | Nonsmooth analysis |
| 37N40 | Dynamical systems in optimization and economics |
| 46N10 | Applications of functional analysis in optimization, convex analysis, mathematical programming, economics |
arXiv data are taken from the
arXiv OAI-PMH API.
If you found a mistake, please
report it directly to arXiv.
