Alen Aliev

dblp:388/2751 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Theoretical computer science
1 paper
Mathematical optimization · 100%

Topics — the 3 heaviest of 3, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Mathematical optimization › continuous optimization › convex optimization › first-order methods › gradient-based optimization
accelerated gradient methods
0.912025
Methods for Convex (L0, L1)-Smooth Optimization: Clipping, Acceleration, and Adaptivity · ICLR 2025
Mathematical optimization › continuous optimization › convex optimization › first-order methods › gradient-based optimization
adaptive gradient methods
0.912025
Methods for Convex (L0, L1)-Smooth Optimization: Clipping, Acceleration, and Adaptivity · ICLR 2025
Mathematical optimization › continuous optimization
convex optimization
0.912025
Methods for Convex (L0, L1)-Smooth Optimization: Clipping, Acceleration, and Adaptivity · ICLR 2025

Methods — techniques the papers use, named apart from their topics

polyak stepsizes · 0.9gradient clipping · 0.9acceleration · 0.9
YearPublicationVenuePosition
2025 Methods for Convex (L0, L1)-Smooth Optimization: Clipping, Acceleration, and Adaptivity
abstract
Due to the non-smoothness of optimization problems in Machine Learning, generalized smoothness assumptions have been gaining a lot of attention in recent years. One of the most popular assumptions of this type is $(L_0,L_1)$-smoothness (Zhang et al., 2020). In this paper, we focus on the class of (strongly) convex $(L_0,L_1)$-smooth functions and derive new convergence guarantees for several existing methods. In particular, we derive improved convergence rates for Gradient Descent with (Smoothed) Gradient Clipping and for Gradient Descent with Polyak Stepsizes. In contrast to the existing results, our rates do not rely on the standard smoothness assumption and do not suffer from the exponential dependency on the initial distance to the solution. We also extend these results to the stochastic case under the over-parameterization assumption, propose a new accelerated method for convex $(L_0,L_1)$-smooth optimization, and derive new convergence rates for Adaptive Gradient Descent (Malitsky and Mishchenko, 2020).
Eduard Gorbunov, Nazarii Tupitsa, Sayantan Choudhury, Alen Aliev, Peter Richtárik, Samuel Horváth, Martin Takác 0001
ICLR4