Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Artem Riabinin

dblp:391/3952 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Optimization for machine learning · 91% Efficient and distributed learning · 9%

Topics — the 4 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Optimization for machine learning
distributed optimization
0.912025
Error Feedback under (L0, L1)-Smoothness: Normalization and Momentum · NeurIPS 2025
Machine learning › Optimization for machine learning › distributed optimization
error feedback
0.912025
Error Feedback under (L0, L1)-Smoothness: Normalization and Momentum · NeurIPS 2025
Machine learning › Optimization for machine learning
stochastic optimization
0.912025
Error Feedback under (L0, L1)-Smoothness: Normalization and Momentum · NeurIPS 2025
Machine learning › Efficient and distributed learning
distributed training
0.312025
Error Feedback under (L0, L1)-Smoothness: Normalization and Momentum · NeurIPS 2025

Methods — techniques the papers use, named apart from their topics

normalization · 0.9momentum · 0.9generalized smoothness · 0.9error feedback · 0.9
YearPublicationVenuePosition
2025 Error Feedback under (L0, L1)-Smoothness: Normalization and Momentum
abstract
We provide the first proof of convergence for normalized error feedback algorithms across a wide range of machine learning problems. Despite their popularity and efficiency in training deep neural networks, traditional analyses of error feedback algorithms rely on the smoothness assumption that does not capture the properties of objective functions in these problems. Rather, these problems have recently been shown to satisfy generalized smoothness assumptions, and the theoretical understanding of error feedback algorithms under these assumptions remains largely unexplored. Moreover, to the best of our knowledge, all existing analyses under generalized smoothness either i) focus on single-node settings or ii) make unrealistically strong assumptions for distributed settings, such as requiring data heterogeneity, and almost surely bounded stochastic gradient noise variance. In this paper, we propose distributed error feedback algorithms that utilize normalization to achieve the $\mathcal{O}(1/\sqrt{K})$ convergence rate for nonconvex problems under generalized smoothness. Our analyses apply for distributed settings without data heterogeneity conditions, and enable stepsize tuning that is independent of problem parameters. Additionally, we provide strong convergence guarantees of normalized error feedback algorithms for stochastic settings. Finally, we show that due to their larger allowable stepsizes, our new normalized error feedback algorithms outperform their non-normalized counterparts on various tasks, including the minimization of polynomial functions, logistic regression, and ResNet-20 training.
Sarit Khirirat, Abdurakhmon Sadiev, Artem Riabinin, Eduard Gorbunov, Peter Richtárik
NeurIPS3