Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Shengnan Miao

dblp:352/8877 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2023
—ORCID · unresolved

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Optimization for machine learning · 100%
Theoretical computer science
1 paper
Mathematical optimization · 100%

Topics — the 3 heaviest of 3, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Optimization for machine learning
distributed optimization
0.712023
Proximal Stochastic Recursive Momentum Methods for Nonconvex Composite Decentralized Optimization · AAAI 2023
Machine learning › Optimization for machine learning › stochastic optimization
stochastic momentum methods
0.712023
Proximal Stochastic Recursive Momentum Methods for Nonconvex Composite Decentralized Optimization · AAAI 2023
Mathematical optimization › distributed optimization
decentralized optimization
0.712023
Proximal Stochastic Recursive Momentum Methods for Nonconvex Composite Decentralized Optimization · AAAI 2023

Methods — techniques the papers use, named apart from their topics

variance reduction · 1.3stochastic recursive momentum · 1.3single-loop algorithm · 1.3
YearPublicationVenuePosition
2023 Proximal Stochastic Recursive Momentum Methods for Nonconvex Composite Decentralized Optimization
abstract
Consider a network of N decentralized computing agents collaboratively solving a nonconvex stochastic composite problem. In this work, we propose a single-loop algorithm, called DEEPSTORM, that achieves optimal sample complexity for this setting. Unlike double-loop algorithms that require a large batch size to compute the (stochastic) gradient once in a while, DEEPSTORM uses a small batch size, creating advantages in occasions such as streaming data and online learning. This is the first method achieving optimal sample complexity for decentralized nonconvex stochastic composite problems, requiring O(1) batch size. We conduct convergence analysis for DEEPSTORM with both constant and diminishing step sizes. Additionally, under proper initialization and a small enough desired solution error, we show that DEEPSTORM with a constant step size achieves a network-independent sample complexity, with an additional linear speed-up with respect to N over centralized methods. All codes are made available at https://github.com/gmancino/DEEPSTORM.
Gabriel Mancino-Ball, Shengnan Miao, Yangyang Xu 0005, Jie Chen 0007
AAAI2