Boyuan Yao

dblp:335/9269 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2022
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Theoretical computer science
1 paper
Mathematical optimization · 100%

Topics — the 4 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Mathematical optimization
minimax optimization
0.612022
Faster Stochastic Algorithms for Minimax Optimization under Polyak-{\L}ojasiewicz Condition · NeurIPS 2022
Mathematical optimization
nonconvex optimization
0.612022
Faster Stochastic Algorithms for Minimax Optimization under Polyak-{\L}ojasiewicz Condition · NeurIPS 2022
Mathematical optimization
polyak-łojasiewicz condition
0.612022
Faster Stochastic Algorithms for Minimax Optimization under Polyak-{\L}ojasiewicz Condition · NeurIPS 2022
Mathematical optimization
stochastic optimization
0.612022
Faster Stochastic Algorithms for Minimax Optimization under Polyak-{\L}ojasiewicz Condition · NeurIPS 2022

Methods — techniques the papers use, named apart from their topics

variance reduction · 0.6stochastic first-order oracle · 0.6
YearPublicationVenuePosition
2022 Faster Stochastic Algorithms for Minimax Optimization under Polyak-{\L}ojasiewicz Condition
abstract
This paper considers stochastic first-order algorithms for minimax optimization under Polyak-{\L}ojasiewicz (PL) conditions. We propose SPIDER-GDA for solving the finite-sum problem of the form $\min_x \max_y f(x,y)\triangleq \frac{1}{n} \sum_{i=1}^n f_i(x,y)$, where the objective function $f(x,y)$ is $\mu_x$-PL in $x$ and $\mu_y$-PL in $y$; and each $f_i(x,y)$ is $L$-smooth. We prove SPIDER-GDA could find an $\epsilon$-approximate solution within ${\mathcal O}\left((n + \sqrt{n}\,\kappa_x\kappa_y^2)\log (1/\epsilon)\right)$ stochastic first-order oracle (SFO) complexity, which is better than the state-of-the-art method whose SFO upper bound is ${\mathcal O}\big((n + n^{2/3}\kappa_x\kappa_y^2)\log (1/\epsilon)\big)$, where $\kappa_x\triangleq L/\mu_x$ and $\kappa_y\triangleq L/\mu_y$.For the ill-conditioned case, we provide an accelerated algorithm to reduce the computational cost further. It achieves $\tilde{{\mathcal O}}\big((n+\sqrt{n}\,\kappa_x\kappa_y)\log^2 (1/\epsilon)\big)$ SFO upper bound when $\kappa_x\geq\sqrt{n}$. Our ideas also can be applied to the more general setting that the objective function only satisfies PL condition for one variable. Numerical experiments validate the superiority of proposed methods.
Lesi Chen, Boyuan Yao, Luo Luo
NeurIPS2