Justin Ko

dblp:192/1364 · also Justin M. Ko · DBLP profile ↗
← Back
3ranked-venue papers
0as first author
3since 2021 · last 2024
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 3 · 3 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
3 papers
Learning theory · 72% Graph learning · 20% Representation and self-supervised learning · 8%
Theoretical computer science
1 paper
Algorithms and data structures · 100%

Topics — the 13 heaviest of 14, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Learning theory
statistical estimation
1.422024
Fundamental Limits of Non-Linear Low-Rank Matrix Estimation · COLT 2024
Optimal Algorithms for the Inhomogeneous Spiked Wigner Model · NeurIPS 2023
Machine learning › Graph learning › graph neural network › message passing
approximate message passing
0.812024
Fundamental Limits of Non-Linear Low-Rank Matrix Estimation · COLT 2024
Machine learning › Learning theory › high-dimensional statistics › matrix estimation
low-rank matrix estimation
0.812024
Fundamental Limits of Non-Linear Low-Rank Matrix Estimation · COLT 2024
Machine learning › Graph learning › graph neural network
message passing
0.812024
Fundamental Limits of Non-Linear Low-Rank Matrix Estimation · COLT 2024
Machine learning › Representation and self-supervised learning › representation learning › dimensionality reduction
principal component analysis
0.812024
Spectral Phase Transition and Optimal PCA in Block-Structured Spiked Models · ICML 2024
Machine learning › Learning theory
random matrix theory
0.812024
Spectral Phase Transition and Optimal PCA in Block-Structured Spiked Models · ICML 2024
Machine learning › Learning theory
spectral methods
0.812024
Spectral Phase Transition and Optimal PCA in Block-Structured Spiked Models · ICML 2024
Machine learning › Learning theory › high-dimensional statistics
spiked model
0.812024
Spectral Phase Transition and Optimal PCA in Block-Structured Spiked Models · ICML 2024
Machine learning › Learning theory › information-theoretic analysis
information-theoretic bounds
0.712023
Optimal Algorithms for the Inhomogeneous Spiked Wigner Model · NeurIPS 2023
Machine learning › Learning theory › sparse recovery
signal recovery
0.712023
Optimal Algorithms for the Inhomogeneous Spiked Wigner Model · NeurIPS 2023
Machine learning › Learning theory › high-dimensional statistics › matrix estimation
spiked matrix model
0.712023
Optimal Algorithms for the Inhomogeneous Spiked Wigner Model · NeurIPS 2023
Machine learning › Graph learning
stochastic block model
0.212024
Spectral Phase Transition and Optimal PCA in Block-Structured Spiked Models · ICML 2024
Algorithms and data structures
spectral methods
0.212023
Optimal Algorithms for the Inhomogeneous Spiked Wigner Model · NeurIPS 2023

Methods — techniques the papers use, named apart from their topics

spectral methods · 2.1approximate message passing · 2.1random matrix theory · 0.8principal component analysis · 0.8bayesian denoising · 0.8
YearPublicationVenuePosition
2024 Fundamental Limits of Non-Linear Low-Rank Matrix Estimation
abstract
We consider the task of estimating a low-rank matrix from non-linear and noisy observations. We prove a strong universality result showing that Bayes-optimal performances are characterized by an equivalent Gaussian model with an effective prior, whose parameters are entirely determined by an expansion of the non-linear function. In particular, we show that to reconstruct the signal accurately, one requires a signal-to-noise ratio growing as \(N^{\frac 12 (1-1/k_F)}\), where \(k_F\){is} the first non-zero Fisher information coefficient of the function. We provide asymptotic characterization for the minimal achievable mean squared error (MMSE) and an approximate message-passing algorithm that reaches the MMSE under conditions analogous to the linear version of the problem. We also provide asymptotic errors achieved by methods such as principal component analysis combined with Bayesian denoising, and compare them with Bayes-optimal MMSE.
Pierre Mergny, Justin Ko, Florent Krzakala, Lenka Zdeborová
COLT2
2024 Spectral Phase Transition and Optimal PCA in Block-Structured Spiked Models
abstract
We discuss the inhomogeneous Wigner spike model, a theoretical framework recently introduced to study structured noise in various learning scenarios, through the prism of random matrix theory, with a specific focus on its spectral properties. Our primary objective is to find an optimal spectral method, and to extend the celebrated (BBP) phase transition criterion ---well-known in the homogeneous case--- to our inhomogeneous, block-structured, Wigner model. We provide a thorough rigorous analysis of a transformed matrix and show that the transition for the appearance of 1) an outlier outside the bulk of the limiting spectral distribution and 2) a positive overlap between the associated eigenvector and the signal, occurs precisely at the optimal threshold, making the proposed spectral method optimal within the class of iterative methods for the inhomogeneous Wigner problem.
Pierre Mergny, Justin Ko, Florent Krzakala
ICML2
2023 Optimal Algorithms for the Inhomogeneous Spiked Wigner Model
abstract
We study a spiked Wigner problem with an inhomogeneous noise profile. Our aim in this problem is to recover the signal passed through an inhomogeneous low-rank matrix channel. While the information-theoretic performances are well-known, we focus on the algorithmic problem. First, we derive an approximate message-passing algorithm (AMP) for the inhomogeneous problem and show that its rigorous state evolution coincides with the information-theoretic optimal Bayes fixed-point equations. Second, we deduce a simple and efficient spectral method that outperforms PCA and is shown to match the information-theoretic transition.
Aleksandr Pak, Justin Ko, Florent Krzakala
NeurIPS2