Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Shoaib Bin Masud

dblp:288/0922 · DBLP profile ↗
← Back
2ranked-venue papers
1as first author
2since 2021 · last 2024
0009-0006-3915-8229ORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021Theory of computation · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Theoretical computer science
2 papers
Information theory · 56% Mathematical optimization · 44%
Artificial intelligence
1 paper
Learning theory · 50% Generative modeling · 50%

Topics — the 6 heaviest of 7, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Mathematical optimization › optimal transport
entropic optimal transport
0.922024
Multivariate Soft Rank via Entropy-Regularized Optimal Transport: Sample Efficiency and Generative Modeling · J. Mach. Learn. Res. 2023
On Rank Energy Statistics via Optimal Transport: Continuity, Convergence, and Change Point Detection · IEEE Trans. Inf. Theory 2024
Mathematical optimization
optimal transport
0.922024
Multivariate Soft Rank via Entropy-Regularized Optimal Transport: Sample Efficiency and Generative Modeling · J. Mach. Learn. Res. 2023
On Rank Energy Statistics via Optimal Transport: Continuity, Convergence, and Change Point Detection · IEEE Trans. Inf. Theory 2024
Information theory › hypothesis testing
change-point detection
0.812024
On Rank Energy Statistics via Optimal Transport: Continuity, Convergence, and Change Point Detection · IEEE Trans. Inf. Theory 2024
Information theory › hypothesis testing
goodness-of-fit testing
0.812024
On Rank Energy Statistics via Optimal Transport: Continuity, Convergence, and Change Point Detection · IEEE Trans. Inf. Theory 2024
Information theory
hypothesis testing
0.812024
On Rank Energy Statistics via Optimal Transport: Continuity, Convergence, and Change Point Detection · IEEE Trans. Inf. Theory 2024
Machine learning › Generative modeling
generative model
0.712023
Multivariate Soft Rank via Entropy-Regularized Optimal Transport: Sample Efficiency and Generative Modeling · J. Mach. Learn. Res. 2023

Methods — techniques the papers use, named apart from their topics

optimal transport · 2.1maximum mean discrepancy · 2.1entropy regularization · 1.3
YearPublicationVenuePosition
2024 On Rank Energy Statistics via Optimal Transport: Continuity, Convergence, and Change Point Detection
abstract
This paper considers the use of recently proposed optimal transport-based multivariate goodness-of-fit (GoF) test statistics, namely rank energy and its variant the soft rank energy derived from entropy-regularized optimal transport, for unsupervised non-parametric change point detection (CPD) in multivariate time series data. We show that the soft rank energy enjoys both fast rates of statistical convergence and robust continuity properties which lead to strong performance on real datasets. Our analyses remove the need for resampling and out-of-sample extensions previously required to obtain such rates. Our theoretical results show that the rank energy suffers from the curse of dimensionality in statistical estimation and moreover can signal a change point from arbitrarily small perturbations, which leads to a high rate of false alarms in CPD. Additionally, under mild regularity conditions, we quantify the discrepancy between soft rank energy and rank energy in terms of the regularization parameter. Finally, we show our approach performs favorably in numerical experiments compared to several other optimal transport-based methods as well as maximum mean discrepancy (MMD), which is a popular multivariate GoF statistic.
Matthew Werenski, Shoaib Bin Masud, James M. Murphy, Shuchin Aeron
IEEE Trans. Inf. Theory2
2023 Multivariate Soft Rank via Entropy-Regularized Optimal Transport: Sample Efficiency and Generative Modeling
abstract
The framework of optimal transport has been leveraged to extend the notion of rank to the multivariate setting as corresponding to an optimal transport map, while preserving desirable properties of the resulting goodness-of-fit (GoF) statistics. In particular, the rank energy (RE) and rank maximum mean discrepancy (RMMD) are distribution-free under the null, exhibit high power in statistical testing, and are robust to outliers. In this paper, we point to and alleviate some of the shortcomings of these GoF statistics that are of practical significance, namely high computational cost, curse of dimensionality in statistical sample complexity, and lack of differentiability with respect to the data. We show that all these issues are addressed by defining multivariate rank as an entropic transport map derived from the entropic regularization of the optimal transport problem, which we refer to as the soft rank. We consequently propose two new statistics, the soft rank energy (sRE) and soft rank maximum mean discrepancy (sRMMD). Given n sample data points, we provide non-asymptotic convergence rates for the sample estimate of the entropic transport map to its population version that are essentially of the order n^(-1/2) when the source measure is subgaussian and the target measure has compact support. This result is novel compared to existing results which achieve a rate of n^(-1) but crucially rely on both measures having compact support. In contrast, the corresponding convergence rate of estimating an optimal transport map, and hence the rank map, is exponential in the data dimension. We leverage these fast convergence rates to show that the sample estimates of sRE and sRMMD converge rapidly to their population versions. Combined with the computational efficiency of methods in solving the entropy-regularized optimal transport problem, these results enable efficient rank-based GoF statistical computation, even in high dimensions. Furthermore, the sample estimates of sRE and sRMMD are differentiable with respect to the data and amenable to popular machine learning frameworks that rely on gradient methods. We leverage these properties towards showcasing their utility for generative modeling on two important problems: image generation and generating valid knockoffs for controlled feature selection.
Shoaib Bin Masud, Matthew Werenski, James M. Murphy, Shuchin Aeron
J. Mach. Learn. Res.1