Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data.

Alvin Heng

dblp:338/9333 · DBLP profile ↗
← Back
4ranked-venue papers
3as first author
4since 2021 · last 2024
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 4 · 3 first-author · 4 since 2021Databases, data management, data science and information retrieval · 1 · 1 first-author · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
3 papers
Generative modeling · 35% Trustworthy machine learning · 29% Time series and sequential data · 16%

Topics — the 11 heaviest of 12, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Generative modeling
diffusion model
1.422024
Out-of-Distribution Detection with a Single Unconditional Diffusion Model · NeurIPS 2024
Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models · NeurIPS 2023
Machine learning › Generative modeling › diffusion model
diffusion trajectory analysis
0.812024
Out-of-Distribution Detection with a Single Unconditional Diffusion Model · NeurIPS 2024
Machine learning › Trustworthy machine learning › robustness
out-of-distribution detection
0.812024
Out-of-Distribution Detection with a Single Unconditional Diffusion Model · NeurIPS 2024
Machine learning › Trustworthy machine learning
uncertainty estimation
0.812024
Out-of-Distribution Detection with a Single Unconditional Diffusion Model · NeurIPS 2024
Machine learning › Generative modeling
concept erasure
0.712023
Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models · NeurIPS 2023
Machine learning › Time series and sequential data › time series modeling
irregularly sampled time series
0.712023
Neural Continuous-Discrete State Space Models for Irregularly-Sampled Time Series · ICML 2023
Natural language and speech › Language models and text generation
knowledge editing
0.712023
Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models · NeurIPS 2023
Machine learning › Trustworthy machine learning › machine unlearning
selective forgetting
0.712023
Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models · NeurIPS 2023
Machine learning › Deep learning architectures and training
state space model
0.712023
Neural Continuous-Discrete State Space Models for Irregularly-Sampled Time Series · ICML 2023
Machine learning › Time series and sequential data
time series modeling
0.712023
Neural Continuous-Discrete State Space Models for Irregularly-Sampled Time Series · ICML 2023
Machine learning › Trustworthy machine learning
generative model safety
0.212023
Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models · NeurIPS 2023

Methods — techniques the papers use, named apart from their topics

rate-of-change measurement · 0.8curvature measurement · 0.8variational likelihood model · 0.7variational inference · 0.7continual learning · 0.7bayesian filtering · 0.7amortized inference · 0.7
YearPublicationVenuePosition
2024 Out-of-Distribution Detection with a Single Unconditional Diffusion Model
abstract
Out-of-distribution (OOD) detection is a critical task in machine learning that seeks to identify abnormal samples. Traditionally, unsupervised methods utilize a deep generative model for OOD detection. However, such approaches require a new model to be trained for each inlier dataset. This paper explores whether a single model can perform OOD detection across diverse tasks. To that end, we introduce Diffusion Paths (DiffPath), which uses a single diffusion model originally trained to perform unconditional generation for OOD detection. We introduce a novel technique of measuring the rate-of-change and curvature of the diffusion paths connecting samples to the standard normal. Extensive experiments show that with a single model, DiffPath is competitive with prior work using individual models on a variety of OOD tasks involving different distributions. Our code is publicly available at https://github.com/clear-nus/diffpath.
Alvin Heng, Alexandre H. Thiery, Harold Soh
NeurIPS1
2024 Generative Modeling with Flow-Guided Density Ratio Learning
Alvin Heng, Abdul Fatir Ansari, Harold Soh
ECML/PKDD (2)1
2023 Neural Continuous-Discrete State Space Models for Irregularly-Sampled Time Series
abstract
Learning accurate predictive models of real-world dynamic phenomena (e.g., climate, biological) remains a challenging task. One key issue is that the data generated by both natural and artificial processes often comprise time series that are irregularly sampled and/or contain missing observations. In this work, we propose the Neural Continuous-Discrete State Space Model (NCDSSM) for continuous-time modeling of time series through discrete-time observations. NCDSSM employs auxiliary variables to disentangle recognition from dynamics, thus requiring amortized inference only for the auxiliary variables. Leveraging techniques from continuous-discrete filtering theory, we demonstrate how to perform accurate Bayesian inference for the dynamic states. We propose three flexible parameterizations of the latent dynamics and an efficient training objective that marginalizes the dynamic states during inference. Empirical results on multiple benchmark datasets across various domains show improved imputation and forecasting performance of NCDSSM over existing models.
Abdul Fatir Ansari, Alvin Heng, Andre Lim, Harold Soh
ICML2
2023 Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models
abstract
The recent proliferation of large-scale text-to-image models has led to growing concerns that such models may be misused to generate harmful, misleading, and inappropriate content. Motivated by this issue, we derive a technique inspired by continual learning to selectively forget concepts in pretrained deep generative models. Our method, dubbed Selective Amnesia, enables controllable forgetting where a user can specify how a concept should be forgotten. Selective Amnesia can be applied to conditional variational likelihood models, which encompass a variety of popular deep generative frameworks, including variational autoencoders and large-scale text-to-image diffusion models. Experiments across different models demonstrate that our approach induces forgetting on a variety of concepts, from entire classes in standard datasets to celebrity and nudity prompts in text-to-image models.
Alvin Heng, Harold Soh
NeurIPS1