Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data.

Sunny Duan

dblp:184/6049 · DBLP profile ↗
← Back
5ranked-venue papers
3as first author
3since 2021 · last 2025
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 4 · 3 first-author · 3 since 2021Security and privacy · 1

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
4 papers
Trustworthy machine learning · 50% Language models and text generation · 25% Representation and self-supervised learning · 12%
Interdisciplinary, comprehensive, and emerging computing
2 papers
Bioinformatics and computational biology · 85% Medical and health informatics · 15%
Network and information security
1 paper
Usable security · 50% Systems and software security · 50%

Topics — the 8 heaviest of 11, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Trustworthy machine learning
data leakage
0.912025
Uncovering Latent Memories in Large Language Models · ICLR 2025
Natural language and speech › Language models and text generation › large language model › knowledge in language models
memorization
0.912025
Uncovering Latent Memories in Large Language Models · ICLR 2025
Machine learning › Trustworthy machine learning
privacy and data protection
0.912025
Uncovering Latent Memories in Large Language Models · ICLR 2025
Bioinformatics and computational biology
computational neuroscience
0.912025
From Synapses to Dynamics: Obtaining Function from Structure in a Connectome Constrained Model of the Head Direction Circuit · NeurIPS 2025
Machine learning › Representation and self-supervised learning › representation learning
disentangled representation learning
0.412020
Unsupervised Model Selection for Variational Disentangled Representation Learning · ICLR 2020
Machine learning › Learning theory
model selection
0.412020
Unsupervised Model Selection for Variational Disentangled Representation Learning · ICLR 2020
Usable security
social engineering
0.212016
Users Really Do Plug in USB Drives They Find · IEEE Symposium on Security and Privacy 2016
Medical and health informatics
EEG analysis
0.112021
Representation learning for improved interpretability and classification accuracy of clinical factors from EEG · ICLR 2021

Methods — techniques the papers use, named apart from their topics

unsupervised learning · 1.7self-supervised learning · 1.7in-silico ablation · 1.7representation learning · 1.0weight perturbation · 0.9cross-entropy loss diagnostic · 0.9user survey · 0.5controlled field experiment · 0.5variational inference · 0.4unsupervised model selection · 0.4
YearPublicationVenuePosition
2025 Uncovering Latent Memories in Large Language Models
abstract
Frontier AI systems are making transformative impacts across society, but such benefits are not without costs: models trained on web-scale datasets containing personal and private data raise profound concerns about data privacy and security. Language models are trained on extensive corpora including potentially sensitive or proprietary information, and the risk of data leakage, where the model response reveals pieces of such information, remains inadequately understood. Prior work has investigated that sequence complexity and the number of repetitions are the primary drivers of memorization. In this work, we examine the most vulnerable class of data: highly complex sequences that are presented only once during training. These sequences often contain the most sensitive information and pose considerable risk if memorized. By analyzing the progression of memorization for these sequences throughout training, we uncover a striking observation: many memorized sequences persist in the model's memory, exhibiting resistance to catastrophic forgetting even after just one encounter. Surprisingly, these sequences may not appear memorized immediately after their first exposure but can later be “uncovered” during training, even in the absence of subsequent exposures - a phenomenon we call "latent memorization." Latent memorization presents a serious challenge for data privacy, as sequences that seem hidden at the final checkpoint of a model may still be easily recoverable. We demonstrate how these hidden sequences can be revealed through random weight perturbations, and we introduce a diagnostic test based on cross-entropy loss to accurately identify latent memorized sequences.
Sunny Duan, Mikail Khona, Abhiram Iyer, Rylan Schaeffer, Ila Fiete
ICLR1
2025 From Synapses to Dynamics: Obtaining Function from Structure in a Connectome Constrained Model of the Head Direction Circuit
abstract
How precisely does circuit wiring specify function? This fundamental question is particularly relevant for modern neuroscience, as large-scale electron microscopy now enables the reconstruction of neural circuits at single-synapse resolution across many organisms. To interpret circuit function from such datasets, we must understand the extent to which [measured] structure constrains dynamics. We investigate this question in the drosophila head direction (HD) circuit, which maintains an internal heading estimate through attractor dynamics that integrate self-motion velocity cues. This circuit serves as a sensitive assay for functional specification: continuous attractor networks are theoretically known to require finely tuned wiring, whereas connectomes reveal that biological wiring can be variable and omit key cellular parameters such as synaptic gains, neuronal thresholds, and time constants. We introduce a method that combines self-supervised and unsupervised learning objectives to estimate unknown parameters at the level of cell types, rather than individual neurons and synapses. Given the raw connectivity matrix, our approach recovers a network that robustly exhibits continuous attractor dynamics and accurately integrates a range of velocity inputs, despite minimal parameter tuning on a connectome which notably departs from the symmetric regularity of an idealized ring attractor. We characterize how deviations from the original connectome shape the space of viable solutions. We also perform in-silico ablation experiments to probe the distinct functional roles of specific cell types in the circuit, demonstrating how connectome-derived structure, when augmented with minimal, biologically grounded tuning, can replicate known physiology and elucidate circuit function.
Sunny Duan, Ling L. Dong, Ila Fiete
NeurIPS1
2021 Representation learning for improved interpretability and classification accuracy of clinical factors from EEG
Garrett Honke, Irina Higgins, Nina Thigpen, Vladimir Miskovic, Katie Link, Sunny Duan, Pramod Gupta, Julia Klawohn, Greg Hajcak
ICLR6
2020 Unsupervised Model Selection for Variational Disentangled Representation Learning
Sunny Duan, Loïc Matthey, Andre Saraiva 0001, Nicholas Watters, Chris Burgess 0001, Alexander Lerchner, Irina Higgins
ICLR1
2016 Users Really Do Plug in USB Drives They Find
abstract
We investigate the anecdotal belief that end users will pick up and plug in USB flash drives they find by completing a controlled experiment in which we drop 297 flash drives on a large university campus. We find that the attack is effective with an estimated success rate of 45 -- 98% and expeditious with the first drive connected in less than six minutes. We analyze the types of drives users connected and survey those users to understand their motivation and security profile. We find that a drive's appearance does not increase attack success. Instead, users connect the drive with the altruistic intention of finding the owner. These individuals are not technically incompetent, but are rather typical community members who appear to take more recreational risks then their peers. We conclude with lessons learned and discussion on how social engineering attacks -- while less technical -- continue to be an effective attack vector that our community has yet to successfully address.
Matthew Tischer, Zakir Durumeric, Sam Foster, Sunny Duan, Alec Mori, Elie Bursztein, Michael D. Bailey
IEEE Symposium on Security and Privacy4