Demo Data from SIGIR 2026 / reviewers in the wild / expert
Ruyi An
dblp:317/1391
· DBLP profile ↗
4ranked-venue papers
2as first author
4since 2021 · last 2025
0000-0003-1745-3252ORCID · corroborated
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 4 · 2 first-author · 4 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 1 first-author · 2 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
3 papers |
Generative modeling · 43% Deep learning architectures and training · 23% Language models and text generation · 11% | |
| Computer graphics and multimedia
1 paper |
Computational photography and imaging · 33% Visual content generation and editing · 33% Image and video processing · 33% | |
| Human-computer interaction and pervasive computing
1 paper |
Human-AI interaction · 100% |
Topics — the 13 heaviest of 15, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Deep learning architectures and training
data augmentation |
0.9 | 1 | 2025 | Generative Data Augmentation via Diffusion Distillation, Adversarial Alignment, and Importance Reweighting · NeurIPS 2025 |
Machine learning › Generative modeling › diffusion model
diffusion distillation |
0.9 | 1 | 2025 | Generative Data Augmentation via Diffusion Distillation, Adversarial Alignment, and Importance Reweighting · NeurIPS 2025 |
Machine learning › Generative modeling
diffusion model |
0.9 | 1 | 2025 | Generative Data Augmentation via Diffusion Distillation, Adversarial Alignment, and Importance Reweighting · NeurIPS 2025 |
Natural language and speech › Language models and text generation
foundation model agents |
0.9 | 1 | 2025 | Cradle: Empowering Foundation Agents towards General Computer Control · ICML 2025 |
Machine learning › Deep learning architectures and training › data augmentation
generative data augmentation |
0.9 | 1 | 2025 | Generative Data Augmentation via Diffusion Distillation, Adversarial Alignment, and Importance Reweighting · NeurIPS 2025 |
Visual content generation and editing
image-to-image translation |
0.9 | 1 | 2025 | OpticalNet: An Optical Imaging Dataset and Benchmark Beyond the Diffraction Limit · CVPR 2025 |
Computational photography and imaging › image acquisition
optical imaging |
0.9 | 1 | 2025 | OpticalNet: An Optical Imaging Dataset and Benchmark Beyond the Diffraction Limit · CVPR 2025 |
Image and video processing › super-resolution
super-resolution imaging |
0.9 | 1 | 2025 | OpticalNet: An Optical Imaging Dataset and Benchmark Beyond the Diffraction Limit · CVPR 2025 |
Machine learning › Representation and self-supervised learning › hierarchical representation
hierarchical representation learning |
0.8 | 1 | 2024 | Improving Unsupervised Hierarchical Representation With Reinforcement Learning · CVPR 2024 |
Machine learning › Generative modeling › variational autoencoder
hierarchical VAE |
0.8 | 1 | 2024 | Improving Unsupervised Hierarchical Representation With Reinforcement Learning · CVPR 2024 |
Machine learning › Reinforcement learning › policy optimization
policy gradient |
0.8 | 1 | 2024 | Improving Unsupervised Hierarchical Representation With Reinforcement Learning · CVPR 2024 |
Machine learning › Generative modeling
variational autoencoder |
0.8 | 1 | 2024 | Improving Unsupervised Hierarchical Representation With Reinforcement Learning · CVPR 2024 |
Machine learning › Efficient and distributed learning
model compression |
0.3 | 1 | 2025 | Generative Data Augmentation via Diffusion Distillation, Adversarial Alignment, and Importance Reweighting · NeurIPS 2025 |
Methods — techniques the papers use, named apart from their topics
self-reflection · 1.7large multimodal model · 1.7action planning · 1.7score distillation · 0.9importance reweighting · 0.9image-to-image translation · 0.9deep learning · 0.9adversarial alignment · 0.9skip-generative path · 0.8reinforcement learning · 0.8q-value function · 0.8policy gradient · 0.8
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | OpticalNet: An Optical Imaging Dataset and Benchmark Beyond the Diffraction LimitabstractOptical imaging capable of resolving nanoscale features would revolutionize scientific research and engineering applications across biomedicine, smart manufacturing, and semiconductor quality control. However, due to the physical phenomenon of diffraction, the optical resolution is limited to approximately half the wavelength of light, which impedes the observation of subwavelength objects such as the native state coronavirus, typically smaller than 200 nm. Fortunately, deep learning methods have shown remarkable potential in uncovering underlying patterns within data, promising to overcome the diffraction limit by revealing the mapping pattern between diffraction images and their corresponding ground truth object images. However, the absence of suitable datasets has hindered progress in this field–collecting high-quality optical data of subwavelength objects is highly difficult as these objects are inherently invisible under conventional microscopy, making it impossible to perform standard visual calibration and drift correction. Therefore, we provide the first general optical imaging dataset based on the "building block" concept for challenging the diffraction limit. Drawing an analogy to modular construction principles, we construct a comprehensive optical imaging dataset comprising subwavelength fundamental elements, i.e., small square units that can be assembled into larger and more complex objects. We then frame the task as an image-to-image translation task and evaluate various vision methods. Experimental results validate our "building block" concept, demonstrating that models trained on basic square units can effectively generalize to realistic, more complex unseen objects. Most importantly, by highlighting this underexplored AI-for-science area and its potential, we aspire to advance optical science by fostering collaboration with the vision and machine learning communities. Benquan Wang, Ruyi An, Jin-Kyu So, Sergei Kurdiumov, Eng Aik Chan, Giorgio Adamo, Yuhan Peng, Yewen Li, Bo An 0001 |
CVPR | 2 |
| 2025 | Cradle: Empowering Foundation Agents towards General Computer ControlabstractDespite their success in specific scenarios, existing foundation agents still struggle to generalize across various virtual scenarios, mainly due to the dramatically different encapsulations of environments with manually designed observation and action spaces. To handle this issue, we propose the General Computer Control (GCC) setting to restrict foundation agents to interact with software through the most unified and standardized interface, i.e., using screenshots as input and keyboard and mouse actions as output. We introduce Cradle, a modular and flexible LMM-powered framework, as a preliminary attempt towards GCC. Enhanced by six key modules, Information Gathering, Self-Reflection, Task Inference, Skill Curation, Action Planning, and Memory, Cradle is able to understand input screenshots and output executable code for low-level keyboard and mouse control after high-level planning and information retrieval, so that Cradle can interact with any software and complete long-horizon complex tasks without relying on any built-in APIs. Experimental results show that Cradle exhibits remarkable generalizability and impressive performance across four previously unexplored commercial video games (Red Dead Redemption 2, Cities:Skylines, Stardew Valley and Dealer’s Life 2), five software applications (Chrome, Outlook, Feishu, Meitu and CapCut), and a comprehensive benchmark, OSWorld. With a unified interface to interact with any software, Cradle greatly extends the reach of foundation agents thus paving the way for generalist agents. Weihao Tan, Wentao Zhang 0007, Xinrun Xu, Haochong Xia, Ziluo Ding, Boyu Li 0003, Junpeng Yue, Jiechuan Jiang, Yewen Li, Ruyi An, Molei Qin, Chuqiao Zong, Longtao Zheng, Xiaoqiang Chai, Yifei Bi, Tianbao Xie, Pengjie Gu, Xiyun Li, Ceyao Zhang, Chaojie Wang 0001, Xinrun Wang, Börje Karlsson 0001, Bo An 0001, Shuicheng Yan, Zongqing Lu 0002 |
ICML | 11 |
| 2025 | Generative Data Augmentation via Diffusion Distillation, Adversarial Alignment, and Importance ReweightingabstractGenerative data augmentation (GDA) leverages generative models to enrich training sets with entirely new samples drawn from the modeled data distribution to achieve performance gains. However, the usage of the mighty contemporary diffusion models in GDA remains impractical: *i)* their thousand-step sampling loop inflates wall-time and energy cost per image augmentation; and *ii)* the divergence between synthetic and real distributions is unknown--classifiers trained on synthetic receive biased gradients.
We propose DAR-GDA, a three-stage augmentation pipeline that unites model **D**istillation, **A**dversarial alignment, and importance **R**eweighting that makes diffusion-quality augmentation both fast and optimized for improving downstream learning outcomes.
In particular, a teacher diffusion model is compressed into a one-step student via score distillation, slashing the time per-image cost by $>100\times$ while preserving FID.
During this distillation (D), the student model additionally undergoes adversarial alignment (A) by receiving direct training signals against real images, supplementing the teacher's guidance to better match the true data distribution.
The discriminator from this adversarial process inherently learns to assess the synthetic-to-real data gap. Its calibrated probabilistic outputs are then employed in reweighting (R) by importance weights that quantify the distributional gap and adjust the classification loss when training downstream models; we show that reweighting yields an unbiased stochastic estimator of the real-data risk, fostering training dynamics akin to those of genuine samples.
Experiments validate DAR-GDA's synergistic design through progressive accuracy gains with each D-A-R stage. Our approach not only surpasses conventional non-foundation-model GDA baselines but also remarkably matches or exceeds the GDA performance of large, web-pretrained text-to-image models, despite using solely in-domain data.
DAR-GDA thus offers diffusion-fidelity GDA samples efficiently, while correcting synthetic-to-real bias to benefit downstream tasks. Ruyi An, Haicheng Huang, Huangjie Zheng, Mingyuan Zhou |
NeurIPS | 1 |
| 2024 | Improving Unsupervised Hierarchical Representation With Reinforcement LearningabstractLearning representations to capture the very fundamental understanding of the world is a key challenge in machine learning. The hierarchical structure of explanatory factors hidden in data is such a general representation and could be potentially achieved with a hierarchical VAE. However, training a hierarchical VAE always suffers from the “posterior collapse”, where the data information is hard to propagate to the higher-level latent variables, hence resulting in a bad hierarchical representation. To address this issue, we first analyze the shortcomings of existing methods for mitigating the posterior collapse from an information theory perspective, then highlight the necessity of regularization for explicitly propagating data information to higher-level latent variables while maintaining the dependency between different levels. This naturally leads to formulating the inference of the hierarchical latent representation as a sequential decision process, which could benefit from applying reinforcement learning (RL). Aligning RL's objective with the regularization, we first introduce a skip-generative path to acquire a reward for evaluating the information content of an inferred latent representation, and then the developed Q-value function based on it could have a consistent optimization direction of the regularization. Finally, policy gradient, one of the typical RL methods, is employed to train a hierarchical VAE without introducing a gradient estimator. Experimental results firmly support our analysis and demonstrate that our proposed method effectively mitigates the posterior collapse issue, learns an informative hierarchy, acquires explainable latent representations, and significantly outperforms other hierarchical VAE-based methods in downstream tasks. Ruyi An, Yewen Li, Pengjie Gu, Mengchen Zhao, Dong Li 0016, Jianye Hao, Chaojie Wang 0001, Bo An 0001, Mingyuan Zhou |
CVPR | 1 |