Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Ruyi An

dblp:317/1391 · DBLP profile ↗
← Back
4ranked-venue papers
2as first author
4since 2021 · last 2025
0000-0003-1745-3252ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 4 · 2 first-author · 4 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 1 first-author · 2 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
3 papers
Generative modeling · 43% Deep learning architectures and training · 23% Language models and text generation · 11%
Computer graphics and multimedia
1 paper
Computational photography and imaging · 33% Visual content generation and editing · 33% Image and video processing · 33%
Human-computer interaction and pervasive computing
1 paper
Human-AI interaction · 100%

Topics — the 13 heaviest of 15, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Deep learning architectures and training
data augmentation
0.912025
Generative Data Augmentation via Diffusion Distillation, Adversarial Alignment, and Importance Reweighting · NeurIPS 2025
Machine learning › Generative modeling › diffusion model
diffusion distillation
0.912025
Generative Data Augmentation via Diffusion Distillation, Adversarial Alignment, and Importance Reweighting · NeurIPS 2025
Machine learning › Generative modeling
diffusion model
0.912025
Generative Data Augmentation via Diffusion Distillation, Adversarial Alignment, and Importance Reweighting · NeurIPS 2025
Natural language and speech › Language models and text generation
foundation model agents
0.912025
Cradle: Empowering Foundation Agents towards General Computer Control · ICML 2025
Machine learning › Deep learning architectures and training › data augmentation
generative data augmentation
0.912025
Generative Data Augmentation via Diffusion Distillation, Adversarial Alignment, and Importance Reweighting · NeurIPS 2025
Visual content generation and editing
image-to-image translation
0.912025
OpticalNet: An Optical Imaging Dataset and Benchmark Beyond the Diffraction Limit · CVPR 2025
Computational photography and imaging › image acquisition
optical imaging
0.912025
OpticalNet: An Optical Imaging Dataset and Benchmark Beyond the Diffraction Limit · CVPR 2025
Image and video processing › super-resolution
super-resolution imaging
0.912025
OpticalNet: An Optical Imaging Dataset and Benchmark Beyond the Diffraction Limit · CVPR 2025
Machine learning › Representation and self-supervised learning › hierarchical representation
hierarchical representation learning
0.812024
Improving Unsupervised Hierarchical Representation With Reinforcement Learning · CVPR 2024
Machine learning › Generative modeling › variational autoencoder
hierarchical VAE
0.812024
Improving Unsupervised Hierarchical Representation With Reinforcement Learning · CVPR 2024
Machine learning › Reinforcement learning › policy optimization
policy gradient
0.812024
Improving Unsupervised Hierarchical Representation With Reinforcement Learning · CVPR 2024
Machine learning › Generative modeling
variational autoencoder
0.812024
Improving Unsupervised Hierarchical Representation With Reinforcement Learning · CVPR 2024
Machine learning › Efficient and distributed learning
model compression
0.312025
Generative Data Augmentation via Diffusion Distillation, Adversarial Alignment, and Importance Reweighting · NeurIPS 2025

Methods — techniques the papers use, named apart from their topics

self-reflection · 1.7large multimodal model · 1.7action planning · 1.7score distillation · 0.9importance reweighting · 0.9image-to-image translation · 0.9deep learning · 0.9adversarial alignment · 0.9skip-generative path · 0.8reinforcement learning · 0.8q-value function · 0.8policy gradient · 0.8
YearPublicationVenuePosition
2025 OpticalNet: An Optical Imaging Dataset and Benchmark Beyond the Diffraction Limit
abstract
Optical imaging capable of resolving nanoscale features would revolutionize scientific research and engineering applications across biomedicine, smart manufacturing, and semiconductor quality control. However, due to the physical phenomenon of diffraction, the optical resolution is limited to approximately half the wavelength of light, which impedes the observation of subwavelength objects such as the native state coronavirus, typically smaller than 200 nm. Fortunately, deep learning methods have shown remarkable potential in uncovering underlying patterns within data, promising to overcome the diffraction limit by revealing the mapping pattern between diffraction images and their corresponding ground truth object images. However, the absence of suitable datasets has hindered progress in this field–collecting high-quality optical data of subwavelength objects is highly difficult as these objects are inherently invisible under conventional microscopy, making it impossible to perform standard visual calibration and drift correction. Therefore, we provide the first general optical imaging dataset based on the "building block" concept for challenging the diffraction limit. Drawing an analogy to modular construction principles, we construct a comprehensive optical imaging dataset comprising subwavelength fundamental elements, i.e., small square units that can be assembled into larger and more complex objects. We then frame the task as an image-to-image translation task and evaluate various vision methods. Experimental results validate our "building block" concept, demonstrating that models trained on basic square units can effectively generalize to realistic, more complex unseen objects. Most importantly, by highlighting this underexplored AI-for-science area and its potential, we aspire to advance optical science by fostering collaboration with the vision and machine learning communities.
Benquan Wang, Ruyi An, Jin-Kyu So, Sergei Kurdiumov, Eng Aik Chan, Giorgio Adamo, Yuhan Peng, Yewen Li, Bo An 0001
CVPR2
2025 Cradle: Empowering Foundation Agents towards General Computer Control
abstract
Despite their success in specific scenarios, existing foundation agents still struggle to generalize across various virtual scenarios, mainly due to the dramatically different encapsulations of environments with manually designed observation and action spaces. To handle this issue, we propose the General Computer Control (GCC) setting to restrict foundation agents to interact with software through the most unified and standardized interface, i.e., using screenshots as input and keyboard and mouse actions as output. We introduce Cradle, a modular and flexible LMM-powered framework, as a preliminary attempt towards GCC. Enhanced by six key modules, Information Gathering, Self-Reflection, Task Inference, Skill Curation, Action Planning, and Memory, Cradle is able to understand input screenshots and output executable code for low-level keyboard and mouse control after high-level planning and information retrieval, so that Cradle can interact with any software and complete long-horizon complex tasks without relying on any built-in APIs. Experimental results show that Cradle exhibits remarkable generalizability and impressive performance across four previously unexplored commercial video games (Red Dead Redemption 2, Cities:Skylines, Stardew Valley and Dealer’s Life 2), five software applications (Chrome, Outlook, Feishu, Meitu and CapCut), and a comprehensive benchmark, OSWorld. With a unified interface to interact with any software, Cradle greatly extends the reach of foundation agents thus paving the way for generalist agents.
Weihao Tan, Wentao Zhang 0007, Xinrun Xu, Haochong Xia, Ziluo Ding, Boyu Li 0003, Junpeng Yue, Jiechuan Jiang, Yewen Li, Ruyi An, Molei Qin, Chuqiao Zong, Longtao Zheng, Xiaoqiang Chai, Yifei Bi, Tianbao Xie, Pengjie Gu, Xiyun Li, Ceyao Zhang, Chaojie Wang 0001, Xinrun Wang, Börje Karlsson 0001, Bo An 0001, Shuicheng Yan, Zongqing Lu 0002
ICML11
2025 Generative Data Augmentation via Diffusion Distillation, Adversarial Alignment, and Importance Reweighting
abstract
Generative data augmentation (GDA) leverages generative models to enrich training sets with entirely new samples drawn from the modeled data distribution to achieve performance gains. However, the usage of the mighty contemporary diffusion models in GDA remains impractical: *i)* their thousand-step sampling loop inflates wall-time and energy cost per image augmentation; and *ii)* the divergence between synthetic and real distributions is unknown--classifiers trained on synthetic receive biased gradients. We propose DAR-GDA, a three-stage augmentation pipeline that unites model **D**istillation, **A**dversarial alignment, and importance **R**eweighting that makes diffusion-quality augmentation both fast and optimized for improving downstream learning outcomes. In particular, a teacher diffusion model is compressed into a one-step student via score distillation, slashing the time per-image cost by $>100\times$ while preserving FID. During this distillation (D), the student model additionally undergoes adversarial alignment (A) by receiving direct training signals against real images, supplementing the teacher's guidance to better match the true data distribution. The discriminator from this adversarial process inherently learns to assess the synthetic-to-real data gap. Its calibrated probabilistic outputs are then employed in reweighting (R) by importance weights that quantify the distributional gap and adjust the classification loss when training downstream models; we show that reweighting yields an unbiased stochastic estimator of the real-data risk, fostering training dynamics akin to those of genuine samples. Experiments validate DAR-GDA's synergistic design through progressive accuracy gains with each D-A-R stage. Our approach not only surpasses conventional non-foundation-model GDA baselines but also remarkably matches or exceeds the GDA performance of large, web-pretrained text-to-image models, despite using solely in-domain data. DAR-GDA thus offers diffusion-fidelity GDA samples efficiently, while correcting synthetic-to-real bias to benefit downstream tasks.
Ruyi An, Haicheng Huang, Huangjie Zheng, Mingyuan Zhou
NeurIPS1
2024 Improving Unsupervised Hierarchical Representation With Reinforcement Learning
abstract
Learning representations to capture the very fundamental understanding of the world is a key challenge in machine learning. The hierarchical structure of explanatory factors hidden in data is such a general representation and could be potentially achieved with a hierarchical VAE. However, training a hierarchical VAE always suffers from the “posterior collapse”, where the data information is hard to propagate to the higher-level latent variables, hence resulting in a bad hierarchical representation. To address this issue, we first analyze the shortcomings of existing methods for mitigating the posterior collapse from an information theory perspective, then highlight the necessity of regularization for explicitly propagating data information to higher-level latent variables while maintaining the dependency between different levels. This naturally leads to formulating the inference of the hierarchical latent representation as a sequential decision process, which could benefit from applying reinforcement learning (RL). Aligning RL's objective with the regularization, we first introduce a skip-generative path to acquire a reward for evaluating the information content of an inferred latent representation, and then the developed Q-value function based on it could have a consistent optimization direction of the regularization. Finally, policy gradient, one of the typical RL methods, is employed to train a hierarchical VAE without introducing a gradient estimator. Experimental results firmly support our analysis and demonstrate that our proposed method effectively mitigates the posterior collapse issue, learns an informative hierarchy, acquires explainable latent representations, and significantly outperforms other hierarchical VAE-based methods in downstream tasks.
Ruyi An, Yewen Li, Pengjie Gu, Mengchen Zhao, Dong Li 0016, Jianye Hao, Chaojie Wang 0001, Bo An 0001, Mingyuan Zhou
CVPR1