Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Yana Wei

dblp:347/9244 · DBLP profile ↗
← Back
6ranked-venue papers
2as first author
6since 2021 · last 2025
0009-0005-6695-0302ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 6 · 2 first-author · 6 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 2 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
5 papers
Vision and language · 54% Reinforcement learning · 23% Language models and text generation · 13%

Topics — the 10 heaviest of 10, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Computer vision › Vision and language › vision-language model
multimodal large language model
2.532025
Perception-R1: Pioneering Perception Policy with Reinforcement Learning · NeurIPS 2025
Perception in Reflection · ICML 2025
Merlin: Empowering Multimodal LLMs with Foresight Minds · ECCV (4) 2024
Natural language and speech › Language models and text generation
hallucination mitigation
0.912025
Perception in Reflection · ICML 2025
Machine learning › Reinforcement learning
reward design
0.912025
Unhackable Temporal Reward for Scalable Video MLLMs · ICLR 2025
Machine learning › Reinforcement learning › knowledge-based reinforcement learning
rule-based reinforcement learning
0.912025
Perception-R1: Pioneering Perception Policy with Reinforcement Learning · NeurIPS 2025
Computer vision › Video understanding and tracking
temporal modeling
0.912025
Unhackable Temporal Reward for Scalable Video MLLMs · ICLR 2025
Computer vision › Vision and language › vision-language model › multimodal large language model
video multimodal large language model
0.912025
Unhackable Temporal Reward for Scalable Video MLLMs · ICLR 2025
Computer vision › Vision and language › cross-modal matching
image-text matching
0.712023
Grounded Image Text Matching with Mismatched Relation Reasoning · ICCV 2023
Computer vision › Vision and language
visual grounding
0.712023
Grounded Image Text Matching with Mismatched Relation Reasoning · ICCV 2023
Natural language and speech › Language models and text generation
alignment
0.312025
Unhackable Temporal Reward for Scalable Video MLLMs · ICLR 2025
Machine learning › Reinforcement learning › reinforcement learning from human feedback
reward alignment
0.312025
Unhackable Temporal Reward for Scalable Video MLLMs · ICLR 2025

Methods — techniques the papers use, named apart from their topics

unlikelihood training · 0.9temporal perplexity score · 0.9reward design · 0.9reinforcement learning · 0.9policy-critic reflection · 0.9GRPO · 0.9foresight prediction · 0.8transformer · 0.7bidirectional message propagation · 0.7
YearPublicationVenuePosition
2025 Unhackable Temporal Reward for Scalable Video MLLMs
abstract
In the pursuit of superior video-processing MLLMs, we have encountered a perplexing paradox: the “anti-scaling law”, where more data and larger models lead to worse performance. This study unmasks the culprit: “temporal hacking”, a phenomenon where models shortcut by fixating on select frames, missing the full video narrative. In this work, we systematically establish a comprehensive theory of temporal hacking, defining it from a reinforcement learning perspective, introducing the Temporal Perplexity (TPL) score to assess this misalignment, and proposing the Unhackable Temporal Rewarding (UTR) framework to mitigate the temporal hacking. Both theoretically and empirically, TPL proves to be a reliable indicator of temporal modeling quality, correlating strongly with frame activation patterns. Extensive experiments reveal that UTR not only counters temporal hacking but significantly elevates video comprehension capabilities. This work not only advances video-AI systems but also illuminates the critical importance of aligning proxy rewards with true objectives in MLLM development.
En Yu, Kangheng Lin, Yana Wei, Zining Zhu 0004, Jianjian Sun, Zheng Ge, Xiangyu Zhang 0005, Jingyu Wang 0001, Wenbing Tao
ICLR4
2025 Perception in Reflection
abstract
We present a perception in reflection paradigm designed to transcend the limitations of current large vision-language models (LVLMs), which are expected yet often fail to achieve perfect perception initially. Specifically, we propose Reflective Perception (RePer), a dual-model reflection mechanism that systematically alternates between policy and critic models, enables iterative refinement of visual perception. This framework is powered by Reflective Perceptual Learning (RPL), which reinforces intrinsic reflective capabilities through a methodically constructed visual reflection dataset and reflective unlikelihood training Comprehensive experimental evaluation demonstrates RePer's quantifiable improvements in image understanding, captioning precision, and hallucination reduction. Notably, RePer achieves strong alignment between model attention patterns and human visual focus, while RPL optimizes fine-grained and free-form preference alignment. These advancements establish perception in reflection as a robust paradigm for future multimodal agents, particularly in tasks requiring complex reasoning and multi-step manipulation. Project Page: [https://weiyana.github.io/Perception-in-Reflection](https://weiyana.github.io/Perception-in-Reflection)
Yana Wei, Kangheng Lin, En Yu, Yuang Peng, Runpei Dong, Jianjian Sun, Zheng Ge, Xiangyu Zhang 0005, Vishal M. Patel
ICML1
2025 Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning
abstract
The remarkable reasoning capability of large language models (LLMs) stems from cognitive behaviors that emerge through reinforcement with verifiable rewards. This work investigates how to transfer this principle to Multimodal LLMs (MLLMs) to unlock advanced visual reasoning. We introduce a two-stage paradigm built on Qwen2.5-VL-7B: a massive linguistic cold-start fine-tuning, followed by multimodal reinforcement learning (RL) spanning nearly 1,000 steps—surpassing all previous open-source efforts in scale. This pioneering work reveals three fundamental insights: 1) Behavior transfer emerges surprisingly early in cold start due to linguistic mental imagery. 2) Cold start broadly memorizes visual behaviors, while RL critically discerns and scales up effective patterns. 3) Transfer strategically favors high-utility behaviors such as visual reflection. Our resulting model, Open-Vision-Reasoner (OVR), achieves state-of-the-art performance on a suite of reasoning benchmarks, including 95.3% on MATH500, 51.8% on MathVision and 54.6% on MathVerse. We release our model, data, and training dynamics to catalyze the development of more capable, behavior-aligned multimodal reasoners.
Yana Wei, Jianjian Sun, Kangheng Lin, Jisheng Yin, Jingcheng Hu, Yinmin Zhang, En Yu, Zejia Weng, Jia Wang 0025, Zheng Ge, Xiangyu Zhang 0005, Daxin Jiang, Vishal M. Patel
NeurIPS1
2025 Perception-R1: Pioneering Perception Policy with Reinforcement Learning
abstract
Inspired by the success of DeepSeek-R1, we explore the potential of rule-based reinforcement learning (RL) in MLLM post-training for perception policy learning. While promising, our initial experiments reveal that incorporating a thinking process through RL does not consistently lead to performance gains across all visual perception tasks. This leads us to delve into the essential role of RL in the context of visual perception. In this work, we return to the fundamentals and explore the effects of RL on different perception tasks. We observe that the perceptual perplexity is a major factor in determining the effectiveness of RL. We also observe that reward design plays a crucial role in further approaching the upper limit of model perception. To leverage these findings, we propose Perception-R1, a scalable RL framework using GRPO during MLLM post-training. With a standard Qwen2-VL-2B-Instruct, Perception-R1 achieves +4.2% on RefCOCO+, +17.9% on PixMo-Count, +4.2% on PageOCR, and notably, 31.9% AP on COCO2017 val for the first time, establishing a strong baseline for perception policy learning.
En Yu, Kangheng Lin, Jisheng Yin, Yana Wei, Yuang Peng, Jianjian Sun, Chunrui Han, Zheng Ge, Xiangyu Zhang 0005, Daxin Jiang, Jingyu Wang 0001, Wenbing Tao
NeurIPS5
2024 Merlin: Empowering Multimodal LLMs with Foresight Minds
En Yu, Yana Wei, Dongming Wu 0005, Lingyu Kong, Tiancai Wang, Zheng Ge, Xiangyu Zhang 0005, Wenbing Tao
ECCV (4)3
2023 Grounded Image Text Matching with Mismatched Relation Reasoning
abstract
This paper introduces Grounded Image Text Matching with Mismatched Relation (GITM-MR), a novel visual-linguistic joint task that evaluates the relation understanding capabilities of transformer-based pre-trained models. GITM-MR requires a model to first determine if an expression describes an image, then localize referred objects or ground the mismatched parts of the text. We provide a benchmark for evaluating vision-language (VL) models on this task, with a focus on the challenging settings of limited training data and out-of-distribution sentence lengths. Our evaluation demonstrates that pre-trained VL models often lack data efficiency and length generalization ability. To address this, we propose the Relation-sensitive Correspondence Reasoning Network (RCRN), which incorporates relation-aware reasoning via bi-directional message propagation guided by language structure. Our RCRN can he interpreted as a modular program and delivers strong performance in terms of both length generalization and data efficiency. The code and data are available on https://githuh.coin/SHTUPLUS/GITM-MR.
Yu Wu 0014, Yana Wei, Haozhe Wang 0002, Yongfei Liu, Sibei Yang, Xuming He 0001
ICCV2