Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Tianyao He

dblp:298/1169 · DBLP profile ↗
← Back
7ranked-venue papers
2as first author
7since 2021 · last 2026
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 6 · 2 first-author · 6 since 2021Graphics, computer vision, multimedia, augmented reality and games · 3 · 1 first-author · 3 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
6 papers
Video understanding and tracking · 35% Probabilistic and Bayesian machine learning · 19% Knowledge representation and reasoning · 16%
Computer graphics and multimedia
2 papers
Visual content generation and editing · 57% Audio and music processing · 43%
Theoretical computer science
1 paper
Algorithmic game theory and mechanism design · 100%

Topics — the 15 heaviest of 19, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Computer vision › Video understanding and tracking › deep video understanding › video reasoning
video causal reasoning
1.822026
MECD+: Unlocking Event-Level Causal Graph Discovery for Video Reasoning · IEEE Trans. Pattern Anal. Mach. Intell. 2026
MECD: Unlocking Multi-Event Causal Discovery in Video Reasoning · NeurIPS 2024
Knowledge, reasoning and agents › Knowledge representation and reasoning › causal reasoning
causal graph discovery
1.012026
MECD+: Unlocking Event-Level Causal Graph Discovery for Video Reasoning · IEEE Trans. Pattern Anal. Mach. Intell. 2026
Knowledge, reasoning and agents › Knowledge representation and reasoning
causal reasoning
1.012026
MECD+: Unlocking Event-Level Causal Graph Discovery for Video Reasoning · IEEE Trans. Pattern Anal. Mach. Intell. 2026
Computer vision › 3D vision
3d facial prior
0.912025
DynamicFace: High-Quality and Consistent Face Swapping for Image and Video Using Composable 3D Facial Priors · ICCV 2025
Computer vision › Face, body and person analysis › face manipulation
face swapping
0.912025
DynamicFace: High-Quality and Consistent Face Swapping for Image and Video Using Composable 3D Facial Priors · ICCV 2025
Computer vision › Video understanding and tracking › activity recognition › procedural activity understanding › procedural video understanding
instructional video understanding
0.912025
Achieving Procedure-Aware Instructional Video Correlation Learning Under Weak Supervision from a Collaborative Perspective · Int. J. Comput. Vis. 2025
Computer vision › Image recognition and object detection
pedestrian detection
0.912025
Toward Accurate and Robust Pedestrian Detection via Variational Inference · Int. J. Comput. Vis. 2025
Machine learning › Probabilistic and Bayesian machine learning › probabilistic inference › approximate inference
variational inference
0.912025
Toward Accurate and Robust Pedestrian Detection via Variational Inference · Int. J. Comput. Vis. 2025
Visual content generation and editing › face editing
face swapping
0.912025
DynamicFace: High-Quality and Consistent Face Swapping for Image and Video Using Composable 3D Facial Priors · ICCV 2025
Machine learning › Probabilistic and Bayesian machine learning
causal inference
0.812024
MECD: Unlocking Multi-Event Causal Discovery in Video Reasoning · NeurIPS 2024
Machine learning › Probabilistic and Bayesian machine learning › causal inference › causal discovery
granger causality
0.812024
MECD: Unlocking Multi-Event Causal Discovery in Video Reasoning · NeurIPS 2024
Computer vision › Video understanding and tracking › activity recognition › procedural activity understanding
instructional video analysis
0.812024
Collaborative Weakly Supervised Video Correlation Learning for Procedure-Aware Instructional Video Analysis · AAAI 2024
Algorithmic game theory and mechanism design › matching
bipartite matching
0.712023
Fine-Grained Music Plagiarism Detection: Revealing Plagiarists through Bipartite Graph Matching and a Comprehensive Large-Scale Dataset · ACM Multimedia 2023
Computer vision › Video understanding and tracking
video question answering
0.312026
MECD+: Unlocking Event-Level Causal Graph Discovery for Video Reasoning · IEEE Trans. Pattern Anal. Mach. Intell. 2026
Data mining
dataset construction
0.212023
Fine-Grained Music Plagiarism Detection: Revealing Plagiarists through Bipartite Graph Matching and a Comprehensive Large-Scale Dataset · ACM Multimedia 2023

Methods — techniques the papers use, named apart from their topics

maximum matching · 2.0bipartite graph matching · 2.0mask-based event prediction · 1.8front-door adjustment · 1.8counterfactual inference · 1.8composable 3d facial priors · 1.7granger causality · 1.0weak supervision · 0.9variational inference · 0.9weakly supervised learning · 0.8frame-to-step alignment · 0.8collaborative step mining · 0.8
YearPublicationVenuePosition
2026 MECD+: Unlocking Event-Level Causal Graph Discovery for Video Reasoning
abstract
Video causal reasoning aims to achieve a high-level understanding of videos from a causal perspective. However, it exhibits limitations in its scope, primarily executed in a question-answering paradigm and focusing on brief video segments containing isolated events and basic causal relations, lacking comprehensive and structured causality analysis for videos with multiple interconnected events. To fill this gap, we introduce a new task and dataset, Multi-Event Causal Discovery (MECD). It aims to uncover the causal relations between events distributed chronologically across long videos. Given visual segments and textual descriptions of events, MECD identifies the causal associations between these events to derive a comprehensive and structured event-level video causal graph explaining why and how the result event occurred. To address the challenges of MECD, we devise a novel framework inspired by the Granger Causality method, incorporating an efficient mask-based event prediction model to perform an Event Granger Test. It estimates causality by comparing the predicted result event when premise events are masked versus unmasked. Furthermore, we integrate causal inference techniques such as front-door adjustment and counterfactual inference to mitigate challenges in MECD like causality confounding and illusory causality. Additionally, context chain reasoning is introduced to conduct more robust and generalized reasoning. Experiments validate the effectiveness of our framework in reasoning complete causal relations, outperforming GPT-4o and VideoChat2 by 5.77% and 2.70%, respectively. Further experiments demonstrate that causal relation graphs can also contribute to downstream video understanding tasks such as video question answering and video event prediction.
Tieyuan Chen, Huabin Liu 0001, Yi Wang 0033, Yihang Chen 0002, Tianyao He, Chaofan Gan, Huanyu He, Weiyao Lin
IEEE Trans. Pattern Anal. Mach. Intell.5
2025 DynamicFace: High-Quality and Consistent Face Swapping for Image and Video Using Composable 3D Facial Priors
Runqi Wang, Sijie Xu, Tianyao He, Dejia Song, Nemo Chen, Xu Tang 0007, Yao Hu 0002
ICCV4
2025 Achieving Procedure-Aware Instructional Video Correlation Learning Under Weak Supervision from a Collaborative Perspective
Tianyao He, Huabin Liu 0001, Zelin Ni, Yuxi Li 0009, Yang Zhang 0002, Weiyao Lin
Int. J. Comput. Vis.1
2025 Toward Accurate and Robust Pedestrian Detection via Variational Inference
Huanyu He, Weiyao Lin, Tianyao He, Yuxi Li 0009
Int. J. Comput. Vis.4
2024 Collaborative Weakly Supervised Video Correlation Learning for Procedure-Aware Instructional Video Analysis
abstract
Video Correlation Learning (VCL), which aims to analyze the relationships between videos, has been widely studied and applied in various general video tasks. However, applying VCL to instructional videos is still quite challenging due to their intrinsic procedural temporal structure. Specifically, procedural knowledge is critical for accurate correlation analyses on instructional videos. Nevertheless, current procedure-learning methods heavily rely on step-level annotations, which are costly and not scalable. To address this problem, we introduce a weakly supervised framework called Collaborative Procedure Alignment (CPA) for procedure-aware correlation learning on instructional videos. Our framework comprises two core modules: collaborative step mining and frame-to-step alignment. The collaborative step mining module enables simultaneous and consistent step segmentation for paired videos, leveraging the semantic and temporal similarity between frames. Based on the identified steps, the frame-to-step alignment module performs alignment between the frames and steps across videos. The alignment result serves as a measurement of the correlation distance between two videos. We instantiate our framework in two distinct instructional video tasks: sequence verification and action quality assessment. Extensive experiments validate the effectiveness of our approach in providing accurate and interpretable correlation analyses for instructional videos.
Tianyao He, Huabin Liu 0001, Yuxi Li 0009, Yang Zhang 0002, Weiyao Lin
AAAI1
2024 MECD: Unlocking Multi-Event Causal Discovery in Video Reasoning
abstract
Video causal reasoning aims to achieve a high-level understanding of video content from a causal perspective. However, current video reasoning tasks are limited in scope, primarily executed in a question-answering paradigm and focusing on short videos containing only a single event and simple causal relationships, lacking comprehensive and structured causality analysis for videos with multiple events. To fill this gap, we introduce a new task and dataset, Multi-Event Causal Discovery (MECD). It aims to uncover the causal relationships between events distributed chronologically across long videos. Given visual segments and textual descriptions of events, MECD requires identifying the causal associations between these events to derive a comprehensive, structured event-level video causal diagram explaining why and how the final result event occurred. To address MECD, we devise a novel framework inspired by the Granger Causality method, using an efficient mask-based event prediction model to perform an Event Granger Test, which estimates causality by comparing the predicted result event when premise events are masked versus unmasked. Furthermore, we integrate causal inference techniques such as front-door adjustment and counterfactual inference to address challenges in MECD like causality confounding and illusory causality. Experiments validate the effectiveness of our framework in providing causal relationships in multi-event videos, outperforming GPT-4o and VideoLLaVA by 5.7% and 4.1%, respectively.
Tieyuan Chen, Huabin Liu 0001, Tianyao He, Yihang Chen 0002, Chaofan Gan, Yang Zhang 0002, Weiyao Lin
NeurIPS3
2023 Fine-Grained Music Plagiarism Detection: Revealing Plagiarists through Bipartite Graph Matching and a Comprehensive Large-Scale Dataset
abstract
Music plagiarism detection is gaining more and more attention due to the popularity of music production and society's emphasis on intellectual property. We aim to find fine-grained plagiarism in music pairs since conventional methods are coarse-grained and cannot match real-life scenarios. Considering that there is no sizeable dataset designed for the music plagiarism task, we establish a large-scale simulated dataset, named Music Plagiarism Detection Dataset (MPD-Set) under the guidance and expertise of researchers from national-level professional institutions in the field of music. MPD-Set considers diverse music plagiarism cases found in real life from the melodic, rhythmic, and tonal levels respectively. Further, we establish a Real-life Dataset for evaluation, where all plagiarism pairs are real cases. To detect the fine-grained plagiarism pairs effectively, we propose a graph-based method called Bipatite Melody Matching Detector (BMM-Det), which formulates the problem as a max matching problem in the bipartite graph. Experimental results on both the simulated and Real-life Datasets demonstrate that BMM-Det outperforms the existing plagiarism detection methods, and is robust to common plagiarism cases like transpositions, pitch shifts, duration variance, and melody change. Datasets and source code are open-sourced at https://github.com/xuan301/BMMDet_MPDSet.
Wenxuan Liu 0004, Tianyao He, Chen Gong 0006, Ning Zhang 0040, Hua Yang 0001, Junchi Yan
ACM Multimedia2