Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Yijie Yu 0001

dblp:138/0399-1 · DBLP profile ↗
← Back
3ranked-venue papers
0as first author
3since 2021 · last 2024
0009-0001-5615-213XORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 2 · 2 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 2 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
3 papers
Generative modeling · 57% Video understanding and tracking · 19% Language models and text generation · 19%
Computer graphics and multimedia
2 papers
Image and video processing · 100%
Interdisciplinary, comprehensive, and emerging computing
1 paper
Bioinformatics and computational biology · 100%

Topics — the 9 heaviest of 11, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Generative modeling
diffusion model
1.522024
Motion-aware Latent Diffusion Models for Video Frame Interpolation · ACM Multimedia 2024
Interaction-based Retrieval-augmented Diffusion Models for Protein-specific 3D Molecule Generation · ICML 2024
Machine learning › Generative modeling › diffusion model › video diffusion model
latent video diffusion model
0.812024
Motion-aware Latent Diffusion Models for Video Frame Interpolation · ACM Multimedia 2024
Natural language and speech › Language models and text generation
retrieval-augmented generation
0.812024
Interaction-based Retrieval-augmented Diffusion Models for Protein-specific 3D Molecule Generation · ICML 2024
Bioinformatics and computational biology › molecular informatics › cheminformatics
molecule generation
0.812024
Interaction-based Retrieval-augmented Diffusion Models for Protein-specific 3D Molecule Generation · ICML 2024
Bioinformatics and computational biology › drug discovery › drug design
structure-based drug design
0.812024
Interaction-based Retrieval-augmented Diffusion Models for Protein-specific 3D Molecule Generation · ICML 2024
Image and video processing › video frame interpolation
diffusion-based video frame interpolation
0.812024
Motion-aware Latent Diffusion Models for Video Frame Interpolation · ACM Multimedia 2024
Image and video processing › super-resolution
event-based super-resolution
0.812024
Bilateral Event Mining and Complementary for Event Stream Super-Resolution · CVPR 2024
Image and video processing
video frame interpolation
0.812024
Motion-aware Latent Diffusion Models for Video Frame Interpolation · ACM Multimedia 2024
Computer vision › Image recognition and object detection › object recognition
event-based object recognition
0.212024
Bilateral Event Mining and Complementary for Event Stream Super-Resolution · CVPR 2024

Methods — techniques the papers use, named apart from their topics

two-stream network · 1.5retrieval augmentation · 1.5protein-molecule interaction network · 1.5motion-aware latent diffusion · 1.5motion prior incorporation · 1.5bilateral information exchange · 1.5self-augmentation · 0.8self augmentation · 0.8
YearPublicationVenuePosition
2024 Bilateral Event Mining and Complementary for Event Stream Super-Resolution
abstract
Event Stream Super-Resolution (ESR) aims to address the challenge of insufficient spatial resolution in event streams, which holds great significance for the application of event cameras in complex scenarios. Previous works for ESR often process positive and negative events in a mixed paradigm. This paradigm limits their ability to effectively model the unique characteristics of each event and mutually refine each other by considering their correlations. In this paper, we propose a bilateral event mining and complementary network (BMCNet) to fully leverage the potential of each event and capture the shared information to complement each other simultaneously. Specifically, we resort to a two-stream network to accomplish comprehensive mining of each type of events individually. To facilitate the exchange of information between two streams, we propose a bilateral information exchange (BIE) module. This module is layer-wisely embedded between two streams, enabling the effective propagation of hierarchical global information while alleviating the impact of invalid information brought by inherent characteristics of events. The experimental results demonstrate that our approach outperforms the previous state-of-the-art methods in ESR, achieving performance improvements of over 11% on both real and synthetic datasets. Moreover, our method significantly enhances the performance of event-based downstream tasks such as object recognition and video reconstruction. Our code is available at https://github.com/Lqm26/BMCNet-ESR.
Zhilin Huang, Quanmin Liang, Yijie Yu 0001, Chujun Qin, Xiawu Zheng, Kai Huang 0001, Zikun Zhou, Wenming Yang
CVPR3
2024 Interaction-based Retrieval-augmented Diffusion Models for Protein-specific 3D Molecule Generation
abstract
Generating ligand molecules that bind to specific protein targets via generative models holds substantial promise for advancing structure-based drug design. Existing methods generate molecules from scratch without reference or template ligands, which poses challenges in model optimization and may yield suboptimal outcomes. To address this problem, we propose an innovative interaction-based retrieval-augmented diffusion model named IRDiff to facilitate target-aware molecule generation. IRDiff leverages a curated set of ligand references, i.e., those with desired properties such as high binding affinity, to steer the diffusion model towards synthesizing ligands that satisfy design criteria. Specifically, we utilize a protein-molecule interaction network (PMINet), which is pretrained with binding affinity signals to: (i) retrieve target-aware ligand molecules with high binding affinity to serve as references, and (ii) incorporate essential protein-ligand binding structures for steering molecular diffusion generation with two effective augmentation mechanisms, i.e., retrieval augmentation and self augmentation. Empirical studies on CrossDocked2020 dataset show IRDiff can generate molecules with more realistic 3D structures and achieve state-of-the-art binding affinities towards the protein targets, while maintaining proper molecular properties. The codes and models are available at https://github.com/YangLing0818/IRDiff
Zhilin Huang, Ling Yang 0006, Xiangxin Zhou, Chujun Qin, Yijie Yu 0001, Xiawu Zheng, Zikun Zhou, Wentao Zhang 0001, Yu Wang 0008, Wenming Yang
ICML5
2024 Motion-aware Latent Diffusion Models for Video Frame Interpolation
abstract
With the advancement of AIGC, video frame interpolation (VFI) has become a crucial component in existing video generation frameworks, attracting widespread research interest. For the VFI task, the motion estimation between neighboring frames plays a crucial role in avoiding motion ambiguity. However, existing VFI methods always struggle to accurately predict the motion information between consecutive frames, and this imprecise estimation leads to blurred and visually incoherent interpolated frames. In this paper, we propose a novel diffusion framework, Motion-Aware latent Diffusion models (MADiff), which is specifically designed for the VFI task. By incorporating motion priors between the conditional neighboring frames with the target interpolated frame predicted throughout the diffusion sampling procedure, MADiff progressively refines the intermediate outcomes, culminating in generating both visually smooth and realistic results. Extensive experiments conducted on benchmark datasets demonstrate that our method achieves state-of-the-art performance significantly outperforming existing approaches, especially under challenging scenarios involving dynamic textures with complex motion.
Zhilin Huang, Yijie Yu 0001, Ling Yang 0006, Chujun Qin, Xiawu Zheng, Zikun Zhou, Yaowei Wang 0001, Wenming Yang
ACM Multimedia2