Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data.

Ye Sun 0004

dblp:29/795-4 · DBLP profile ↗
← Back
3ranked-venue papers
2as first author
3since 2021 · last 2025
0009-0009-8607-7845ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 2 · 2 first-author · 2 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
2 papers
Vision and language · 62% Question answering and dialogue systems · 20% Segmentation and scene understanding · 18%
Network and information security
2 papers
Security and privacy of machine learning · 65% Privacy and data protection · 35%

Topics — the 6 heaviest of 7, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Security and privacy of machine learning › poisoning attack
unlearnable examples
1.622025
T2UE: Generating Unlearnable Examples from Text Descriptions · ACM Multimedia 2025
UnSeg: One Universal Unlearnable Example Generator is Enough against All Image Segmentation · NeurIPS 2024
Computer vision › Vision and language › video grounding
spatio-temporal video grounding
0.912025
SAMA: Towards Multi-Turn Referential Grounded Video Chat with Large Language Models · NeurIPS 2025
Computer vision › Vision and language
video grounding
0.912025
SAMA: Towards Multi-Turn Referential Grounded Video Chat with Large Language Models · NeurIPS 2025
Computer vision › Vision and language › vision-language model › multimodal large language model
video multimodal large language model
0.912025
SAMA: Towards Multi-Turn Referential Grounded Video Chat with Large Language Models · NeurIPS 2025
Privacy and data protection › privacy-preserving machine learning
data protection against unauthorized training
0.912025
T2UE: Generating Unlearnable Examples from Text Descriptions · ACM Multimedia 2025
Computer vision › Segmentation and scene understanding
image segmentation
0.812024
UnSeg: One Universal Unlearnable Example Generator is Enough against All Image Segmentation · NeurIPS 2024

Methods — techniques the papers use, named apart from their topics

segment anything model · 2.4unlearnable noise generator · 1.5bi-level optimization · 1.5text-to-image model · 0.9spatio-temporal context aggregator · 0.9error minimization · 0.9
YearPublicationVenuePosition
2025 T2UE: Generating Unlearnable Examples from Text Descriptions
abstract
Large-scale pre-training frameworks like CLIP have revolutionized multimodal learning, but their reliance on web-scraped datasets, frequently containing private user data, raises serious concerns about misuse. Unlearnable Examples (UEs) have emerged as a promising countermeasure against unauthorized model training, employing carefully crafted unlearnable noise to disrupt the learning of meaningful representations from protected data. Current approaches typically generate UEs by jointly optimizing unlearnable noise for both images and their associated text descriptions (or labels). However, this optimization process is often computationally prohibitive for on-device execution, forcing reliance on external third-party services. This creates a fundamental privacy paradox: users must initially expose their data to these very services to achieve protection, thereby compromising privacy in the process. Such a contradiction has severely hindered the development of practical, scalable data protection solutions. To resolve this paradox, we introduce Text-to-Unlearnable Example (T2UE), a novel framework that enables users to generate UEs using only text descriptions. T2UE circumvents the need for original image data by employing a text-to-image (T2I) model to map text descriptions into the image (noise) space, combined with an error-minimization framework to produce effective unlearnable noise. Extensive experiments show that T2UE-protected data substantially degrades performance in downstream tasks (e.g., cross-modal retrieval) for state-of-the-art models. Notably, the protective effect generalizes across diverse architectures and even to supervised learning settings. Our work demonstrates the feasibility of ''zero-contact data protection'', where personal data can be safeguarded based solely on their textual descriptions, eliminating the need for direct data exposure.
Xingjun Ma, Hanxun Huang, Tianwei Song, Ye Sun 0004, Yifeng Gao 0002, Yu-Gang Jiang 0001
ACM Multimedia4
2025 SAMA: Towards Multi-Turn Referential Grounded Video Chat with Large Language Models
abstract
Achieving fine-grained spatio-temporal understanding in videos remains a major challenge for current Video Large Multimodal Models (Video LMMs). Addressing this challenge requires mastering two core capabilities: video referring understanding, which captures the semantics of video regions, and video grounding, which segments object regions based on natural language descriptions. However, most existing approaches tackle these tasks in isolation, limiting progress toward unified, referentially grounded video interaction. We identify a key bottleneck in the lack of high-quality, unified video instruction data and a comprehensive benchmark for evaluating referentially grounded video chat. To address these challenges, we contribute in three core aspects: dataset, model, and benchmark. First, we introduce SAMA-239K, a large-scale dataset comprising 15K videos specifically curated to enable joint learning of video referring understanding, grounding, and multi-turn video chat. Second, we propose the SAMA model, which incorporates a versatile spatio-temporal context aggregator and a Segment Anything Model to jointly enhance fine-grained video comprehension and precise grounding capabilities. Finally, we establish SAMA-Bench, a meticulously designed benchmark consisting of 5,067 questions from 522 videos, to comprehensively evaluate the integrated capabilities of Video LMMs in multi-turn, spatio-temporal referring understanding and grounded dialogue. Extensive experiments and benchmarking results show that SAMA not only achieves strong performance on SAMA-Bench but also sets a new state-of-the-art on general grounding benchmarks, while maintaining highly competitive performance on standard visual understanding benchmarks.
Ye Sun 0004, Hao Zhang 0047, Henghui Ding, Tiehua Zhang, Xingjun Ma, Yu-Gang Jiang 0001
NeurIPS1
2024 UnSeg: One Universal Unlearnable Example Generator is Enough against All Image Segmentation
abstract
Image segmentation is a crucial vision task that groups pixels within an image into semantically meaningful segments, which is pivotal in obtaining a fine-grained understanding of real-world scenes. However, an increasing privacy concern exists regarding training large-scale image segmentation models on unauthorized private data. In this work, we exploit the concept of unlearnable examples to make images unusable to model training by generating and adding unlearnable noise into the original images. Particularly, we propose a novel Unlearnable Segmentation (UnSeg) framework to train a universal unlearnable noise generator that is capable of transforming any downstream images into their unlearnable version. The unlearnable noise generator is finetuned from the Segment Anything Model (SAM) via bilevel optimization on an interactive segmentation dataset towards minimizing the training error of a surrogate model that shares the same architecture with SAM (but trains from scratch). We empirically verify the effectiveness of UnSeg across 6 mainstream image segmentation tasks, 10 widely used datasets, and 7 different network architectures, and show that the unlearnable images can reduce the segmentation performance by a large margin. Our work provides useful insights into how to leverage foundation models in a data-efficient and computationally affordable manner to protect images against image segmentation models.
Ye Sun 0004, Hao Zhang 0047, Tiehua Zhang, Xingjun Ma, Yu-Gang Jiang 0001
NeurIPS1