Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Shengtao Lou

dblp:359/4243 · DBLP profile ↗
← Back
2ranked-venue papers
1as first author
2since 2021 · last 2024
0009-0008-2043-5526ORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 first-author · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
2 papers
Segmentation and scene understanding · 44% Trustworthy machine learning · 25% Video understanding and tracking · 19%
Computer graphics and multimedia
1 paper
Visual content generation and editing · 100%

Topics — the 9 heaviest of 9, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Computer vision › Segmentation and scene understanding › image segmentation › binary segmentation
dichotomous image segmentation
0.812024
MaskFactory: Towards High-quality Synthetic Data Generation for Dichotomous Image Segmentation · NeurIPS 2024
Computer vision › Segmentation and scene understanding
image segmentation
0.812024
MaskFactory: Towards High-quality Synthetic Data Generation for Dichotomous Image Segmentation · NeurIPS 2024
Visual content generation and editing
image generation
0.812024
MaskFactory: Towards High-quality Synthetic Data Generation for Dichotomous Image Segmentation · NeurIPS 2024
Visual content generation and editing
synthetic data generation
0.812024
MaskFactory: Towards High-quality Synthetic Data Generation for Dichotomous Image Segmentation · NeurIPS 2024
Machine learning › Trustworthy machine learning › robustness
adversarial attack
0.712023
Follow-me: Deceiving Trackers with Fabricated Paths · ACM Multimedia 2023
Computer vision › Video understanding and tracking
object tracking
0.712023
Follow-me: Deceiving Trackers with Fabricated Paths · ACM Multimedia 2023
Machine learning › Generative modeling › image generation
conditional image generation
0.212024
MaskFactory: Towards High-quality Synthetic Data Generation for Dichotomous Image Segmentation · NeurIPS 2024
Machine learning › Generative modeling
diffusion model
0.212024
MaskFactory: Towards High-quality Synthetic Data Generation for Dichotomous Image Segmentation · NeurIPS 2024
Machine learning › Trustworthy machine learning
robustness
0.212023
Follow-me: Deceiving Trackers with Fabricated Paths · ACM Multimedia 2023

Methods — techniques the papers use, named apart from their topics

self-attention · 1.5diffusion model · 1.5adversarial training · 1.5white-box attack · 0.7loss function design · 0.7heatmap anchor · 0.7
YearPublicationVenuePosition
2024 MaskFactory: Towards High-quality Synthetic Data Generation for Dichotomous Image Segmentation
abstract
Dichotomous Image Segmentation (DIS) tasks require highly precise annotations, and traditional dataset creation methods are labor intensive, costly, and require extensive domain expertise. Although using synthetic data for DIS is a promising solution to these challenges, current generative models and techniques struggle with the issues of scene deviations, noise-induced errors, and limited training sample variability. To address these issues, we introduce a novel approach, Mask Factory, which provides a scalable solution for generating diverse and precise datasets, markedly reducing preparation time and costs. We first introduce a general mask editing method that combines rigid and non-rigid editing techniques to generate high-quality synthetic masks. Specially, rigid editing leverages geometric priors from diffusion models to achieve precise viewpoint transformations under zero-shot conditions, while non-rigid editing employs adversarial training and self-attention mechanisms for complex, topologically consistent modifications. Then, we generate pairs of high-resolution image and accurate segmentation mask using a multi-conditional control generation method. Finally, our experiments on the widely-used DIS5K dataset benchmark demonstrate superior performance in quality and efficiency compared to existing methods. The code is available at https://qian-hao-tian.github.io/MaskFactory/.
Haotian Qian, Yinda Chen, Shengtao Lou, Fahad Shahbaz Khan, Xiaogang Jin 0001, Deng-Ping Fan
NeurIPS3
2023 Follow-me: Deceiving Trackers with Fabricated Paths
abstract
Convolutional Neural Networks (CNNs) are vulnerable to adversarial attacks in which visually imperceptible perturbations can deceive CNN-based models. While current research on adversarial attacks in single object tracking exists, it overlooks a critical aspect of manipulating predicted trajectories to follow user-defined paths regardless of the actual location of the targeted object. To address this, we propose the very first white-box attack algorithm that is capable of deceiving victim trackers by compelling them to generate trajectories that adhere to predetermined counterfeit paths. Specifically, we focus on Siamese-based trackers as our victim models. Given an arbitrary counterfeit path, we first decompose it into discrete target locations in each frame, with the assumption of constant velocity. These locations are converted to heatmap anchors, which represent the offset of their location from the target object's location in the previous frame. Later on, we design a novel loss function to minimize the gap between above-mentioned anchors and our predicted ones. Finally, the gradients computed by such loss are used to update the original video, resulting in our adversarial video. To validate our ideas, we design three sets of counterfeit paths as well as novel evaluation metrics to measure the path-following properties. Experiments with two victim models on three publicly available datasets, OTB100, VOT2018, and VOT2016, demonstrate that our algorithm not only outperforms SOTA methods significantly under conventional evaluation metrics, e.g. 90% and 68.4% precision and successful rate drop on OTB100, but also follows the counterfeit paths well, which is beyond any existing attack methods. The source code is available at https://github.com/loushengtao/Follow-me.
Shengtao Lou, Buyu Liu, Jun Bao, Jiajun Ding, Jun Yu 0002
ACM Multimedia1