Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Yuchen Ren 0005

dblp:252/7814-5 · DBLP profile ↗
← Back
2ranked-venue papers
0as first author
2since 2021 · last 2024
0009-0003-3301-6113ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
2 papers
Trustworthy machine learning · 69% Vision and language · 24% Graph learning · 7%
Network and information security
1 paper
Security and privacy of machine learning · 100%

Topics — the 9 heaviest of 9, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Trustworthy machine learning › interpretability
causal explanation
0.812024
See or Guess: Counterfactually Regularized Image Captioning · ACM Multimedia 2024
Computer vision › Vision and language
image captioning
0.812024
See or Guess: Counterfactually Regularized Image Captioning · ACM Multimedia 2024
Machine learning › Trustworthy machine learning
interpretability
0.812024
See or Guess: Counterfactually Regularized Image Captioning · ACM Multimedia 2024
Security and privacy of machine learning › adversarial attack
graph adversarial attack
0.812024
Intruding with Words: Towards Understanding Graph Injection Attacks at the Text Level · NeurIPS 2024
Security and privacy of machine learning › graph neural network security
graph injection attack
0.812024
Intruding with Words: Towards Understanding Graph Injection Attacks at the Text Level · NeurIPS 2024
Machine learning › Trustworthy machine learning › robustness
adversarial robustness
0.212024
Intruding with Words: Towards Understanding Graph Injection Attacks at the Text Level · NeurIPS 2024
Machine learning › Graph learning
graph neural network
0.212024
Intruding with Words: Towards Understanding Graph Injection Attacks at the Text Level · NeurIPS 2024
Machine learning › Trustworthy machine learning › adversarial machine learning
graph neural network robustness
0.212024
Intruding with Words: Towards Understanding Graph Injection Attacks at the Text Level · NeurIPS 2024
Machine learning › Trustworthy machine learning
robustness
0.212024
Intruding with Words: Towards Understanding Graph Injection Attacks at the Text Level · NeurIPS 2024

Methods — techniques the papers use, named apart from their topics

large language model · 1.5graph neural network · 1.5counterfactual regularization · 0.8causal inference · 0.8
YearPublicationVenuePosition
2024 See or Guess: Counterfactually Regularized Image Captioning
abstract
Image captioning, which generates natural language descriptions of images, is a crucial task in vision-language research. Previous models have typically addressed this task by aligning the generative capabilities of machines with humans through statistical fitting existing datasets. While effective for normal images, they may struggle to accurately describe those where certain parts of the image are obscured or edited, unlike humans who excel in such cases. These weaknesses, including hallucinations and limited interpretability, often hinder performance in scenarios with shifted association patterns. In this paper, we present a generic image captioning framework that employs causal inference to make existing models more capable of interventional tasks, and counterfactually explainable. Our approach includes two variants leveraging either total effect or natural direct effect. Integrating them into the training process enables models to handle counterfactual scenarios, increasing their generalizability. Extensive experiments on various datasets show that our method effectively reduces hallucinations and improves the model's faithfulness to images, demonstrating high portability across both small-scale and large-scale image-to-text models. The code is available at https://github.com/Aman-4-Real/See-or-Guess.
Qian Cao 0001, Xu Chen 0017, Ruihua Song, Xiting Wang, Xinting Huang, Yuchen Ren 0005
ACM Multimedia6
2024 Intruding with Words: Towards Understanding Graph Injection Attacks at the Text Level
abstract
Graph Neural Networks (GNNs) excel across various applications but remain vulnerable to adversarial attacks, particularly Graph Injection Attacks (GIAs), which inject malicious nodes into the original graph and pose realistic threats. Text-attributed graphs (TAGs), where nodes are associated with textual features, are crucial due to their prevalence in real-world applications and are commonly used to evaluate these vulnerabilities. However, existing research only focuses on embedding-level GIAs, which inject node embeddings rather than actual textual content, limiting their applicability and simplifying detection. In this paper, we pioneer the exploration of GIAs at the text level, presenting three novel attack designs that inject textual content into the graph. Through theoretical and empirical analysis, we demonstrate that text interpretability, a factor previously overlooked at the embedding level, plays a crucial role in attack strength. Among the designs we investigate, the Word-frequency-based Text-level GIA (WTGIA) is particularly notable for its balance between performance and interpretability. Despite the success of WTGIA, we discover that defenders can easily enhance their defenses with customized text embedding methods or large language model (LLM)--based predictors. These insights underscore the necessity for further research into the potential and practical significance of text-level GIAs.
Runlin Lei, Yuchen Ren 0005, Zhewei Wei
NeurIPS3