Demo Data from VLDB 2026 / reviewers in the wild / expert
Marius Guerard
dblp:300/4644
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2024
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Trustworthy machine learning · 65% Representation and self-supervised learning · 22% Language models and text generation · 13% |
Topics — the 6 heaviest of 6, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Representation and self-supervised learning › representation analysis
hidden representation analysis |
0.8 | 1 | 2024 | Who's asking? User personas and the mechanics of latent misalignment · NeurIPS 2024 |
Machine learning › Trustworthy machine learning
interpretability |
0.8 | 1 | 2024 | Who's asking? User personas and the mechanics of latent misalignment · NeurIPS 2024 |
Machine learning › Trustworthy machine learning › adversarial machine learning
jailbreak attack |
0.8 | 1 | 2024 | Who's asking? User personas and the mechanics of latent misalignment · NeurIPS 2024 |
Machine learning › Trustworthy machine learning
robustness |
0.8 | 1 | 2024 | Who's asking? User personas and the mechanics of latent misalignment · NeurIPS 2024 |
Natural language and speech › Language models and text generation › large language model safety
refusal behavior |
0.2 | 1 | 2024 | Who's asking? User personas and the mechanics of latent misalignment · NeurIPS 2024 |
Natural language and speech › Language models and text generation › large language model safety
safety fine-tuning |
0.2 | 1 | 2024 | Who's asking? User personas and the mechanics of latent misalignment · NeurIPS 2024 |
Methods — techniques the papers use, named apart from their topics
natural language prompting · 0.8activation steering · 0.8
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2024 | Who's asking? User personas and the mechanics of latent misalignmentabstractStudies show that safety-tuned models may nevertheless divulge harmful information. In this work, we show that whether they do so depends significantly on who they are talking to, which we refer to as *user persona*. In fact, we find manipulating user persona to be more effective for eliciting harmful content than certain more direct attempts to control model refusal. We study both natural language prompting and activation steering as intervention methods and show that activation steering is significantly more effective at bypassing safety filters.
We shed light on the mechanics of this phenomenon by showing that even when model generations are safe, harmful content can persist in hidden representations and can be extracted by decoding from earlier layers. We also show we can predict a persona’s effect on refusal given only the geometry of its steering vector. Finally, we show that certain user personas induce the model to form more charitable interpretations of otherwise dangerous queries. Asma Ghandeharioun, Ann Yuan, Marius Guerard, Emily Reif, Michael A. Lepori, Lucas Dixon |
NeurIPS | 3 |