Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Marius Guerard

dblp:300/4644 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2024
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Trustworthy machine learning · 65% Representation and self-supervised learning · 22% Language models and text generation · 13%

Topics — the 6 heaviest of 6, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Representation and self-supervised learning › representation analysis
hidden representation analysis
0.812024
Who's asking? User personas and the mechanics of latent misalignment · NeurIPS 2024
Machine learning › Trustworthy machine learning
interpretability
0.812024
Who's asking? User personas and the mechanics of latent misalignment · NeurIPS 2024
Machine learning › Trustworthy machine learning › adversarial machine learning
jailbreak attack
0.812024
Who's asking? User personas and the mechanics of latent misalignment · NeurIPS 2024
Machine learning › Trustworthy machine learning
robustness
0.812024
Who's asking? User personas and the mechanics of latent misalignment · NeurIPS 2024
Natural language and speech › Language models and text generation › large language model safety
refusal behavior
0.212024
Who's asking? User personas and the mechanics of latent misalignment · NeurIPS 2024
Natural language and speech › Language models and text generation › large language model safety
safety fine-tuning
0.212024
Who's asking? User personas and the mechanics of latent misalignment · NeurIPS 2024

Methods — techniques the papers use, named apart from their topics

natural language prompting · 0.8activation steering · 0.8
YearPublicationVenuePosition
2024 Who's asking? User personas and the mechanics of latent misalignment
abstract
Studies show that safety-tuned models may nevertheless divulge harmful information. In this work, we show that whether they do so depends significantly on who they are talking to, which we refer to as *user persona*. In fact, we find manipulating user persona to be more effective for eliciting harmful content than certain more direct attempts to control model refusal. We study both natural language prompting and activation steering as intervention methods and show that activation steering is significantly more effective at bypassing safety filters. We shed light on the mechanics of this phenomenon by showing that even when model generations are safe, harmful content can persist in hidden representations and can be extracted by decoding from earlier layers. We also show we can predict a persona’s effect on refusal given only the geometry of its steering vector. Finally, we show that certain user personas induce the model to form more charitable interpretations of otherwise dangerous queries.
Asma Ghandeharioun, Ann Yuan, Marius Guerard, Emily Reif, Michael A. Lepori, Lucas Dixon
NeurIPS3