Demo Data from EDBT 2026 / reviewers in the wild / expert
Jonas Rohweder
dblp:420/1023
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2026
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Trustworthy machine learning · 50% Probabilistic and Bayesian machine learning · 50% |
Topics — the 2 heaviest of 2, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Trustworthy machine learning › interpretability
mechanistic interpretability |
1.0 | 1 | 2026 | Patches of Nonlinearity: Instruction Vectors in Large Language Models · ACL (1) 2026 |
Machine learning › Probabilistic and Bayesian machine learning › causal inference › causal effect estimation
mediation analysis |
1.0 | 1 | 2026 | Patches of Nonlinearity: Instruction Vectors in Large Language Models · ACL (1) 2026 |
Methods — techniques the papers use, named apart from their topics
causal mediation · 1.0activation patching · 1.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Patches of Nonlinearity: Instruction Vectors in Large Language ModelsabstractDespite the recent success of instruction-tuned language models and their ubiquitous usage, very little is known of how models process instructions internally. In this work, we address this gap from a mechanistic point of view by investigating how instruction-specific representations are constructed and utilized in different stages of post-training: Supervised Fine-Tuning (SFT) and Direct Preference Optimization (DPO). Via causal mediation, we identify that instruction representation is fairly localized in models. These representations, which we call Instruction Vectors (IVs), demonstrate a curious juxtaposition of linear separability along with non-linear causal interaction, broadly questioning the scope of the linear representation hypothesis commonplace in mechanistic interpretability. To disentangle the non-linear causal interaction, we propose a novel method to localize information processing in language models that is free from the implicit linear assumptions of patching-based techniques. We find that, conditioned on the task representations formed in the early layers, different information pathways are selected in the later layers to solve that task, i.e., IVs act as circuit selectors. Irina Bigoulaeva, Jonas Rohweder, Subhabrata Dutta, Iryna Gurevych |
ACL (1) | 2 |