Demo Data from EDBT 2026 / reviewers in the wild / expert
Keith Stevens
dblp:33/9013
· DBLP profile ↗
2ranked-venue papers
1as first author
1since 2021 · last 2023
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 2 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
2 papers |
Language models and text generation · 93% Information extraction and text analysis · 7% | |
| Databases, data mining, and information retrieval
1 paper |
Data mining · 100% |
Topics — the 5 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation
alignment |
0.7 | 1 | 2023 | OpenAssistant Conversations - Democratizing Large Language Model Alignment · NeurIPS 2023 |
Natural language and speech › Language models and text generation › alignment › preference alignment
human feedback alignment |
0.7 | 1 | 2023 | OpenAssistant Conversations - Democratizing Large Language Model Alignment · NeurIPS 2023 |
Natural language and speech › Language models and text generation
instruction tuning |
0.7 | 1 | 2023 | OpenAssistant Conversations - Democratizing Large Language Model Alignment · NeurIPS 2023 |
Natural language and speech › Information extraction and text analysis
topic model |
0.1 | 1 | 2012 | Exploring Topic Coherence over Many Models and Many Topics · EMNLP-CoNLL 2012 |
Data mining › text mining › topic model › topic model evaluation
topic coherence |
0.1 | 1 | 2012 | Exploring Topic Coherence over Many Models and Many Topics · EMNLP-CoNLL 2012 |
Methods — techniques the papers use, named apart from their topics
supervised fine-tuning · 0.7reinforcement learning from human feedback · 0.7topic modeling · 0.3
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2023 | OpenAssistant Conversations - Democratizing Large Language Model AlignmentabstractAligning large language models (LLMs) with human preferences has proven to drastically improve usability and has driven rapid adoption as demonstrated by ChatGPT.Alignment techniques such as supervised fine-tuning (\textit{SFT}) and reinforcement learning from human feedback (\textit{RLHF}) greatly reduce the required skill and domain knowledge to effectively harness the capabilities of LLMs, increasing their accessibility and utility across various domains.However, state-of-the-art alignment techniques like \textit{RLHF} rely on high-quality human feedback data, which is expensive to create and often remains proprietary.In an effort to democratize research on large-scale alignment, we release OpenAssistant Conversations, a human-generated, human-annotated assistant-style conversation corpus consisting of 161,443 messages in 35 different languages, annotated with 461,292 quality ratings, resulting in over 10,000 complete and fully annotated conversation trees.The corpus is a product of a worldwide crowd-sourcing effort involving over 13,500 volunteers.Models trained on OpenAssistant Conversations show consistent improvements on standard benchmarks over respective base models.We release our code\footnote{\git} and data\footnote{\data} under a fully permissive licence. Andreas Köpf, Yannic Kilcher, Dimitri von Rütte, Sotiris Anagnostidis, Zhi Rui Tam, Keith Stevens, Abdullah Barhoum, Oliver Stanley, Richárd Nagyfi, Shahul ES, Sameer Suri, David Glushkov, Arnav Dantuluri, Andrew Maguire, Christoph Schuhmann, Huu Nguyen, Alexander Mattick |
NeurIPS | 6 |
| 2012 | Exploring Topic Coherence over Many Models and Many Topics
Keith Stevens, W. Philip Kegelmeyer, David Andrzejewski, David Buttler |
EMNLP-CoNLL | 1 |