Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Keith Stevens

dblp:33/9013 · DBLP profile ↗
← Back
2ranked-venue papers
1as first author
1since 2021 · last 2023
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 2 · 1 first-author · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
2 papers
Language models and text generation · 93% Information extraction and text analysis · 7%
Databases, data mining, and information retrieval
1 paper
Data mining · 100%

Topics — the 5 heaviest of 5, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Natural language and speech › Language models and text generation
alignment
0.712023
OpenAssistant Conversations - Democratizing Large Language Model Alignment · NeurIPS 2023
Natural language and speech › Language models and text generation › alignment › preference alignment
human feedback alignment
0.712023
OpenAssistant Conversations - Democratizing Large Language Model Alignment · NeurIPS 2023
Natural language and speech › Language models and text generation
instruction tuning
0.712023
OpenAssistant Conversations - Democratizing Large Language Model Alignment · NeurIPS 2023
Natural language and speech › Information extraction and text analysis
topic model
0.112012
Exploring Topic Coherence over Many Models and Many Topics · EMNLP-CoNLL 2012
Data mining › text mining › topic model › topic model evaluation
topic coherence
0.112012
Exploring Topic Coherence over Many Models and Many Topics · EMNLP-CoNLL 2012

Methods — techniques the papers use, named apart from their topics

supervised fine-tuning · 0.7reinforcement learning from human feedback · 0.7topic modeling · 0.3
YearPublicationVenuePosition
2023 OpenAssistant Conversations - Democratizing Large Language Model Alignment
abstract
Aligning large language models (LLMs) with human preferences has proven to drastically improve usability and has driven rapid adoption as demonstrated by ChatGPT.Alignment techniques such as supervised fine-tuning (\textit{SFT}) and reinforcement learning from human feedback (\textit{RLHF}) greatly reduce the required skill and domain knowledge to effectively harness the capabilities of LLMs, increasing their accessibility and utility across various domains.However, state-of-the-art alignment techniques like \textit{RLHF} rely on high-quality human feedback data, which is expensive to create and often remains proprietary.In an effort to democratize research on large-scale alignment, we release OpenAssistant Conversations, a human-generated, human-annotated assistant-style conversation corpus consisting of 161,443 messages in 35 different languages, annotated with 461,292 quality ratings, resulting in over 10,000 complete and fully annotated conversation trees.The corpus is a product of a worldwide crowd-sourcing effort involving over 13,500 volunteers.Models trained on OpenAssistant Conversations show consistent improvements on standard benchmarks over respective base models.We release our code\footnote{\git} and data\footnote{\data} under a fully permissive licence.
Andreas Köpf, Yannic Kilcher, Dimitri von Rütte, Sotiris Anagnostidis, Zhi Rui Tam, Keith Stevens, Abdullah Barhoum, Oliver Stanley, Richárd Nagyfi, Shahul ES, Sameer Suri, David Glushkov, Arnav Dantuluri, Andrew Maguire, Christoph Schuhmann, Huu Nguyen, Alexander Mattick
NeurIPS6
2012 Exploring Topic Coherence over Many Models and Many Topics
Keith Stevens, W. Philip Kegelmeyer, David Andrzejewski, David Buttler
EMNLP-CoNLL1