Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Rob Voigt

dblp:148/9246 · DBLP profile ↗
← Back
7ranked-venue papers
2as first author
5since 2021 · last 2025
0000-0003-3743-0322ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 7 · 2 first-author · 5 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 1 first-author · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
4 papers
Information extraction and text analysis · 31% Trustworthy machine learning · 26% Language models and text generation · 23%
Interdisciplinary, comprehensive, and emerging computing
3 papers
Computational social science and digital humanities · 88% Computing education · 12%

Topics — the 11 heaviest of 12, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Natural language and speech › Language models and text generation › large language model
reasoning model
0.912025
Thinking Out Loud: Do Reasoning Models Know When They're Right? · EMNLP 2025
Machine learning › Trustworthy machine learning
uncertainty and calibration
0.912025
Thinking Out Loud: Do Reasoning Models Know When They're Right? · EMNLP 2025
Machine learning › Trustworthy machine learning › uncertainty estimation
verbalized confidence
0.912025
Thinking Out Loud: Do Reasoning Models Know When They're Right? · EMNLP 2025
Computational social science and digital humanities
scientometrics
0.912025
Good Intentions Beyond ACL: Who Does NLP for Social Good, and Where? · EMNLP 2025
Natural language and speech › Information extraction and text analysis › distributional semantics
semantic axes
0.812024
Adaptive Axes: A Pipeline for In-domain Social Stereotype Analysis · EMNLP 2024
Machine learning › Transfer learning and domain adaptation
cross-lingual transfer
0.712023
GreenPLM: Cross-Lingual Transfer of Monolingual Pre-Trained Language Models at Almost No Cost · IJCAI 2023
Natural language and speech › Information extraction and text analysis
dialogue analysis
0.712023
Language of Bargaining · ACL (1) 2023
Machine learning › Efficient and distributed learning › energy-efficient learning
energy-efficient training
0.712023
GreenPLM: Cross-Lingual Transfer of Monolingual Pre-Trained Language Models at Almost No Cost · IJCAI 2023
Natural language and speech › Language models and text generation
pre-trained language model
0.712023
GreenPLM: Cross-Lingual Transfer of Monolingual Pre-Trained Language Models at Almost No Cost · IJCAI 2023
Natural language and speech › Information extraction and text analysis › dialogue analysis
speech act recognition
0.712023
Language of Bargaining · ACL (1) 2023
Computing education
research community analysis
0.312025
Good Intentions Beyond ACL: Who Does NLP for Social Good, and Where? · EMNLP 2025

Methods — techniques the papers use, named apart from their topics

text embedding models · 1.5large language model · 1.5prediction task · 1.3annotation study · 1.3supervised fine-tuning · 0.9reinforcement learning · 0.9bibliometric analysis · 0.9continued pretraining · 0.7bilingual lexicon translation · 0.7
YearPublicationVenuePosition
2025 Good Intentions Beyond ACL: Who Does NLP for Social Good, and Where?
abstract
The social impact of Natural Language Processing (NLP) is increasingly important, with a rising community focus on initiatives related to NLP for Social Good (NLP4SG).Indeed, in recent years, almost 20% of all papers in the ACL Anthology address topics related to social good as defined by the UN Sustainable Development Goals (Adauto et al., 2023).In this study, we take an author-and venue-level perspective to map the landscape of NLP4SG, quantifying the proportion of work addressing social good concerns both within and beyond the ACL community, by both core ACL contributors and non-ACL authors.With this approach we discover two surprising facts about the landscape of NLP4SG.First, ACL authors are dramatically more likely to do work addressing social good concerns when publishing in venues outside of ACL.Second, the vast majority of publications using NLP techniques to address concerns of social good are done by non-ACL authors in venues outside of ACL.We discuss the implications of these findings on agendasetting considerations for the ACL community related to NLP4SG.
Grace LeFevre, Qingcheng Zeng, Adam Leif, Jason Jewell, Denis Peskoff, Rob Voigt
EMNLP6
2025 Thinking Out Loud: Do Reasoning Models Know When They're Right?
abstract
Large reasoning models (LRMs) have recently demonstrated impressive capabilities in complex reasoning tasks by leveraging increased test-time computation and exhibiting behaviors reminiscent of human-like self-reflection.While LRMs show a clear capacity for valuable self-reflection, how this ability interacts with other model behaviors remains underexplored.We investigate this connection by analyzing verbalized confidence, how models articulate their certainty, as a lens into the nature of self-reflection in LRMs.We find that supervised fine-tuning on reasoning traces (i.e., distillation) and reinforcement learning can improve verbalized calibration in reasoningintensive settings in a progressive, laddered fashion.However, our results also indicate that reasoning models may possess a diminished awareness of their own knowledge boundaries, as evidenced by significantly lower "I don't know" response rates on factuality benchmarks.Moreover, we examine the relationship between verbalized confidence and reasoning chains, finding that models tend to express higher confidence when providing shorter or less elaborate reasoning.Our findings highlight how reasoning-oriented training can enhance performance in reasoning-centric tasks while potentially incurring a reasoning tax, a cost reflected in the model's reduced ability to accurately recognize the limits of its own knowledge in small-scale models.More broadly, our work showcases how this erosion of knowledge boundaries can compromise model faithfulness, as models grow more confident without a commensurate understanding of when they should abstain.
Qingcheng Zeng, Weihao Xuan, Leyang Cui, Rob Voigt
EMNLP4
2024 Adaptive Axes: A Pipeline for In-domain Social Stereotype Analysis
abstract
Prior work has explored the possibility of using the semantic information obtained from embedding representations to quantify social stereotypes, leveraging techniques such as word embeddings combined with a list of traits (Garg et al., 2018;Charlesworth et al., 2022) or semantic axes (An et al., 2018;Lucy et al., 2022).However, these approaches have struggled to fully capture the variability in stereotypes across different conceptual domains for the same social group (e.g., black in science, health, and art), in part because the identity of a word and the associations formed during pretraining can dominate its contextual representation (Field and Tsvetkov, 2019).This study explores the ability to recover stereotypes from the contexts surrounding targeted entities by utilizing state-of-the-art text embedding models and adaptive semantic axes enhanced by large language models (LLMs).Our results indicate that the proposed pipeline not only surpasses token-based methods in capturing in-domain framing but also effectively tracks stereotypes over time and along domain-specific semantic axes for in-domain texts.Our research highlights the potential of employing text embedding models to achieve a deeper understanding of nuanced social stereotypes.
Qingcheng Zeng, Mingyu Jin, Rob Voigt
EMNLP3
2023 Language of Bargaining
abstract
Leveraging an established exercise in negotiation education, we build a novel dataset for studying how the use of language shapes bilateral bargaining.Our dataset extends existing work in two ways: 1) we recruit participants via behavioral labs instead of crowdsourcing platforms and allow participants to negotiate through audio, enabling more naturalistic interactions; 2) we add a control setting where participants negotiate only through alternating, written numeric offers.Despite the two contrasting forms of communication, we find that the average agreed prices of the two treatments are identical.But when subjects can talk, fewer offers are exchanged, negotiations finish faster, the likelihood of reaching agreement rises, and the variance of prices at which subjects agree drops substantially.We further propose a taxonomy of speech acts in negotiation and enrich the dataset with annotated speech acts.We set up prediction tasks to predict negotiation success and find that being reactive to the arguments of the other party is advantageous over driving the negotiation.
Mourad Heddaya, Solomon Dworkin, Chenhao Tan, Rob Voigt, Alexander Zentefis
ACL (1)4
2023 GreenPLM: Cross-Lingual Transfer of Monolingual Pre-Trained Language Models at Almost No Cost
abstract
Large pre-trained models have revolutionized natural language processing (NLP) research and applications, but high training costs and limited data resources have prevented their benefits from being shared equally amongst speakers of all the world's languages. To address issues of cross-linguistic access to such models and reduce energy consumption for sustainability during large-scale model training, this study proposes an effective and energy-efficient framework called GreenPLM that uses bilingual lexicons to directly ``translate'' pre-trained language models of one language into another at almost no additional cost. We validate this approach in 18 languages' BERT models and show that this framework is comparable to, if not better than, other heuristics with high training costs. In addition, given lightweight continued pre-training on limited data where available, this framework outperforms the original monolingual language models in six out of seven tested languages with up to 200x less pre-training efforts. Aiming at the Leave No One Behind Principle (LNOB), our approach manages to reduce inequalities between languages and energy consumption greatly. We make our codes and models publicly available at https://github.com/qcznlp/GreenPLMs.
Qingcheng Zeng, Lucas Garay, Peilin Zhou, Dading Chong, Yining Hua, Jiageng Wu, Yikang Pan, Han Zhou 0010, Rob Voigt, Jie Yang 0039
IJCAI9
2018 RtGender: A Corpus for Studying Differential Responses to Gender
Rob Voigt, David Jurgens, Vinodkumar Prabhakaran, Daniel Jurafsky, Yulia Tsvetkov
LREC1
2016 Between- and Within-Speaker Effects of Bilingualism on F0 Variation
Rob Voigt, Daniel Jurafsky, Meghan Sumner
INTERSPEECH1