Demo Data from SIGIR 2026 / reviewers in the wild / expert
Raksha Shenoy
dblp:297/4330
· DBLP profile ↗
1ranked-venue papers
1as first author
1since 2021 · last 2021
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Machine translation · 100% | |
| Human-computer interaction and pervasive computing
1 paper |
Human-AI interaction · 100% |
Topics — the 4 heaviest of 4, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Machine translation › computer-assisted translation
post-editing |
0.5 | 1 | 2021 | Investigating the Helpfulness of Word-Level Quality Estimation for Post-Editing Machine Translation Output · EMNLP (1) 2021 |
Natural language and speech › Machine translation › machine translation evaluation
translation quality estimation |
0.5 | 1 | 2021 | Investigating the Helpfulness of Word-Level Quality Estimation for Post-Editing Machine Translation Output · EMNLP (1) 2021 |
Natural language and speech › Machine translation › machine translation evaluation › translation quality estimation
word-level quality estimation |
0.5 | 1 | 2021 | Investigating the Helpfulness of Word-Level Quality Estimation for Post-Editing Machine Translation Output · EMNLP (1) 2021 |
Human-AI interaction › explainable AI › uncertainty communication
uncertainty visualization |
0.1 | 1 | 2021 | Investigating the Helpfulness of Word-Level Quality Estimation for Post-Editing Machine Translation Output · EMNLP (1) 2021 |
Methods — techniques the papers use, named apart from their topics
user study · 1.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2021 | Investigating the Helpfulness of Word-Level Quality Estimation for Post-Editing Machine Translation OutputabstractCompared to fully manual translation, postediting (PE) machine translation (MT) output can save time and reduce errors.Automatic word-level quality estimation (QE) aims to predict the correctness of words in MT output and holds great promise to aid PE by flagging problematic output.Quality of QE is crucial, as incorrect QE might lead to translators missing errors or wasting time on already correct MT output.Achieving accurate automatic word-level QE is very hard, and it is currently not known (i) at what quality threshold QE is actually beginning to be useful for human PE, and (ii), how to best present wordlevel QE information to translators.In particular, should word-level QE visualization indicate uncertainty of the QE model or not?In this paper, we address both research questions with real and simulated word-level QE, visualizations, and user studies, where time, subjective ratings, and quality of the final translations are assessed.Results show that current wordlevel QE models are not yet good enough to support PE. Instead, quality levels of ≥ 80% F1 are required.For helpful quality levels, a visualization reflecting the uncertainty of the QE model is preferred.Our analysis further shows that speed gains achieved through QE are not merely a result of blindly trusting the QE system, but that the quality of the final translations also improves.The threshold results from the paper establish a quality goal for future wordlevel QE research. Raksha Shenoy, Nico Herbig 0001, Antonio Krüger, Josef van Genabith |
EMNLP (1) | 1 |