Demo Data from VLDB 2026 / reviewers in the wild / expert
Madeleine van Zuylen
dblp:218/6059 · also Madeleine N. van Zuylen
· DBLP profile ↗
6ranked-venue papers
0as first author
3since 2021 · last 2021
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 5 · 2 since 2021Human-computer interaction and ubiquitous computing · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
3 papers |
Information extraction and text analysis · 65% Language models and text generation · 35% | |
| Interdisciplinary, comprehensive, and emerging computing
1 paper |
Medical and health informatics · 100% | |
| Databases, data mining, and information retrieval
1 paper |
Information retrieval · 100% |
Topics — the 8 heaviest of 9, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation › text summarization
multi-document summarization |
0.5 | 1 | 2021 | MS\^2: Multi-Document Summarization of Medical Studies · EMNLP (1) 2021 |
Natural language and speech › Language models and text generation
text summarization |
0.5 | 1 | 2021 | MS\^2: Multi-Document Summarization of Medical Studies · EMNLP (1) 2021 |
Natural language and speech › Information extraction and text analysis › document analysis
document information extraction |
0.4 | 1 | 2020 | SciREX: A Challenge Dataset for Document-Level Information Extraction · ACL 2020 |
Natural language and speech › Information extraction and text analysis
fact-checking |
0.4 | 1 | 2020 | Fact or Fiction: Verifying Scientific Claims · EMNLP (1) 2020 |
Natural language and speech › Information extraction and text analysis
relation extraction |
0.4 | 1 | 2020 | SciREX: A Challenge Dataset for Document-Level Information Extraction · ACL 2020 |
Natural language and speech › Information extraction and text analysis › fact-checking
scientific claim verification |
0.4 | 1 | 2020 | Fact or Fiction: Verifying Scientific Claims · EMNLP (1) 2020 |
Natural language and speech › Information extraction and text analysis
named entity recognition |
0.1 | 1 | 2020 | SciREX: A Challenge Dataset for Document-Level Information Extraction · ACL 2020 |
Information retrieval › document retrieval › domain-specific retrieval
scientific literature search |
0.1 | 1 | 2020 | Fact or Fiction: Verifying Scientific Claims · EMNLP (1) 2020 |
Methods — techniques the papers use, named apart from their topics
summarization evaluation metric · 1.0BART · 1.0natural language inference · 0.9evidence retrieval · 0.9neural model · 0.4human annotation · 0.4automatic annotation · 0.4
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2021 | SciA11y: Converting Scientific Papers to Accessible HTMLabstractWe present SciA11y, a system that renders inaccessible scientific paper PDFs into HTML. SciA11y uses machine learning models to extract and understand the content of scientific PDFs, and reorganizes the resulting paper components into a form that better supports skimming and scanning for blind and low vision (BLV) readers. SciA11y adds navigation features such as tagged headings, a table of contents, and bidirectional links between inline citations and references, which allow readers to resolve citations without losing their context. A set of 1.5 million open access papers are processed and available at https://scia11y.org/. This system is a first step in addressing scientific PDF accessibility, and may significantly improve the experience of paper reading for BLV users. Lucy Lu Wang, Isabel Cachola, Jonathan Bragg, Evie Yu-Yen Cheng, Chelsea Haupt, Matt Latzke, Bailey Kuehl, Madeleine van Zuylen, Linda Wagner, Daniel S. Weld |
ASSETS | 8 |
| 2021 | MS\^2: Multi-Document Summarization of Medical StudiesabstractTo assess the effectiveness of any medical intervention, researchers must conduct a timeintensive and manual literature review.NLP systems can help to automate or assist in parts of this expensive process.In support of this goal, we release MSˆ2 (Multi-Document Summarization of Medical Studies), a dataset of over 470k documents and 20K summaries derived from the scientific literature.This dataset facilitates the development of systems that can assess and aggregate contradictory evidence across multiple studies, and is the first large-scale, publicly available multi-document summarization dataset in the biomedical domain.We experiment with a summarization system based on BART, with promising early results, though significant work remains to achieve higher summarization quality.We formulate our summarization inputs and targets in both free text and structured forms and modify a recently proposed metric to assess the quality of our system's generated summaries. Jay DeYoung, Iz Beltagy, Madeleine van Zuylen, Bailey Kuehl, Lucy Lu Wang |
EMNLP (1) | 3 |
| 2021 | Extracting a Knowledge Base of Mechanisms from COVID-19 PapersabstractTom Hope, Aida Amini, David Wadden, Madeleine van Zuylen, Sravanthi Parasa, Eric Horvitz, Daniel Weld, Roy Schwartz, Hannaneh Hajishirzi. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2021. Tom Hope, Aida Amini, Dave Wadden, Madeleine van Zuylen, Sravanthi Parasa, Eric Horvitz, Daniel S. Weld, Roy Schwartz 0001, Hannaneh Hajishirzi |
NAACL-HLT | 4 |
| 2020 | SciREX: A Challenge Dataset for Document-Level Information ExtractionabstractExtracting information from full documents is an important problem in many domains, but most previous work focus on identifying relationships within a sentence or a paragraph.It is challenging to create a large-scale information extraction (IE) dataset at the document level since it requires an understanding of the whole document to annotate entities and their document-level relationships that usually span beyond sentences or even sections.In this paper, we introduce SCIREX, a document level IE dataset that encompasses multiple IE tasks, including salient entity identification and document level N -ary relation identification from scientific articles.We annotate our dataset by integrating automatic and human annotations, leveraging existing scientific knowledge resources.We develop a neural model as a strong baseline that extends previous state-of-the-art IE models to documentlevel IE.Analyzing the model performance shows a significant gap between human performance and current baselines, inviting the community to use our dataset as a challenge to develop document-level IE models. Madeleine van Zuylen, Hannaneh Hajishirzi, Iz Beltagy |
ACL | 2 |
| 2020 | Fact or Fiction: Verifying Scientific ClaimsabstractDavid Wadden, Shanchuan Lin, Kyle Lo, Lucy Lu Wang, Madeleine van Zuylen, Arman Cohan, Hannaneh Hajishirzi. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2020. Dave Wadden, Shanchuan Lin, Kyle Lo, Lucy Lu Wang, Madeleine van Zuylen, Arman Cohan, Hannaneh Hajishirzi |
EMNLP (1) | 5 |
| 2018 | A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP ApplicationsabstractDongyeop Kang, Waleed Ammar, Bhavana Dalvi, Madeleine van Zuylen, Sebastian Kohlmeier, Eduard Hovy, Roy Schwartz. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). 2018. Dongyeop Kang, Waleed Ammar, Bhavana Dalvi, Madeleine van Zuylen, Sebastian Kohlmeier, Eduard H. Hovy, Roy Schwartz 0001 |
NAACL-HLT | 4 |