Demo Data from VLDB 2026 / reviewers in the wild / expert
Siobhan Mackenzie Hall
dblp:317/1342
· DBLP profile ↗
5ranked-venue papers
3as first author
5since 2021 · last 2025
0000-0002-1520-4220ORCID · verified
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 2 · 1 first-author · 2 since 2021Applied, interdisciplinary, general and emerging computing · 2 · 1 first-author · 2 since 2021Human-computer interaction and ubiquitous computing · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Trustworthy machine learning · 75% Vision and language · 25% | |
| Interdisciplinary, comprehensive, and emerging computing
1 paper |
Computational science and engineering · 100% | |
| Databases, data mining, and information retrieval
1 paper |
Information retrieval · 100% |
Topics — the 7 heaviest of 8, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Computational science and engineering › scientific machine learning
surrogate modeling |
0.9 | 1 | 2025 | SMRS: advocating a unified reporting standard for surrogate models in the artificial intelligence era · NeurIPS 2025 |
Machine learning › Trustworthy machine learning › fairness
bias evaluation |
0.7 | 1 | 2023 | VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolution · NeurIPS 2023 |
Machine learning › Trustworthy machine learning
fairness |
0.7 | 1 | 2023 | VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolution · NeurIPS 2023 |
Machine learning › Trustworthy machine learning › fairness › gender bias
gender bias in vision-language models |
0.7 | 1 | 2023 | VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolution · NeurIPS 2023 |
Computer vision › Vision and language
vision-language model |
0.7 | 1 | 2023 | VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolution · NeurIPS 2023 |
Computational science and engineering
computational reproducibility |
0.3 | 1 | 2025 | SMRS: advocating a unified reporting standard for surrogate models in the artificial intelligence era · NeurIPS 2025 |
Computational science and engineering › scientific data management
data standardization |
0.3 | 1 | 2025 | SMRS: advocating a unified reporting standard for surrogate models in the artificial intelligence era · NeurIPS 2025 |
Methods — techniques the papers use, named apart from their topics
retrieval evaluation · 1.3pronoun resolution · 1.3benchmarking · 1.3
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | SMRS: advocating a unified reporting standard for surrogate models in the artificial intelligence eraabstractSurrogate models are widely used to approximate complex systems across science and engineering to reduce computational costs. Despite their widespread adoption, the field lacks standardisation across key stages of the modelling pipeline, including data sampling, model selection, evaluation, and downstream analysis. This fragmentation limits reproducibility and cross-domain utility – a challengefurther exacerbated by the rapid proliferation of AI-driven surrogate models. We argue for the urgent need to establish a structured reporting standard, the Surrogate Model Reporting Standard (SMRS), that systematically captures essential design and evaluation choices while remaining agnostic to implementation specifics. By promoting a standardised yet flexible framework, we aim to improve the reliabilityof surrogate modelling, foster interdisciplinary knowledge transfer, and, as a result, accelerate scientific progress in the AI era. Elizaveta Semenova, Siobhan Mackenzie Hall, Timothy James Hitge, Alisa Sheinkman, Jon Cockayne |
NeurIPS | 2 |
| 2025 | The Human Labour of Data Work: Capturing Cultural Diversity through World Wide DishesabstractThis paper provides guidance for building and maintaining infrastructure for participatory AI efforts by sharing reflections on building World Wide Dishes (WWD), a bottom-up, community-led image and text dataset of culinary dishes and associated cultural customs. We present WWD as an example of participatory dataset creation, where community members both guide the design of the research process and contribute to the crowdsourced dataset. This approach incorporates localised expertise and knowledge to address the limitations of web-scraped Internet datasets acknowledged in the Participatory AI discourse. We show that our approach can result in curated, high-quality data that supports decentralised contributions from communities that do not typically contribute to datasets due to a variety of systemic factors. Our project demonstrates the importance of participatory mediators in supporting community engagement by identifying the kinds of labour they performed to make WWD possible. We surface three dimensions of labour performed by participatory mediators that are crucial for participatory dataset construction: building trust with community members, making participation accessible, and contextualising community values to support meaningful data collection. Drawing on our findings, we put forth five lessons for building infrastructure to support future participatory AI efforts. Siobhan Mackenzie Hall, Samantha Dalal, Raesetje Sefala, Foutse Yuehgoh, Aisha Alaagib, Imane Hamzaoui, Shu Ishida, Jabez Magomere, Lauren Crais, Aya Salama 0002, Tejumade Afonja |
Proc. ACM Hum. Comput. Interact. | 1 |
| 2024 | Ten simple rules for pushing boundaries of inclusion at academic eventsabstractInclusion at academic events is facing increased scrutiny as the communities these events serve raise their expectations for who can practically attend. Active efforts in recent years to bring more diversity to academic events have brought progress and created momentum. However, we must reflect on these efforts and determine which underrepresented groups are being disadvantaged. Inclusion at academic events is important to ensure diversity of discourse and opinion, to help build networks, and to avoid academic siloing. All of these contribute to the development of a robust and resilient academic field. We have developed these Ten Simple Rules both to amplify the voices that have been speaking out and to celebrate the progress of many Equity, Diversity, and Inclusivity practices that continue to drive the organisation of academic events. The Rules aim to raise awareness as well as provide actionable suggestions and tools to support these initiatives further. This aims to support academic organisations such as the Deep Learning Indaba, Neuromatch Academy, the IBRO-Simons Computational Neuroscience Imbizo, Biodiversity Information Standards (TDWG), Arabs in Neuroscience, FAIRPoints, and OLS (formerly Open Life Science). This article is a call to action for organisers to reevaluate the impact and reach of their inclusive practices. Siobhan Mackenzie Hall, Daniel Kochin, Carmel Carne, Patricia Herterich, Kristen Lenay Lewers, Mohamed Abdelhack, Arun Ramasubramanian, Juno Felecia Michael Alphonse, Visotheary Ung, Sara El-Gebali, Christopher Brian Currin, Esther Plomp, Rachel Thompson, Malvika Sharan |
PLoS Comput. Biol. | 1 |
| 2023 | VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolutionabstractWe introduce VisoGender, a novel dataset for benchmarking gender bias in vision-language models. We focus on occupation-related biases within a hegemonic system of binary gender, inspired by Winograd and Winogender schemas, where each image is associated with a caption containing a pronoun relationship of subjects and objects in the scene. VisoGender is balanced by gender representation in professional roles, supporting bias evaluation in two ways: i) resolution bias, where we evaluate the difference between pronoun resolution accuracies for image subjects with gender presentations perceived as masculine versus feminine by human annotators and ii) retrieval bias, where we compare ratios of professionals perceived to have masculine and feminine gender presentations retrieved for a gender-neutral search query. We benchmark several state-of-the-art vision-language models and find that they demonstrate bias in resolving binary gender in complex scenes. While the direction and magnitude of gender bias depends on the task and the model being evaluated, captioning models are generally less biased than Vision-Language Encoders. Siobhan Mackenzie Hall, Fernanda Gonçalves Abrantes, Hanwen Zhu, Grace Sodunke, Aleksandar Shtedritski, Hannah Kirk |
NeurIPS | 1 |
| 2022 | Ten simple rules for establishing a mentorship programmeabstractIn recent years, a wide variety of mentorship programmes targeting issues that cannot be addressed through traditional teaching and learning methods alone have been developed. Mentoring plays significant roles in the growth and development of both mentors and mentees, and the positive impacts of mentoring have been well documented. Mentorship programmes are therefore increasingly being implemented in a wide variety of fields by organisations, academic institutes, businesses, and governments. While there is a growing body of literature on mentoring and mentorship programmes, gaining a clear overview of the field is often challenging. In this article, we therefore provide a concise summary of recommendations to consider when designing and establishing mentorship programmes. These recommendations are based on the collective knowledge and experiences of 4 different emerging and established mentorship programmes and can be adapted across various mentorship settings or contexts. Anne M. Treasure, Siobhan Mackenzie Hall, Igor Lesko, Derek Moore, Malvika Sharan, Menno van Zaanen, Yo Yehudi, Anelda van der Walt |
PLoS Comput. Biol. | 2 |