Demo Data from VLDB 2026 / reviewers in the wild / expert
Demet Demir
dblp:360/2728
· DBLP profile ↗
1ranked-venue papers
1as first author
1since 2021 · last 2024
0000-0002-7497-5957ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Software engineering, systems software and programming languages · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Software engineering, system software, and programming languages
1 paper |
Software testing · 100% | |
| Artificial intelligence
1 paper |
Trustworthy machine learning · 100% |
Topics — the 5 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Software testing
deep learning testing |
0.8 | 1 | 2024 | Test Selection for Deep Neural Networks using Meta-Models with Uncertainty Metrics · ISSTA 2024 |
Software testing › regression testing
test case prioritization |
0.8 | 1 | 2024 | Test Selection for Deep Neural Networks using Meta-Models with Uncertainty Metrics · ISSTA 2024 |
Software testing › regression testing
test selection |
0.8 | 1 | 2024 | Test Selection for Deep Neural Networks using Meta-Models with Uncertainty Metrics · ISSTA 2024 |
Machine learning › Trustworthy machine learning › robustness
out-of-distribution detection |
0.2 | 1 | 2024 | Test Selection for Deep Neural Networks using Meta-Models with Uncertainty Metrics · ISSTA 2024 |
Machine learning › Trustworthy machine learning
robustness |
0.2 | 1 | 2024 | Test Selection for Deep Neural Networks using Meta-Models with Uncertainty Metrics · ISSTA 2024 |
Methods — techniques the papers use, named apart from their topics
uncertainty metrics · 1.5meta-model · 1.5
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2024 | Test Selection for Deep Neural Networks using Meta-Models with Uncertainty MetricsabstractWith the use of Deep Learning (DL) in safety-critical domains, the systematic testing of these systems has become a critical issue for human life. Due to the data-driven nature of Deep Neural Networks (DNNs), the effectiveness of tests is closely related to the adequacy of test datasets. Test data need to be labeled, which requires manual human effort and sometimes expert knowledge. DL system testers aim to select the test data that will be most helpful in identifying the weaknesses of the DNN model by using resources efficiently. To help achieve this goal, we propose a test data prioritization approach based on using a meta-model that gets uncertainty metrics as input, which are derived from outputs of other base models. Integrating different uncertainty metrics helps overcome individual limitations of these metrics and be effective in a wider range of scenarios. We train the meta-models with the objective of predicting whether a test input will lead the tested model to make an incorrect prediction or not. We conducted an experimental evaluation with popular image classification datasets and DNN models to evaluate the proposed approach. The results of the experiments demonstrate that our approach effectively prioritizes the test datasets and outperforms existing state-of-the-art test prioritization methods used in comparison. In the experiments, we evaluated the test prioritization approach from a distribution-aware perspective by generating test datasets with and without out-of-distribution data. Demet Demir, Aysu Betin Can, Elif Sürer |
ISSTA | 1 |