Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Demet Demir

dblp:360/2728 · DBLP profile ↗
← Back
1ranked-venue papers
1as first author
1since 2021 · last 2024
0000-0002-7497-5957ORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Software engineering, systems software and programming languages · 1 · 1 first-author · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Software engineering, system software, and programming languages
1 paper
Software testing · 100%
Artificial intelligence
1 paper
Trustworthy machine learning · 100%

Topics — the 5 heaviest of 5, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Software testing
deep learning testing
0.812024
Test Selection for Deep Neural Networks using Meta-Models with Uncertainty Metrics · ISSTA 2024
Software testing › regression testing
test case prioritization
0.812024
Test Selection for Deep Neural Networks using Meta-Models with Uncertainty Metrics · ISSTA 2024
Software testing › regression testing
test selection
0.812024
Test Selection for Deep Neural Networks using Meta-Models with Uncertainty Metrics · ISSTA 2024
Machine learning › Trustworthy machine learning › robustness
out-of-distribution detection
0.212024
Test Selection for Deep Neural Networks using Meta-Models with Uncertainty Metrics · ISSTA 2024
Machine learning › Trustworthy machine learning
robustness
0.212024
Test Selection for Deep Neural Networks using Meta-Models with Uncertainty Metrics · ISSTA 2024

Methods — techniques the papers use, named apart from their topics

uncertainty metrics · 1.5meta-model · 1.5
YearPublicationVenuePosition
2024 Test Selection for Deep Neural Networks using Meta-Models with Uncertainty Metrics
abstract
With the use of Deep Learning (DL) in safety-critical domains, the systematic testing of these systems has become a critical issue for human life. Due to the data-driven nature of Deep Neural Networks (DNNs), the effectiveness of tests is closely related to the adequacy of test datasets. Test data need to be labeled, which requires manual human effort and sometimes expert knowledge. DL system testers aim to select the test data that will be most helpful in identifying the weaknesses of the DNN model by using resources efficiently. To help achieve this goal, we propose a test data prioritization approach based on using a meta-model that gets uncertainty metrics as input, which are derived from outputs of other base models. Integrating different uncertainty metrics helps overcome individual limitations of these metrics and be effective in a wider range of scenarios. We train the meta-models with the objective of predicting whether a test input will lead the tested model to make an incorrect prediction or not. We conducted an experimental evaluation with popular image classification datasets and DNN models to evaluate the proposed approach. The results of the experiments demonstrate that our approach effectively prioritizes the test datasets and outperforms existing state-of-the-art test prioritization methods used in comparison. In the experiments, we evaluated the test prioritization approach from a distribution-aware perspective by generating test datasets with and without out-of-distribution data.
Demet Demir, Aysu Betin Can, Elif Sürer
ISSTA1