Demo Data from EDBT 2026 / reviewers in the wild / expert
Susan Elliott Sim
dblp:21/3796
· DBLP profile ↗
28ranked-venue papers
10as first author
0since 2021 · last 2013
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Software engineering, systems software and programming languages · 23 · 10 first-authorHuman-computer interaction and ubiquitous computing · 4Artificial intelligence and machine learning · 2Databases, data management, data science and information retrieval · 1
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Software engineering, system software, and programming languages
7 papers |
Software maintenance and evolution · 48% Empirical software engineering · 36% Requirements engineering and software design · 16% | |
| Databases, data mining, and information retrieval
2 papers |
Information retrieval · 100% |
Topics — the 15 heaviest of 16, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Requirements engineering and software design › software architecture
component-based software engineering |
0.1 | 1 | 2012 | Software reuse through methodical component reuse and amethodical snippet remixing · CSCW 2012 |
Software maintenance and evolution
software reuse |
0.1 | 1 | 2012 | Software reuse through methodical component reuse and amethodical snippet remixing · CSCW 2012 |
Information retrieval › document retrieval › domain-specific retrieval
code search |
0.1 | 1 | 2011 | How Well Do Search Engines Support Code Retrieval on the Web? · ACM Trans. Softw. Eng. Methodol. 2011 |
Information retrieval
retrieval models |
0.1 | 1 | 2011 | How Well Do Search Engines Support Code Retrieval on the Web? · ACM Trans. Softw. Eng. Methodol. 2011 |
Software maintenance and evolution
feature location |
0.1 | 1 | 2010 | Using transitive changesets to support feature location · ASE 2010 |
Empirical software engineering
mining software repositories |
0.1 | 1 | 2010 | Using transitive changesets to support feature location · ASE 2010 |
Software maintenance and evolution
program comprehension |
0.1 | 1 | 2010 | Using transitive changesets to support feature location · ASE 2010 |
Software maintenance and evolution
code search |
0.0 | 1 | 2012 | Software reuse through methodical component reuse and amethodical snippet remixing · CSCW 2012 |
Empirical software engineering
benchmarking |
0.0 | 1 | 2003 | Using Benchmarking to Advance Research: A Challenge to Software Engineering · ICSE 2003 |
Information retrieval
search engines |
0.0 | 1 | 2011 | How Well Do Search Engines Support Code Retrieval on the Web? · ACM Trans. Softw. Eng. Methodol. 2011 |
Computing education
software engineering education |
0.0 | 2 | 2006 | Case studies for software engineers · ICSE 2006 Case Studies for Software Engineers · ICSE 2004 |
Information retrieval › document retrieval
structured document retrieval |
0.0 | 1 | 1999 | Searching Program Source Code with a Structured Text Retrieval System (poster abstract) · SIGIR 1999 |
Empirical software engineering
developer studies |
0.0 | 1 | 1998 | The Ramp-Up Problem in Software Projects: A Case Study of How Software Immigrants Naturalize · ICSE 1998 |
Software maintenance and evolution
reverse engineering |
0.0 | 1 | 2003 | Using Benchmarking to Advance Research: A Challenge to Software Engineering · ICSE 2003 |
Empirical software engineering › developer studies
software teams |
0.0 | 1 | 1998 | The Ramp-Up Problem in Software Projects: A Case Study of How Software Immigrants Naturalize · ICSE 1998 |
Methods — techniques the papers use, named apart from their topics
qualitative study · 0.1deconstructionist analysis · 0.1user study · 0.1relevance judgment · 0.1transitive changesets · 0.1case study · 0.1structured text retrieval · 0.0interview study · 0.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2013 | Guest Editorial: Special Section on International Conference on Program Comprehension, 2011
Filippo Ricca, Thomas R. Dean, Susan Elliott Sim |
Inf. Softw. Technol. | 3 |
| 2012 | Software reuse through methodical component reuse and amethodical snippet remixingabstractEvery method for developing software is a prescriptive model. Applying a deconstructionist analysis to methods reveals that there are two texts, or sets of assumptions and ideals: a set that is privileged by the method and a second set that is left out, or marginalized by the method. We apply this analytical lens to software reuse, a technique in software development that seeks to expedite one's own project by using programming artifacts created by others. By analyzing the methods prescribed by Component-Based Software Engineering (CBSE), we arrive at two texts: Methodical CBSE and Amethodical Remixing. Empirical data from four studies on code search on the web draws attention to four key points of tension: status of component boundaries; provenance of source code; planning and process; and evaluation criteria for candidate code. We conclude the paper with a discussion of the implications of this work for the limits of methods, structure of organizations that reuse software, and the design of search engines for source code. Kavita Philip, Medha Umarji, Megha Agarwala, Susan Elliott Sim, Rosalva E. Gallardo-Valencia, Cristina V. Lopes, Sukanya Ratanotayanon |
CSCW | 4 |
| 2011 | Getting the whole story: an experience report on analyzing data elicited using the war stories procedureabstractWhen analyzing data elicited using the “war stories” technique, previously introduced by Lutters and Seaman (Inf Softw Technol 49(6):576–587, 2007 ), we encountered unexpected challenges in applying standard qualitative analysis techniques. After reviewing the literature on stories and storytelling, we realized that a richer analysis would be possible if we accorded more respect to the data’s structure and nature as stories, rather than treating our participants’ utterances simply as textual data. We report on five lessons learned regarding how we can better analyze war stories as stories: 1) war stories tend to be about exceptional situations; 2) war stories tend to be diverse and resistant to being combined into a single grand narrative; 3) the humanities can be a valuable resource for analyzing war stories; 4) war stories are not just text, they are also performances; and 5) war stories are not just data, they are also instructive and evocative. Susan Elliott Sim, Thomas A. Alspaugh |
Empir. Softw. Eng. | 1 |
| 2011 | How Well Do Search Engines Support Code Retrieval on the Web?abstractSoftware developers search the Web for various kinds of source code for diverse reasons. In a previous study, we found that searches varied along two dimensions: the size of the search target (e.g., block, subsystem, or system) and the motivation for the search (e.g., reference example or as-is reuse). Would each of these kinds of searches require different search technologies? To answer this question, we conducted an experiment with 36 participants to evaluate three diverse approaches (general purpose information retrieval, source code search, and component reuse), as represented by five Web sites (Google, Koders, Krugle, Google Code Search, and SourceForge). The independent variables were search engine, size of search target, and motivation for search. The dependent variable was the participants judgement of the relevance of the first ten hits. We found that it was easier to find reference examples than components for as-is reuse and that participants obtained the best results using a general-purpose information retrieval site. However, we also found an interaction effect: code-specific search engines worked better in searches for subsystems, but Google worked better on searches for blocks. These results can be used to guide the creation of new tools for retrieving source code from the Web. Susan Elliott Sim, Medha Umarji, Sukanya Ratanotayanon, Cristina V. Lopes |
ACM Trans. Softw. Eng. Methodol. | 1 |
| 2010 | Design methods as discourse on practiceabstractIn this paper, we present a view of design methods as discourse on practice. We consider how the deployment of a particular set of design methods enables and constrains not only practical action but also discursive action within the design practice. A case study of agile software development methods illustrates the ways that methods establish conditions for who can speak in the design process and how. We indentify three main kinds of discourse work performed in the invoking of design methods. These are the establishing of ontologies, the authorizing of voices, and the legitimizing of practices. We then discuss implications of this view on methods for CSCW research on the relationship between methods and practice as well as implications for participation in the design process. Marisa Leavitt Cohn, Susan Elliott Sim, Paul Dourish |
GROUP | 2 |
| 2010 | Searching for reputable source code on the webabstractLooking for source code on the Web is a common practice among software developers. Previous research has shown that developers use social cues over technical cues to evaluate source code candidates. However, current source code search engines do not take full advantage of social information. We present a prototype, an extension of Sourcerer, that shows reputation information for each developer involved in the project and the developer's activity level. From this implementation, we have learned that the effectiveness of this approach depends on the amount of reputation information available on the Web, which is currently scarce. We also learned that a ranking algorithm that relies on both relevance and reputation would be beneficial. More research needs to be done to explore ranking algorithms that combine both social and technical information and also reputation information for source code and people. Rosalva E. Gallardo-Valencia, Phitchayaphong Tantikul, Susan Elliott Sim |
GROUP | 3 |
| 2010 | My Repository Runneth Over: An Empirical Study on Diversifying Data Sources to Improve Feature SearchabstractResearch on feature location that applies information retrieval techniques have experimented the kinds of inputs to the corpus and the algorithms that could be used. At first, only source code was used. Later extraction techniques were improved, and data from other software tools and analyses were used to expand or augment the repository. But, does having more diverse data in the repository always produce better results? In this paper, we report on an empirical study to examine the effect of increasing data diversity to improve feature location through search. In particular, we looked at the effect of including: i) change sets from revision control system, ii) tickets from issue trackers, and iii) elements from a Static Dependency Graph (SDG). We searched for three features of Jajuk, an open source Java jukebox, and two features of jEdit, an open source Java text editor. We used four different corpuses built with a combination of the above data. We used Eclipse's code search and an index built with source code as baseline conditions. We found that it is not always better to have more diverse data. Adding SDG data to change sets increased recall, but drove down precision. Adding data from issue trackers had little effect and in one case lowered recall. We also found that large-scale refactoring of the code decreases the effectiveness using change sets for feature location. Sukanya Ratanotayanon, Hye Jung Choi, Susan Elliott Sim |
ICPC | 3 |
| 2010 | Using transitive changesets to support feature locationabstractIn this paper, we present a new construct, called Transitive Changeset, that can be used for feature location. Transitive Changesets are created by extending changesets from revision control systems with additional information. A changeset temporally associate changes and conceptual descriptions provided in a commit transaction. By following transitive relationships from these changesets, we can create a Transitive Changeset that relates concepts in the problem domain to a list of program elements that enclose changes made in the transaction and other relevant program elements. We have implemented a prototype Eclipse plug-in, Kayley, to create Sukanya Ratanotayanon, Hye Jung Choi, Susan Elliott Sim |
ASE | 3 |
| 2009 | Creating task-based concern maps by merging concern fragmentsabstractOn any project, it is not possible to have complete and accurate concern maps for all possible tasks. We present an approach to create concern maps from available secondary software work artifacts produced by common software tools, such as revisions control. We mine and index concern fragments from repositories of those tools. Developers can search the index for an initial set of relevant fragments. To create a final concern map, the members from the initial set of fragments are validated, merged and expanded using a call graph. Members of the final concern map members are also ranked to guide developers to more relevant sections of the code. Sukanya Ratanotayanon, Susan Elliott Sim |
ICPC | 2 |
| 2009 | Structure transition graphs: An ECG for program comprehension?abstractThis paper presents an idea of using a structure traversal graph (STG) to characterize whether program comprehension is progressing smoothly. Inspired by electrocardiograms that are used to measure heart rhythms, STGs are an attempt to depict the rhythm of program navigation. STGs are created by abstracting navigation between files to the level of a conceptual architecture graph. We analyzed the navigation patterns of fifteen developers performing a modification task in the laboratory and found that the STG was a good organizing principle for program comprehension behavior. Susan Elliott Sim, Sukanya Ratanotayanon, Leyna Cotran |
ICPC | 1 |
| 2009 | What Counts as Software Process? Negotiating the Boundary of Software Work Through Artifacts and Conversation
Marisa Leavitt Cohn, Susan Elliott Sim, Charlotte P. Lee |
Comput. Support. Cooperative Work. | 2 |
| 2008 | Marginal Notes on Amethodical Requirements Engineering: What Experts Learned from ExperienceabstractRequirements engineers with many years of experience have a distinct perspective on the field. To sample this knowledge, we interviewed 34 requirements researchers and practitioners, each with up to 42 years of experience. We used open-ended, structured interviews in which we asked them to reflect on their experiences and professional development as requirements engineers over their careers. Several themes emerged: requirements engineers act as bridges between different worlds, good communication is key, good process can help but isn't everything, shorter requirements documents can be better, and good requirements are driven by customer value not technical elegance. All of these pertain to amethodical requirements engineering. Amethodical concepts are not rejections of method, but rather those concepts that are marginalized and left out of prescriptive methods for carrying out a procedure. We discuss these results and their implications. Susan Elliott Sim, Thomas A. Alspaugh, Ban Al-Ani |
RE | 1 |
| 2008 | Guest editors' introduction: special issue from the 13th working conference on reverse engineering (WCRE 2006)
Susan Elliott Sim, Massimiliano Di Penta |
Empir. Softw. Eng. | 1 |
| 2007 | Working Conference on Reverse Engineering 2005
Andrea De Lucia, Susan Elliott Sim |
Inf. Softw. Technol. | 2 |
| 2006 | Case studies for software engineersabstractThe topic of this full-day tutorial was the correct use and interpretation of case studies as an empirical research method. Using an equal blend of lecture and discussion, it gave attendees a foundation for conducting, reviewing, and reading case studies. There were lessons for software engineers as researchers who conduct and report case studies, reviewers who evaluate papers, and practitioners who are attempting to apply results from papers. The main resource for the course was the book Case Study Research: Design and Methods by Robert K. Yin. This text was supplemented with positive and negative examples from the literature. Dewayne E. Perry, Susan Elliott Sim, Steve M. Easterbrook |
ICSE | 2 |
| 2006 | So, You Think You Are a Requirements Engineer?abstractThe success of a task relies on the expertise of its owner to a great degree. But what is the anticipated expertise? In what areas? Our research intends to investigate the skill sets anticipated of requirements engineers. This paper presents a model of the varying levels of RE expertise within the context of the main RE domains. Identifying the layers of RE expertise can provide more realistic expectations of the anticipated expertise. This understanding can in turn be utilised to increase tool usability (by embedding appropriate support for users' expertise), course development (by identifying the anticipated competencies a student demonstrated at the end of a course), task allocation and employment in industry (mapping capability required to a person 's expertise) Ban Al-Ani, Susan Elliott Sim |
RE | 2 |
| 2006 | Applying Models of Technology Adoption to Software Tools and Methods: An Empirical Study
Scott A. Bailey, Susan Elliott Sim |
SEKE | 2 |
| 2006 | After the Scrum: Twenty Years of Working without Documentation
Sukanya Ratanotayanon, Jigar Kotak, Susan Elliott Sim |
SEKE | 3 |
| 2006 | GXL: A graph-based standard exchange format for reengineering
Richard C. Holt, Andy Schürr, Susan Elliott Sim, Andreas Winter 0001 |
Sci. Comput. Program. | 3 |
| 2005 | Studying Software Engineers: Data Collection Techniques for Software Field Studies
Timothy Lethbridge, Susan Elliott Sim, Janice Singer |
Empir. Softw. Eng. | 2 |
| 2004 | Case Studies for Software EngineersabstractThe topic of this paper was the correct use and interpretation of case studies as an empirical research method. Using an equal blend of lecture and discussion, it gave a foundation for conducting, reviewing, and reading case studies. There were lessons for software engineers as researchers who conduct and report case studies, reviewers who evaluate papers, and practitioners who are attempting to apply results from papers. The main resource for the course was the book Case Study Research: Design and Methods by Robert K. Yin. This text was supplemented with positive and negative examples from the literature. Dewayne E. Perry, Susan Elliott Sim, Steve M. Easterbrook |
ICSE | 2 |
| 2003 | Using Benchmarking to Advance Research: A Challenge to Software EngineeringabstractBenchmarks have been used in computer science to compare the performance of computer systems, information retrieval algorithms, databases, and many other technologies. The creation and widespread use of a benchmark within a research area is frequently accompanied by rapid technical progress and community building. These observations have led us to formulate a theory of benchmarking within scientific disciplines. Based on this theory, we challenge software engineering research to become more scientific and cohesive by working as a community to define benchmarks. In support of this challenge, we present a case study of the reverse engineering community, where we have successfully used benchmarks to advance the state of research. Susan Elliott Sim, Steve M. Easterbrook, Richard C. Holt |
ICSE | 1 |
| 2001 | Beg, Borrow, or Steal: Using Multidisciplinary Approaches in Empirical Software Engineering Research
Susan Elliott Sim, Janice Singer, Margaret-Anne D. Storey |
Empir. Softw. Eng. | 1 |
| 2000 | Workshop on standard exchange format (WoSEF)abstractNo abstract available. Susan Elliott Sim, Richard C. Holt, Rainer Koschke |
ICSE | 1 |
| 2000 | Beg, borrow, or steal (workshop session): using multidisciplinary approaches in empirical software engineering researchabstractThe goal of this workshop is to provide an interactive forum for software engineers and empirical researchers to investigate the feasibility of applying proven methods from other research disciplines to software engineering research. Participants submitted position papers describing problems that might benefit from a multidisciplinary approach. Expert guest speakers from software engineering and other disciplines will address the issues highlighted in the papers with the goal of encouraging more multidisciplinary research. Janice Singer, Margaret-Anne D. Storey, Susan Elliott Sim |
ICSE | 3 |
| 1999 | Browsing and Searching Software ArchitecturesabstractSoftware architecture visualization tools tend to support browsing, that is, exploration by following concepts. If architectural diagrams are to be used during daily software maintenance tasks, these tools also need to support specific fact-finding through searching. Searching is essential to program comprehension and hypothesis testing. Furthermore, searching allows users to reverse the abstractions in architectural diagrams and access facts in the underlying program code. We consider the problem of searching and browsing software architectures using perspectives from information retrieval and program comprehension. After analyzing our own user studies and results from the literature, we propose a solution: the Searchable Bookshelf, an architecture visualization tool that supports both navigation styles. We also present a prototype of our tool which is an extension of an existing architecture visualization tool. Susan Elliott Sim, Charles L. A. Clarke, Richard C. Holt, Anthony Cox |
ICSM | 1 |
| 1999 | Searching Program Source Code with a Structured Text Retrieval System (poster abstract)abstractNo abstract available. Charles L. A. Clarke, Anthony Cox, Susan Elliott Sim |
SIGIR | 3 |
| 1998 | The Ramp-Up Problem in Software Projects: A Case Study of How Software Immigrants NaturalizeabstractJoining a software development team is like moving to a new country to start employment; the immigrant has a lot to learn about the job, the local customs, and sometimes a new language. In an exploratory case study, we interviewed four software immigrants, in order to characterize their naturalization process. Seven patterns in four major categories were found. In this paper, these patterns are substantiated, and their implications discussed. The lessons learned from this study can be applied equally to improving the naturalization process, and to the formulation of further research questions. Susan Elliott Sim, Richard C. Holt |
ICSE | 1 |