VLDB 2026 Research / reviewers in the wild / expert
Besiki Stvilia
dblp:27/153
· DBLP profile ↗
15ranked-venue papers in the field
9as first author
5since 2021 · last 2025
0000-0002-2428-6627ORCID · verified
Domains — venue-derived; a paper can count in several
Information Retrieval & Web Search · 15 (9 first)
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | College students' credibility assessments of GenAI-generated information for academic tasks: An interview studyabstractAbstract The study explored college students' use of generative artificial intelligence (GenAI) tools, such as ChatGPT, for academic tasks and their perceptions and behaviors in assessing the credibility of GenAI‐generated information. Semistructured interviews were conducted with 25 college students in the United States. Interview transcripts were analyzed using the qualitative content analysis method. The study identified various types of academic tasks for which students used ChatGPT, including writing, programming, and learning. Guided by two models of credibility assessment Hilligoss and Rieh (2008); Metzger (2007), six factors influencing students' motivation and ability to assess the credibility of GenAI‐generated information were identified (e.g., task salience, social pressure). We also identified 9 constructs (e.g., refinedness, explainability), 5 heuristics (e.g., inter‐ and intrasystem consistency heuristics), and 10 cues (e.g., version and tone) used by students to assess the credibility of GenAI‐generated information. This study provides theoretical and empirical findings regarding students' use of GenAI tools in the academic context and credibility evaluation of the system outputs using rich, qualitative interview data. Wonchan Choi, Hyerin Bak, Jiaxin An, Yan Zhang 0005, Besiki Stvilia |
J. Assoc. Inf. Sci. Technol. | 5 |
| 2025 | Data quality assurance practices in research data repositories - A systematic literature review. An Annual Review of Information Science and Technology (ARIST) paperabstractAbstract Data quality issues can significantly hinder research reproducibility, data sharing, and reuse. At the forefront of addressing data quality issues are research data repositories (RDRs). This study conducted a systematic analysis of data quality assurance (DQA) practices in RDRs, guided by activity theory and data quality literature, resulting in conceptualizing a data quality assurance model (DQAM) for RDRs. DQAM outlines a DQA process comprising evaluation, intervention, and communication activities and categorizes 17 quality dimensions into intrinsic and product‐level data quality. It also details specific improvement actions for data products and identifies the essential roles, skills, standards, and tools for DQA in RDRs. By comparing DQAM with existing DQA models, the study highlights its potential to improve these models by adding a specific DQA activity structure. The theoretical implication of the study is a systematic conceptualization of DQA work in RDRs that is grounded in a comprehensive analysis of the literature and offers a refined conceptualization of DQA integration into broader frameworks of RDR evaluation. In practice, DQAM can inform the design and development of DQA workflows and tools. As a future research direction, the study suggests applying and evaluating DQAM across various domains to validate and refine this model further. Besiki Stvilia, Yuanying Pang, Dong Joon Lee, Fatih Gunaydin |
J. Assoc. Inf. Sci. Technol. | 1 |
| 2023 | Developing a platform-specific framework for web credibility assessment: A case of social Q&A sites
Wonchan Choi, Besiki Stvilia, Hyun Seung Lee |
Inf. Process. Manag. | 2 |
| 2023 | The structure and priorities of researchers' scholarly profile maintenance activities: A case of institutional research information management systemabstractAbstract Research information management systems (RIMS) have become critical components of information technology infrastructure on university campuses. They are used not just for sharing and promoting faculty research, but also for conducting faculty evaluation and development, facilitating research collaborations, identifying mentors for student projects, and expert consultants for local businesses. This study is one of the first empirical investigations of the structure of researchers' scholarly profile maintenance activities in a nonmandatory institutional RIMS. By analyzing the RIMS's log data, we identified 11 tasks researchers performed when updating their profiles. These tasks were further grouped into three activities: (a) adding publication, (b) enhancing researcher identity, and (c) improving research discoverability. In addition, we found that junior researchers and female researchers were more engaged in maintaining their RIMS profiles than senior researchers and male researchers. The results provide insights for designing profile maintenance action templates for institutional RIMS that are tailored to researchers' characteristics and help enhance researchers' engagement in the curation of their research information. This also suggests that female and junior researchers can serve as early adopters of institutional RIMS. Dong Joon Lee, Besiki Stvilia, Seungyeon Ha, Douglas C. Hahn |
J. Assoc. Inf. Sci. Technol. | 2 |
| 2021 | "Striking out on your own" - A study of research information management problems on university campusesabstractAbstract Here, we report on a qualitative study that examined research information management (RIM) ecosystems on research university campuses from the perspectives of research information (RI) managers and librarians. In the study, we identified 21 RIM services offered to researchers, ranging from discovering, storing, and sharing authored content to identifying expertise, recruiting faculty, and ensuring the diversity of committee assignments. In addition, we identified 15 types of RIM service provision and adoption problems, analyzed their activity structures, and connected them to strategies for their resolution. Finally, we report on skills that the study participants reported as being needed in their work. These findings can inform the development of best practice guides for RIM on university campuses. The study also advances the state of the art of RIM research by applying the typology of contradictions from activity theory to categorize the problems of RIM service provision and connect their resolution to theories and findings of prior studies in the literature. In this way, the research expands the theoretical base used to study RIM in general and RIM at research universities in particular. Besiki Stvilia, Dong Joon Lee, Na-eun Han |
J. Assoc. Inf. Sci. Technol. | 1 |
| 2018 | Researchers' uses of and disincentives for sharing their research identity information in research information management systemsabstractThis study examined how researchers used research information systems (RIMSs) and the relationships among researchers' seniority, discipline, and types and extent of RIMS use. Most researchers used RIMSs to discover research content. Fewer used RIMSs for sharing and promoting their research. Early career researchers were more frequent users of RIMSs than were associate and full professors. Likewise, assistant professors and postdocs exhibited a higher probability of using RIMSs to promote their research than did students and full professors. Humanities researchers were the least frequent users of RIMSs. Moreover, humanities scholars used RIMSs to evaluate research less than did scholars in other disciplines. The tasks of discovering papers, monitoring the literature, identifying potential collaborators, and promoting research were predictors of higher RIMS use. Researchers who engaged in promoting their research, evaluating research, or monitoring the literature showed a greater propensity to have a public RIMS profile. Furthermore, researchers mostly agreed that not being required, having no effect on their status, not being useful, or not being a norm were reasons for not having a public RIMS profile. Humanities scholars were also more likely than social scientists to agree that having a RIMS profile was not a norm in their fields. Besiki Stvilia, Shuheng Wu, Dong Joon Lee |
J. Assoc. Inf. Sci. Technol. | 1 |
| 2015 | Web credibility assessment: Conceptualization, operationalization, variability, and modelsabstractThis article reviews theoretical and empirical studies on information credibility, with particular questions as to how scholars have conceptualized credibility, which is known as a multifaceted concept with underlying dimensions; how credibility has been operationalized and measured in empirical studies, especially in the web context; what are the important user characteristics that contribute to the variability of web credibility assessment; and how the process of web credibility assessment has been theorized. An agenda for future research on information credibility is also discussed. Wonchan Choi, Besiki Stvilia |
J. Assoc. Inf. Sci. Technol. | 2 |
| 2015 | Research project tasks, data, and perceptions of data quality in a condensed matter physics communityabstractTo be effective and at the same time sustainable, a community data curation model needs to be aligned with the community's current data practices, including research project activities, data types, and perceptions of data quality. Based on a survey of members of the condensed matter physics (CMP) community gathered around the National High Magnetic Field Laboratory, a large national laboratory, this article defines a model of CMP research project tasks consisting of 10 task constructs. In addition, the study develops a model of data quality perceptions by CMP scientists consisting of four data quality constructs. The paper also discusses relationships among the data quality perceptions, project roles, and demographic characteristics of CMP scientists. The findings of the study can inform the design of a CMP data curation model that is aligned and harmonized with the community's research work structure and data practices. Besiki Stvilia, Charles C. Hinnant, Shuheng Wu, Adam Worrall, Dong Joon Lee, Kathleen Burnett, Gary Burnett, Michelle M. Kazmer, Paul F. Marty |
J. Assoc. Inf. Sci. Technol. | 1 |
| 2014 | Assessing the relationships among tag syntax, semantics, and perceived usefulnessabstractWith the recent interest in socially created metadata as a potentially complementary resource for image description in relation to established tools such as thesauri and other forms of controlled vocabulary, questions remain about the quality and reuse value of these metadata. This study describes and examines a set of tags using quantitative and qualitative methods and assesses relationships among categories of image tags, tag assignment order, and users' perceptions of usefulness of index terms and user‐contributed tags. The study found that tags provide much descriptive information about an image but that users also value and trust controlled vocabulary terms. The study found no correlation between tag length and assignment order, and tag length and its perceived usefulness. The findings of this study can contribute to the design of controlled vocabularies, indexing processes, and retrieval systems for images. In particular, the findings of the study can advance the understanding of image tagging practices, tag facet/category distributions, relative usefulness and importance of these categories to the user, and potential mechanisms for identifying useful terms. Corinne Jörgensen, Besiki Stvilia, Shuheng Wu |
J. Assoc. Inf. Sci. Technol. | 2 |
| 2012 | Prioritization of data quality dimensions and skills requirements in genome annotation workabstractAbstract The rapid accumulation of genome annotations, as well as their widespread reuse in clinical and scientific practice, poses new challenges to management of the quality of scientific data. This study contributes towards better understanding of scientists' perceptions of and priorities for data quality and data quality assurance skills needed in genome annotation. This study was guided by a previously developed general framework for assessment of data quality and by a taxonomy of data‐quality (DQ) skills, and intended to define context‐sensitive models of criteria for data quality and skills for genome annotation. Analysis of the results revealed that genomics scientists recognize specific sets of criteria for quality in the genome‐annotation context. Seventeen data quality dimensions were reduced to 5‐factor constructs, and 17 relevant skills were grouped into 4‐factor constructs. The constructs defined by this study advance the understanding of data quality relationships and are an important contribution to data and information quality research. In addition, the resulting models can serve as valuable resources to genome data curators and administrators for developing data‐curation policies and designing DQ‐assurance strategies, processes, procedures, and infrastructure. The study's findings may also inform educators in developing data quality assurance curricula and training courses. Besiki Stvilia, Corinne Jörgensen, Hank W. Bass |
J. Assoc. Inf. Sci. Technol. | 2 |
| 2011 | Composition of scientific teams and publication productivity at a national science lababstractThe production of scientific knowledge has evolved from a process of inquiry largely based on the activities of individual scientists to one grounded in the collaborative efforts of specialized research teams. This shift brings to light a new question: how the composition of scientific teams affects their production of knowledge. This study employs data from 1,415 experiments conducted at the National High Magnetic Field Laboratory (NHMFL) between 2005 and 2008 to identify and select a sample of 89 teams and examine whether team diversity and network characteristics affect productivity. The study examines how the diversity of science teams along several variables affects overall team productivity. Results indicate several diversity measures associated with network position and team productivity. Teams with mixed institutional associations were more central to the overall network compared with teams that primarily comprised NHMFL's own scientists. Team cohesion was positively related to productivity. The study indicates that high productivity in teams is associated with high disciplinary diversity and low seniority diversity of team membership. Finally, an increase in the share of senior members negatively affects productivity, and teams with members in central structural positions perform better than other teams. Besiki Stvilia, Charles C. Hinnant, Katy Schindler, Adam Worrall, Gary Burnett, Kathleen Burnett, Michelle M. Kazmer, Paul F. Marty |
J. Assoc. Inf. Sci. Technol. | 1 |
| 2010 | Member activities and quality of tags in a collection of historical photographs in FlickrabstractAbstract To enable and guide effective metadata creation it is essential to understand the structure and patterns of the activities of the community around the photographs, resources used, and scale and quality of the socially created metadata relative to the metadata and knowledge already encoded in existing knowledge organization systems. This article presents an analysis of Flickr member discussions around the photographs of the Library of Congress photostream in Flickr. The article also reports on an analysis of the intrinsic and relational quality of the photostream tags relative to two knowledge organization systems: the Thesaurus for Graphic Materials (TGM) and the Library of Congress Subject Headings (LCSH). Thirty seven percent of the original tag set and 15.3% of the preprocessed set (after the removal of tags with fewer than three characters and URLs) were invalid or misspelled terms. Nouns, named entity terms, and complex terms constituted approximately 77% of the preprocessed set. More than a half of the photostream tags were not found in the TGM and LCSH, and more than a quarter of those terms were regular nouns and noun phrases. This suggests that these terms could be complimentary to more traditional methods of indexing using controlled vocabularies. Besiki Stvilia, Corinne Jörgensen |
J. Assoc. Inf. Sci. Technol. | 1 |
| 2009 | A model for online consumer health information qualityabstractAbstract This article describes a model for online consumer health information consisting of five quality criteria constructs. These constructs are grounded in empirical data from the perspectives of the three main sources in the communication process: health information providers, consumers, and intermediaries, such as Web directory creators and librarians, who assist consumers in finding healthcare information. The article also defines five constructs of Web page structural markers that could be used in information quality evaluation and maps these markers to the quality criteria. Findings from correlation analysis and multinomial logistic tests indicate that use of the structural markers depended significantly on the type of Web page and type of information provider. The findings suggest the need to define genre‐specific templates for quality evaluation and the need to develop models for an automatic genre‐based classification of health information Web pages. In addition, the study showed that consumers may lack the motivation or literacy skills to evaluate the information quality of health Web pages, which suggests the need to develop accessible automatic information quality evaluation tools and ontologies. Besiki Stvilia, Lorri Mon, Yong Jeong Yi |
J. Assoc. Inf. Sci. Technol. | 1 |
| 2008 | Information quality work organization in wikipediaabstractAbstract The classic problem within the information quality (IQ) research and practice community has been the problem of defining IQ. It has been found repeatedly that IQ is context sensitive and cannot be described, measured, and assured with a single model. There is a need for empirical case studies of IQ work in different systems to develop a systematic knowledge that can then inform and guide the construction of context‐specific IQ models. This article analyzes the organization of IQ assurance work in a large‐scale, open, collaborative encyclopedia—Wikipedia. What is special about Wikipedia as a resource is that the quality discussions and processes are strongly connected to the data itself and are accessible to the general public. This openness makes it particularly easy for researchers to study a particular kind of collaborative work that is highly distributed and that has a particularly substantial focus, not just on error detection but also on error correction. We believe that the study of those evolving debates and processes and of the IQ assurance model as a whole has useful implications for the improvement of quality in other more conventional databases. Besiki Stvilia, Michael B. Twidale, Linda C. Smith, Les Gasser |
J. Assoc. Inf. Sci. Technol. | 1 |
| 2007 | A framework for information quality assessmentabstractAbstract One cannot manage information quality (IQ) without first being able to measure it meaningfully and establishing a causal connection between the source of IQ change, the IQ problem types, the types of activities affected, and their implications. In this article we propose a general IQ assessment framework. In contrast to context‐specific IQ assessment models, which usually focus on a few variables determined by local needs, our framework consists of comprehensive typologies of IQ problems, related activities, and a taxonomy of IQ dimensions organized in a systematic way based on sound theories and practices. The framework can be used as a knowledge resource and as a guide for developing IQ measurement models for many different settings. The framework was validated and refined by developing specific IQ measurement models for two large‐scale collections of two large classes of information objects: Simple Dublin Core records and online encyclopedia articles. Besiki Stvilia, Les Gasser, Michael B. Twidale, Linda C. Smith |
J. Assoc. Inf. Sci. Technol. | 1 |