Identifying acute events as they occur is challenging in large hospital systems. Here, we describe an automated method to detect 2 rare adverse drug events (ADEs), drug-induced torsades de pointes and Stevens-Johnson syndrome and toxic epidermal necrolysis, in near real time for participant recruitment into prospective clinical studies. A text processing system searched clinical notes from the electronic health record (EHR) for relevant keywords and alerted study personnel via email of potential patients for chart review or in-person evaluation. Between 2016 and 2018, the automated recruitment system resulted in capture of 138 true cases of drug-induced rare events, improving recall from 43% to 93%. Our focused electronic alert system maintained 2-year enrollment, including across an EHR migration from a bespoke system to Epic. Real-time monitoring of EHR notes may accelerate research for certain conditions less amenable to conventional study recruitment paradigms.

OBJECTIVE: The goal of this study was to develop a practical framework for recognizing and disambiguating clinical abbreviations, thereby improving current clinical natural language processing (NLP) systems' capability to handle abbreviations in clinical narratives. METHODS: We developed an open-source framework for clinical abbreviation recognition and disambiguation (CARD) that leverages our previously developed methods, including: (1) machine learning based approaches to recognize abbreviations from a clinical corpus, (2) clustering-based semiautomated methods to generate possible senses of abbreviations, and (3) profile-based word sense disambiguation methods for clinical abbreviations. We applied CARD to clinical corpora from Vanderbilt University Medical Center (VUMC) and generated 2 comprehensive sense inventories for abbreviations in discharge summaries and clinic visit notes. Furthermore, we developed a wrapper that integrates CARD with MetaMap, a widely used general clinical NLP system. RESULTS AND CONCLUSION: CARD detected 27 317 and 107 303 distinct abbreviations from discharge summaries and clinic visit notes, respectively. Two sense inventories were constructed for the 1000 most frequent abbreviations in these 2 corpora. Using the sense inventories created from discharge summaries, CARD achieved an F1 score of 0.755 for identifying and disambiguating all abbreviations in a corpus from the VUMC discharge summaries, which is superior to MetaMap and Apache's clinical Text Analysis Knowledge Extraction System (cTAKES). Using additional external corpora, we also demonstrated that the MetaMap-CARD wrapper improved MetaMap's performance in recognizing disorder entities in clinical notes. The CARD framework, 2 sense inventories, and the wrapper for MetaMap are publicly available at https://sbmi.uth.edu/ccb/resources/abbreviation.htm . We believe the CARD framework can be a valuable resource for improving abbreviation identification in clinical NLP systems.

OBJECTIVE: To determine whether assisted annotation using interactive training can reduce the time required to annotate a clinical document corpus without introducing bias. MATERIALS AND METHODS: A tool, RapTAT, was designed to assist annotation by iteratively pre-annotating probable phrases of interest within a document, presenting the annotations to a reviewer for correction, and then using the corrected annotations for further machine learning-based training before pre-annotating subsequent documents. Annotators reviewed 404 clinical notes either manually or using RapTAT assistance for concepts related to quality of care during heart failure treatment. Notes were divided into 20 batches of 19-21 documents for iterative annotation and training. RESULTS: The number of correct RapTAT pre-annotations increased significantly and annotation time per batch decreased by ~50% over the course of annotation. Annotation rate increased from batch to batch for assisted but not manual reviewers. Pre-annotation F-measure increased from 0.5 to 0.6 to >0.80 (relative to both assisted reviewer and reference annotations) over the first three batches and more slowly thereafter. Overall inter-annotator agreement was significantly higher between RapTAT-assisted reviewers (0.89) than between manual reviewers (0.85). DISCUSSION: The tool reduced workload by decreasing the number of annotations needing to be added and helping reviewers to annotate at an increased rate. Agreement between the pre-annotations and reference standard, and agreement between the pre-annotations and assisted annotations, were similar throughout the annotation process, which suggests that pre-annotation did not introduce bias. CONCLUSIONS: Pre-annotations generated by a tool capable of interactive training can reduce the time required to create an annotated document corpus by up to 50%.

Electronic health record (EHR) systems are increasingly being adopted in pediatric practices; however, requirements for integrated growth charts are poorly described and are not standardized in current systems. The authors integrated growth chart functionality into an EHR system being developed and installed in a multispecialty pediatric clinic in an academic medical center. During a three-year observation period, rates of electronically documented values for weight, stature, and head circumference increased from fewer than ten total per weekday, up to 488 weight values, 293 stature values, and 74 head circumference values (p<0.001 for each measure). By the end of the observation period, users accessed the growth charts an average 175 times per weekday, compared to 127 patient visits per weekday to the sites that most closely monitored pediatric growth. Because EHR systems and integrated growth charts can manipulate data, perform calculations, and adapt to user preferences and patient characteristics, users may expect greater functionality from electronic growth charts than from paper-based growth charts.

OBJECTIVE: Authors evaluated whether displaying context sensitive links to infrequently accessed educational materials and patient information via the user interface of an inpatient computerized care provider order entry (CPOE) system would affect access rates to the materials. DESIGN: The CPOE of Vanderbilt University Hospital (VUH) included "baseline" clinical decision support advice for safety and quality. Authors augmented this with seven new primarily educational decision support features. A prospective, randomized, controlled trial compared clinicians' utilization rates for the new materials via two interfaces. Control subjects could access study-related decision support from a menu in the standard CPOE interface. Intervention subjects received active notification when study-related decision support was available through context sensitive, visibly highlighted, selectable hyperlinks. MEASUREMENTS: Rates of opportunities to access and utilization of study-related decision support materials from April 1999 through March 2000 on seven VUH Internal Medicine wards. RESULTS: During 4,466 intervention subject-days, there were 240,504 (53.9/subject-day) opportunities for study-related decision support, while during 3,397 control subject-days, there were 178,235 (52.5/subject-day) opportunities for such decision support, respectively (p = 0.11). Individual intervention subjects accessed the decision support features at least once on 3.8% of subject-days logged on (278 responses); controls accessed it at least once on 0.6% of subject-days (18 responses), with a response rate ratio adjusted for decision support frequency of 9.17 (95% confidence interval 4.6-18, p < 0.0005). On average, intervention subjects accessed study-related decision support materials once every 16 days individually and once every 1.26 days in aggregate. CONCLUSION: Highlighting availability of context-sensitive educational materials and patient information through visible hyperlinks significantly increased utilization rates for study-related decision support when compared to "standard" VUH CPOE methods, although absolute response rates were low.

One-way constraints have been incorporated in many graphical user interface toolkits because they are simple to learn, easy to write, and can express many types of useful graphical relationships. This paper is an evaluative paper that examines users' experience with one-way constraints in two user interface development toolkits, Garnet and Amulet, over a 15-year time span. The lessons gained from this examination can help guide the design of future constraint systems. The most important lessons are that (1) constraints should be allowed to contain arbitrary code that is written in the underlying toolkit language and does not require any annotations, such as parameter declarations, (2) constraints are difficult to debug and better debugging tools are needed, and (3) programmers will readily use one-way constraints to specify the graphical layout of an application, but must be carefully and time-consumingly trained to use them for other purposes. Copyright © 2005 John Wiley & Sons, Ltd.

One-way, dataflow constraints are commonly used in graphical interface toolkits, programming environments, and circuit applications. Previous papers on dataflow constraints have focused on the design and implementation of individual algorithms. In contrast, this article focuses on the lessons we have learned from a decade of implementing competing algorithms in the Garnet and Amulet graphical interface toolkits. These lessons reveal the design and implementation tradeoffs for different one-way, constraint satisfaction algorithms. The most important lessons we have learned are that (1) mark-sweep algorithms are more efficient than topological ordering algorithms; (2) lazy and eager evaluators deliver roughly comparable performance for most applications; and (3) constraint satisfaction algorithms have more than adequate speed, except that the storage required by these algorithms can be problematic.

OBJECTIVE: Refine the understanding of the desirable skills for health sciences librarians as a basis for developing a training program model that reflects the fundamental changes in health care delivery and information technology. DESIGN: A four-step needs assessment process: focus groups developed lists of desirable skills; the research team organized candidate skills into a taxonomy; a survey of a random sample of librarians and library users assessed perception of importance of individual skills; and the research team framed, as a unifying hypothesis, a training model. SURVEY METHODS: The survey was distributed to random samples of 150 librarians, stratified by type of library, and 150 library users, stratified by type of use. A non-randomized sample was obtained by mounting the survey on a World Wide Web server. The survey instrument included 96 distinct skills organized into 13 categories. Respondents rated the importance of each skill on a Likert scale and provided a separate ranking by identifying the ten most important skills for the profession. RESULTS: Among the participants, 51% of librarians and 36% of library users responded to the survey. All categories of skills were rated above the midpoint of priority on the Likert scale. All groups rated personality characteristics and skills as most important, with an understanding of the health sciences, education, and research being rated comparably to technical skills. CONCLUSIONS: Health sciences librarians need a new educational model that provides them with broad-based tools to discover new roles and new resources for acquiring individual skills as the need arises. A unifying training model would involve trainees in developing their learning plan in a way that promotes proactive inquiry and self-directed learning, and it would rotate the trainees through projects to provide skills and an understanding of end-user work processes.

Vanderbilt University Medical Center is implementing an Integrated Advanced Information Management System (IAIMS) using a fast-track approach. The elapsed time between start-up and completion of implementation will be 7.5 years. The Start-Up and Planning phases of the project are complete. The Implementation phase asks one question: How does an organization create an environment that redirects and coordinates a variety of individual activities so that they come together to provide an IAIMS? Four answers to this question are being tested. First, design resources to be "scalable"--i.e., capable of supporting enterprise-wide use. Second, provide information technology planning activities as ongoing core functions that direct local efforts. Third, design core infrastructure resources to be both reusable and expandable at the local level. Fourth, use milestones to measure progress toward selected endpoints to permit early refinement of plans and strategies.

OBJECTIVE: Evaluate the effects of long-term maintenance activities on existing portions of a large internal medicine knowledge base. DESIGN: Five physicians who were not among the original developers of the knowledge base independently updated a total of 15 QMR disease profiles; each updated submission was modified by a review of group serving as the "gold standard, " and the pre- and post-study versions of each updated disease profile were compared. MEASUREMENTS: Numbers and types of changes, defined as any difference between the original version and the final version of a disease profile; reason for each change; and bibliographic references cited by the physicians as supporting evidence. RESULTS: A total of 16% of all entries were modified by the updating process; up to 95% of the entries in a disease profile were affected. The two most common modifications were changes to the frequency of an entry, and creation of a new entry. Laboratory findings were affected much more often than were history, symptom, or physical exam findings. The dominant reason for changes was appearance of new evidence in the medical literature. The literature cited ranged from 1944 to the present. CONCLUSIONS: This study provides an evaluation of the rate of change within the QMR medical knowledge base due to long-term maintenance. The results show that this is a demanding activity that may profoundly affect certain portions of a knowledge base, and that different types of knowledge (e.g., simple laboratory vs expensive or invasive laboratory findings) are affected by the process in different ways.

OBJECTIVE: To examine the information needs of health care professionals in HIV-related clinical encounters, and to determine the suitability of existing information sources to address those needs. SETTING: HIV outpatient clinic. PARTICIPANTS: Seven health care professionals with diverse training and patient care involvement. METHODS: Based on patient charts describing 120 patient encounters, participants generated 266 clinical questions. Printed and on-line information sources were used to answer questions in two phases: using commonly available sources and using all available medical library sources. MEASUREMENTS: The questions were divided into 16 categories by subject. The number of questions answered, their categories, the information source(s) providing answers, and the time required to answer questions were recorded for each phase. RESULTS: Each participant generated an average of 3.8 clinical questions per chart. Five categories accounted for almost 75% of all questions; the treatment protocols/regimens category was most frequent (24%). A total of 245 questions (92%) were answered, requiring an average of 15 minutes per question. Most (87%) of the questions were answered via electronic sources, even though paper sources were consulted first. CONCLUSIONS: The participating professionals showed considerable information needs. A combination of on-line and paper sources was necessary to provide the answers. The study suggests that present-day information sources are not entirely satisfactory for answering clinical questions generated by examining charts of HIV-infected patients.

Pointer variables have long been considered useful for constructing and manipulating data structures in traditional programming languages. This article discusses how pointer variables can be integrated into one-way constraint models and indicates how these constraints can be usefully employed in user interfaces. Pointer variables allow constraints to model a wide array of dynamic application behavior, simplify the implementation of structured objects and demonstrational systems, and improve the storage and efficiency of constraint-based applications. This article presents two incremental algorithms—one lazy and one eager— for solving constraints with pointer variables. Both algorithms are capable of handling (1) arbitrary systems of one-way constraints, including constraints that involve cycles, and (2) editing models that allow multiple changes between calls to the constraint solver. These algorithms are fault tolerant in that they can handle and recover gracefully from formulas that crash due to programmer error. Constraints that use pointer variables have been implemented in a comprehensive user interface toolkit, Garnet, and our experience with applications written in Garnet have proven the usefulness of pointer variable constraints. Many large-scale applications have been implemented using these constraints.

article Free Access Share on Declarative programming in a prototype-instance system: object-oriented programming without writing methods Authors: Brad A. Myers View Profile , Dario A. Giuse View Profile , Brad Vander Zanden View Profile Authors Info & Claims ACM SIGPLAN NoticesVolume 27Issue 10Oct. 1992 pp 184–200https://doi.org/10.1145/141937.141953Online:31 October 1992Publication History 37citation558DownloadsMetricsTotal Citations37Total Downloads558Last 12 Months14Last 6 weeks3 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteeReaderPDF

Graphical tools are increasingly using constraints to specify the graphical layout and behavior of many parts of an application.However, conventional constraints directly encode the objects they reference, and thus cannot provide support for the dynamic rttntime creation and manipulation of application objects.This paper discusses an extension to current constraint models that allows constraints to indirectly reference objects through pointer variables.Pointer variables permit programmers to create the constraint equivalent of procedures in traditional programming languages.This procedural abstraction allows constraints to model a wide array of dynamic application behavior, simplifies the implementation of structured object and demonstrational systems, and improves the storage and efficiency of highly interactive, graphical applications.It also promotes a simpler, more effective style of programming than conventional constraints.Constraints that use pointer variables are powerful enough to allow a comprehensive user interface toolkit to be built for the first time on top of a constraint system.