Demo Data from SIGIR 2026 / reviewers in the wild / expert
Justin Emile Gottschlich
dblp:56/2013 · also Justin Gottschlich
· DBLP profile ↗
13ranked-venue papers
4as first author
2since 2021 · last 2025
0000-0003-2742-9205ORCID · conflict
Domains — the database's venue-derived domains; a paper can count in several
Systems, architecture and hardware · 8 · 4 first-authorArtificial intelligence and machine learning · 3 · 1 since 2021Software engineering, systems software and programming languages · 3 · 1 first-authorDatabases, data management, data science and information retrieval · 2 · 2 since 2021Theory of computation · 1
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Software engineering, system software, and programming languages
3 papers |
Debugging and program repair · 35% Program synthesis and code generation · 27% Software testing · 18% | |
| Artificial intelligence
2 papers |
Language models and text generation · 62% Trustworthy machine learning · 24% Multi-agent systems · 14% | |
| Computer architecture, parallel and distributed computing, and storage systems
3 papers |
Processor architecture and microarchitecture · 47% Parallel and multicore computing · 29% Memory systems · 16% | |
| Databases, data mining, and information retrieval
2 papers |
Data mining · 40% Information retrieval · 40% Machine learning and data management · 21% |
Topics — the 21 heaviest of 26, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation
LLM agents |
0.9 | 1 | 2025 | Agentic AI for Enterprise: Emerging Applications and Real-world Challenges · KDD (2) 2025 |
Machine learning › Trustworthy machine learning › robustness
neural network verification |
0.4 | 1 | 2020 | An Abstraction-Based Framework for Neural Network Verification · CAV (1) 2020 |
Debugging and program repair
fault localization |
0.4 | 1 | 2019 | A Zero-Positive Learning Approach for Diagnosing Software Performance Regressions · NeurIPS 2019 |
Debugging and program repair › performance debugging
performance bug diagnosis |
0.4 | 1 | 2019 | A Zero-Positive Learning Approach for Diagnosing Software Performance Regressions · NeurIPS 2019 |
Software testing › regression testing
performance regression testing |
0.4 | 1 | 2019 | A Zero-Positive Learning Approach for Diagnosing Software Performance Regressions · NeurIPS 2019 |
Data mining
anomaly detection |
0.3 | 1 | 2018 | Precision and Recall for Time Series · NeurIPS 2018 |
Natural language and speech › Language models and text generation
large language model |
0.3 | 1 | 2025 | Agentic AI for Enterprise: Emerging Applications and Real-world Challenges · KDD (2) 2025 |
Knowledge, reasoning and agents › Multi-agent systems
multi-agent collaboration |
0.3 | 1 | 2025 | Agentic AI for Enterprise: Emerging Applications and Real-world Challenges · KDD (2) 2025 |
Parallel and multicore computing › parallel computing › parallel program debugging
deterministic replay |
0.2 | 2 | 2013 | QuickRec: prototyping an intel architecture extension for record and replay of multithreaded programs · ISCA 2013 CoreRacer: a practical memory race recorder for multicore x86 TSO processors · MICRO 2011 |
Empirical software engineering › developer studies › developer behavior
developer productivity |
0.2 | 1 | 2022 | Machine Programming: Turning Data into Programmer Productivity · Proc. VLDB Endow. 2022 |
Processor architecture and microarchitecture › debugging support
hardware-assisted deterministic replay |
0.2 | 1 | 2013 | QuickRec: prototyping an intel architecture extension for record and replay of multithreaded programs · ISCA 2013 |
Processor architecture and microarchitecture
chip multiprocessor |
0.1 | 1 | 2011 | CoreRacer: a practical memory race recorder for multicore x86 TSO processors · MICRO 2011 |
Processor architecture and microarchitecture › multicore design
memory race recording |
0.1 | 1 | 2011 | CoreRacer: a practical memory race recorder for multicore x86 TSO processors · MICRO 2011 |
Processor architecture and microarchitecture
multicore design |
0.1 | 1 | 2011 | CoreRacer: a practical memory race recorder for multicore x86 TSO processors · MICRO 2011 |
Electronic design automation › hardware verification and test › hardware verification
consistency checking |
0.1 | 1 | 2008 | Optimizing consistency checking for memory-intensive transactions · PODC 2008 |
Memory systems › cache coherence
invalidation |
0.1 | 1 | 2008 | Optimizing consistency checking for memory-intensive transactions · PODC 2008 |
Parallel and multicore computing
transactional memory |
0.1 | 1 | 2008 | Optimizing consistency checking for memory-intensive transactions · PODC 2008 |
Parallel and multicore computing › thread-level parallelism
multithreaded applications |
0.0 | 1 | 2013 | QuickRec: prototyping an intel architecture extension for record and replay of multithreaded programs · ISCA 2013 |
Memory systems › memory consistency
memory consistency model |
0.0 | 1 | 2011 | CoreRacer: a practical memory race recorder for multicore x86 TSO processors · MICRO 2011 |
Memory systems › memory consistency › memory consistency model
total store order |
0.0 | 1 | 2011 | CoreRacer: a practical memory race recorder for multicore x86 TSO processors · MICRO 2011 |
Memory systems
cache coherence |
0.0 | 1 | 2008 | Optimizing consistency checking for memory-intensive transactions · PODC 2008 |
Methods — techniques the papers use, named apart from their topics
machine programming · 1.1large language model · 0.9over-approximation · 0.4counterexample-guided refinement · 0.4zero-positive learning · 0.4hardware telemetry · 0.4autoencoder · 0.4precision-recall evaluation · 0.3hardware prototyping · 0.3hardware race recording · 0.1
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | Agentic AI for Enterprise: Emerging Applications and Real-world ChallengesabstractLarge language models (LLMs) have revolutionized natural language processing, enabling unprecedented capabilities in reasoning, planning, and tool utilization. Enterprises are increasingly adopting LLM-powered agents to automate complex workflows, from meeting summarization (e.g., Microsoft Copilot) to supply chain optimization and customer service orchestration. However, deploying agentic AI systems in enterprise settings introduces unique challenges, including decision making under uncertainty, multi-agent collaboration, security vulnerabilities, and trust gaps in mission-critical applications. This workshop aims to bridge the gap between academia and industry to explore LLM-driven agentic systems tailored for enterprise needs. We focus on three pillars: 1) emerging architectures that enable dynamic task decomposition and tool invocation; 2) domain-specific applications such as case studies in supply chain and employee productivity domain; 3) evaluation and governance such as the AAEF (Agentic Application Evaluation Framework) and security strategies. Anbang Xu, Min Du 0003, Meghana Puvvadi, Tao Yu 0009, Justin Emile Gottschlich |
KDD (2) | 8 |
| 2022 | Machine Programming: Turning Data into Programmer ProductivityabstractMachine programming is an emerging research area that improves the software development life cycle from design through deployment. We present a tutorial on machine programming research highlighting aspects relevant to the data systems community. We divide this tutorial into three parts: We begin with an introduction to machine programming introducing its three pillars: intention, invention, and adaptation. Then, we provide an overview of the data ecosystem central to all machine programming systems, highlighting challenges and novel opportunities relevant to the data systems community. Finally, we describe recent advances in machine programming research and how these directions use various data sets to improve the ease of creating and maintaining performant software systems. Abdul Wasay, Nesime Tatbul, Justin Emile Gottschlich |
Proc. VLDB Endow. | 3 |
| 2020 | An Abstraction-Based Framework for Neural Network VerificationabstractDeep neural networks are increasingly being used as controllers for safety-critical systems. Because neural networks are opaque, certifying their correctness is a significant challenge. To address this issue, several neural network verification approaches have recently been proposed. However, these approaches afford limited scalability, and applying them to large networks can be challenging. In this paper, we propose a framework that can enhance neural network verification techniques by using over-approximation to reduce the size of the network—thus making it more amenable to verification. We perform the approximation such that if the property holds for the smaller (abstract) network, it holds for the original as well. The over-approximation may be too coarse, in which case the underlying verification tool might return a spurious counterexample. Under such conditions, we perform counterexample-guided refinement to adjust the approximation, and then repeat the process. Our approach is orthogonal to, and can be integrated with, many existing verification techniques. For evaluation purposes, we integrate it with the recently proposed Marabou framework, and observe a significant improvement in Marabou’s performance. Our experiments demonstrate the great potential of our approach for verifying larger neural networks. Yizhak Yisrael Elboher, Justin Emile Gottschlich, Guy Katz |
CAV (1) | 2 |
| 2019 | A Zero-Positive Learning Approach for Diagnosing Software Performance RegressionsabstractThe field of machine programming (MP), the automation of the development of software, is making notable research advances. This is, in part, due to the emergence of a wide range of novel techniques in machine learning. In this paper, we apply MP to the automation of software performance regression testing. A performance regression is a software performance degradation caused by a code change. We present AutoPerf – a novel approach to automate regression testing that utilizes three core techniques: (i) zero-positive learning, (ii) autoencoders, and (iii) hardware telemetry. We demonstrate AutoPerf’s generality and efficacy against 3 types of performance regressions across 10 real performance bugs in 7 benchmark and open-source programs. On average, AutoPerf exhibits 4% profiling overhead and accurately diagnoses more performance bugs than prior state-of-the-art approaches. Thus far, AutoPerf has produced no false negatives. Mejbah Alam, Justin Emile Gottschlich, Nesime Tatbul, Javier Turek, Timothy G. Mattson, Abdullah Muzahid |
NeurIPS | 2 |
| 2018 | Precision and Recall for Time SeriesabstractClassical anomaly detection is principally concerned with point-based anomalies, those anomalies that occur at a single point in time. Yet, many real-world anomalies are range-based, meaning they occur over a period of time. Motivated by this observation, we present a new mathematical model to evaluate the accuracy of time series classification algorithms. Our model expands the well-known Precision and Recall metrics to measure ranges, while simultaneously enabling customization support for domain-specific preferences. Nesime Tatbul, Tae Jun Lee, Stanley B. Zdonik, Mejbah Alam, Justin Emile Gottschlich |
NeurIPS | 5 |
| 2015 | TSXProf: Profiling Hardware TransactionsabstractThe availability of commercial hardware transactionalmemory (TM) systems has not yet been met with a rise in the numberof large-scale programs that use memory transactions explicitly. Asignificant impediment to the use of TM is the lack of tool support, specifically profilers that can identify and explain performance anomalies. In this paper, we introduce an end-to-end system that enables lowoverheadperformance profiling of large-scale transactional programs. We present algorithms and an implementation for Intel's Haswellprocessors. With our system, it is possible to record a transactionalprogram's execution with minimal overhead, and then replay it withina custom profiling tool to identify causes of contention and aborts, down to the granularity of individual memory accesses. Evaluationshows that our algorithms have low overhead, and our tools enableprogrammers to effectively explain performance anomalies. Yujie Liu 0003, Justin Emile Gottschlich, Gilles Pokam, Michael F. Spear |
PACT | 2 |
| 2014 | Invyswell: a hybrid transactional memory for haswell's restricted transactional memoryabstractThe Intel Haswell processor includes restricted transactional memory (RTM), which is the first commodity-based hardware transactional memory (HTM) to become publicly available. However, like other real HTMs, such as IBM's Blue Gene/Q, Haswell's RTM is best-effort, meaning it provides no transactional forward progress guarantees. Because of this, a software fallback system must be used in conjunction with Haswell's RTM to ensure transactional programs execute to completion. To complicate matters, Haswell does not provide escape actions. Without escape actions, non-transactional instructions cannot be executed within the context of a hardware transaction, thereby restricting the ways in which a software fallback can interact with the HTM. As such, the challenge of creating a scalable hybrid TM (HyTM) that uses Haswell's RTM and a software TM (STM) fallback is exacerbated. Irina Calciu, Justin Emile Gottschlich, Tatiana Shpeisman, Gilles Pokam, Maurice Herlihy |
PACT | 2 |
| 2013 | Concurrent predicates: A debugging technique for every parallel programmerabstractTo reduce the complexity of debugging multithreaded programs, researchers have developed many techniques that automatically detect bugs that arise from shared memory errors. These techniques can identify a wide range of bugs, but it can be challenging for a programmer to reproduce a specific bug that he or she is interested in using such techniques. This is because these techniques were not intended for individual bug reproduction but rather an exploratory search for possible bugs. To address this concern we present concurrent predicates (CPs) and concurrent predicate expressions (CPEs), which allow programmers to single out a specific bug by specifying the schedule and program state that must be satisfied for the bug to be reproduced. We present the recipes, that is, the mechanical processes, we use to reproduce data races, atomicity violations, and deadlocks with CP and CPE. We then show how these recipes apply to the diagnosis and reproduction of bugs from 13 handcrafted bugs, five real-world application bugs from RADBench, and three previously unresolved bugs from TBoost.STM, which now includes the fixes we generated using CP and CPE. Justin Emile Gottschlich, Gilles Pokam, Cristiano Pereira, Youfeng Wu |
PACT | 1 |
| 2013 | QuickRec: prototyping an intel architecture extension for record and replay of multithreaded programsabstractThere has been significant interest in hardware-assisted deterministic Record and Replay (RnR) systems for multithreaded programs on multiprocessors. However, no proposal has implemented this technique in a hardware prototype with full operating system support. Such an implementation is needed to assess RnR practicality. Gilles Pokam, Klaus Danne, Cristiano Pereira, Rolf Kassa, Tim Kranich, Shiliang Hu, Justin Emile Gottschlich, Nima Honarmand, Nathan Dautenhahn, Samuel T. King, Josep Torrellas |
ISCA | 7 |
| 2012 | Visualizing transactional memoryabstractThis paper presents TMProf, a transactional memory (TM) profiler, based on three visualization principles. These principles are (i) the precise graphical representation of transaction interactions including cross-correlated information and source code, (ii) visualized soft real-time playback of concurrently executing transactions, and (iii) dynamic visualizations of multiple executions. We describe how these principles break new ground and create new challenges for TM profilers. Justin Emile Gottschlich, Maurice Herlihy, Gilles Pokam, Jeremy G. Siek |
PACT | 1 |
| 2011 | CoreRacer: a practical memory race recorder for multicore x86 TSO processorsabstractShared memory multiprocessors are difficult to program because of the non-deterministic ways in which the memory operations from different threads interleave. To address this issue, many hardware-based memory race recorders have been proposed that efficiently log an ordering of the shared memory interleavings between threads for deterministic replay. These approaches are challenging to integrate into current processors because they change the cache subsystem or the coherence protocol, and they mostly support a sequentially consistent memory model. Gilles Pokam, Cristiano Pereira, Shiliang Hu, Ali-Reza Adl-Tabatabai, Justin Emile Gottschlich, Youfeng Wu |
MICRO | 5 |
| 2010 | An efficient software transactional memory using commit-time invalidationabstractTo improve the performance of transactional memory (TM), researchers have found many eager and lazy optimizations for conflict detection, the process of determining if transactions can commit. Despite these optimizations, nearly all TMs perform one aspect of lazy conflict detection in the same manner to preserve serializability. That is, they perform commit-time validation, where a transaction is checked for conflicts with previously committed transactions during its commit phase. While commit-time validation is efficient for workloads that exhibit limited contention, it can limit transaction throughput for contending workloads. Justin Emile Gottschlich, Manish Vachharajani, Jeremy G. Siek |
CGO | 1 |
| 2008 | Optimizing consistency checking for memory-intensive transactionsabstractTransactional memory (TM) reduces parallel programming complexity while maintaining multi-threaded performance benefits. Consistency checking, the way memory conflicts are found in TM, is critical to performance and is executed through either validation or invalidation. We present a unique invalidation algorithm which boasts high transactional throughput for memory-intensive transactions. Justin Emile Gottschlich, Daniel A. Connors |
PODC | 1 |