Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Jerry O. Talton

dblp:67/6796 · DBLP profile ↗
← Back
14ranked-venue papers
6as first author
2since 2021 · last 2026
0009-0007-0908-5388ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Human-computer interaction and ubiquitous computing · 9 · 4 first-author · 2 since 2021Graphics, computer vision, multimedia, augmented reality and games · 4 · 2 first-authorArtificial intelligence and machine learning · 2

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Databases, data mining, and information retrieval
4 papers
Information retrieval · 35% Recommender systems · 34% Web and social media mining · 28%
Human-computer interaction and pervasive computing
6 papers
Usability and user experience research · 36% User interface design and tools · 32% Design research and methods · 32%
Interdisciplinary, comprehensive, and emerging computing
1 paper
Computing education · 100%
Computer graphics and multimedia
3 papers
Computer animation and physical simulation · 53% Geometric modeling and processing · 47%
Theoretical computer science
1 paper
Algorithms and data structures · 100%

Topics — the 14 heaviest of 19, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Computing education
programming education
1.012026
From Code Generation to Conceptual Learning: Student Use of LLMs in a Web Programming Course · CHI 2026
Information retrieval
ranking
0.412019
How do People Sort by Ratings? · CHI 2019
Usability and user experience research
user perception
0.412019
How do People Sort by Ratings? · CHI 2019
Design research and methods › computational design
data-driven design
0.212013
Webzeitgeist: design mining the web · CHI 2013
Geometric modeling and processing
procedural modeling
0.112011
Metropolis procedural modeling · ACM Trans. Graph. 2011
Algorithms and data structures › combinatorial algorithms
tree matching
0.112011
Flexible Tree Matching · IJCAI 2011
Recommender systems
rating aggregation
0.112019
How do People Sort by Ratings? · CHI 2019
Computer animation and physical simulation
fluid simulation
0.112008
Two-Way Coupled SPH and Particle Level Set Fluid Simulation · IEEE Trans. Vis. Comput. Graph. 2008
Computer animation and physical simulation › fluid simulation › particle-based fluid simulation
smoothed particle hydrodynamics
0.112008
Two-Way Coupled SPH and Particle Level Set Fluid Simulation · IEEE Trans. Vis. Comput. Graph. 2008
Computer animation and physical simulation › fluid simulation › solid-fluid coupling
two-way coupling
0.112008
Two-Way Coupled SPH and Particle Level Set Fluid Simulation · IEEE Trans. Vis. Comput. Graph. 2008
Web and social media mining
web page analysis
0.012013
Webzeitgeist: design mining the web · CHI 2013
User interface design and tools › authoring tools
generative design tools
0.012012
Learning design patterns with bayesian grammar induction · UIST 2012
Data integration and cleaning
schema matching
0.012011
Flexible Tree Matching · IJCAI 2011
Design research and methods › participatory design
community-based design
0.012009
Exploratory modeling with collaborative design spaces · ACM Trans. Graph. 2009

Methods — techniques the papers use, named apart from their topics

open coding · 1.0chat log analysis · 1.0statistical ordering · 0.8online study · 0.8crowd workers · 0.8large-scale data mining · 0.3knowledge discovery · 0.3ranking algorithm · 0.2network structure analysis · 0.2structured concept learning · 0.1natural language processing · 0.1data-driven design · 0.1bayesian grammar induction · 0.1structured prediction · 0.1optimization over productions · 0.1metropolis sampling · 0.1usage pattern analysis · 0.1parametric design spaces · 0.1
YearPublicationVenuePosition
2026 From Code Generation to Conceptual Learning: Student Use of LLMs in a Web Programming Course
abstract
As AI-assisted coding becomes standard in software development, computer science educators need a clearer understanding of how Large Language Models (LLMs) can support the learning process. Recent work has examined how students can benefit from using LLMs in their courses, but most studies rely on self-reported usage or controlled experiments with short, isolated programming tasks. To complement these approaches, this paper investigates how students organically leverage LLMs in an advanced computer science course where assignments reflect real-world complexity. We analyze 448 LLM chat logs from 147 students across two offerings of a senior-level web programming course at a large U.S. research university. Through open coding, we identified 14 distinct prompt–response pair types that cluster into three categories: to generate code, debug code, and explain programming concepts. Our analysis reveals that how students interact with LLMs correlates with academic performance. High-effort detailed specifications for code generation positively correlated with final grades (r = 0.25, p < 0.01), whereas low-effort behaviors such as pasting raw error messages showed negative correlations (r = −0.34, p < 0.01). We also observed a temporal shift toward explanation-oriented interactions, suggesting that students increasingly use LLMs as conceptual tutors and not just as code generators.
Hajara-Yasmin Isa, Matthew Weston, Muhammad Rizky Wellyanto, Ishita Karna, Jerry O. Talton, Ranjitha Kumar
CHI5
2025 On-Device Interaction Mining MHCI024
abstract
Interaction mining is a popular technique for capturing design and interaction data while a mobile app is being used. Over the years, researchers have leveraged interaction mining systems to build large repositories of interaction data, enabling novel, ML-based tools for UX practitioners, designers, and programmers. Existing interaction mining systems range from simple screen recorders — which are easy to use but capture sparse, unstructured data — to complex installations requiring dedicated hardware and custom OS forks — which yield rich, high-fidelity traces but are difficult to deploy outside of a lab environment. This paper presents ODIM, an on-device framework for mobile interaction mining that produces detailed trace metadata. The framework is reified in an Android implementation based on a simple APK that users can install on their personal devices. The paper outlines ODIM’s design principles, describes its implementation, evaluates the system on traces collected from 100 popular apps on the Google Play Store, and discusses future avenues for scaling the utility and impact of interaction mining systems. The ODIM software, source code, and online trace repository are all freely available at interactionmining.org, for anyone to use and contribute to.
Deniz Arsan, Carl Guo, Muhammad Rizky Wellyanto, Erik R. Ji, Jerry O. Talton, Ranjitha Kumar
Proc. ACM Hum. Comput. Interact.5
2019 How do People Sort by Ratings?
abstract
Sorting items by user rating is a fundamental interaction pattern of the modern Web, used to rank products (Amazon), posts (Reddit), businesses (Yelp), movies (YouTube), and more. To implement this pattern, designers must take in a distribution of ratings for each item and define a sensible total ordering over them. This is a challenging problem, since each distribution is drawn from a distinct sample population, rendering the most straightforward method of sorting --- comparing averages --- unreliable when the samples are small or of different sizes. Several statistical orderings for binary ratings have been proposed in the literature (e.g., based on the Wilson score, or Laplace smoothing), each attempting to account for the uncertainty introduced by sampling. In this paper, we study this uncertainty through the lens of human perception, and ask "How do people sort by ratings?" In an online study, we collected 48,000 item-ranking pairs from 4,000 crowd workers along with 4,800 rationales, and analyzed the results to understand how users make decisions when comparing rated items. Our results shed light on the cognitive models users employ to choose between rating distributions, which sorts of comparisons are most contentious, and how the presentation of rating information affects users' preferences.
Jerry O. Talton, Krishna Dusad, Konstantinos Koiliaris, Ranjitha Kumar
CHI1
2016 Accounting for Taste: Ranking Curators and Content in Social Networks
abstract
Ranking users in social networks is a well-studied problem, typically solved by algorithms that leverage network structure to identify influential users and recommend people to follow. In the last decade, however, curation --- users sharing and promoting content in a network --- has become a central social activity, as platforms like Facebook, Twitter, Pinterest, and GitHub drive growth and engagement by connecting users through content and content to users. While existing algorithms reward users that are highly active with higher rankings, they fail to account for users' curatorial taste. This paper introduces CuRank, an algorithm for ranking users and content in social networks by explicitly modeling three characteristics of a good curator: discerning taste, high activity, and timeliness. We evaluate CuRank on datasets from two popular social networks --- GitHub and Vine --- and demonstrate its efficacy at ranking content and identifying good curators.
Haizi Yu, Biplab Deka, Jerry O. Talton, Ranjitha Kumar
CHI3
2013 Webzeitgeist: design mining the web
abstract
Advances in data mining and knowledge discovery have transformed the way Web sites are designed. However, while visual presentation is an intrinsic part of the Web, traditional data mining techniques ignore render-time page structures and their attributes. This paper introduces design mining for the Web: using knowledge discovery techniques to understand design demographics, automate design curation, and support data-driven design tools. This idea is manifest in Webzeitgeist, a platform for large-scale design mining comprising a repository of over 100,000 Web pages and 100 million design elements. This paper describes the principles driving design mining, the implementation of the Webzeitgeist architecture, and the new class of data-driven design applications it enables.
Ranjitha Kumar, Arvind Satyanarayan, César Torres 0001, Maxine Lim, Scott R. Klemmer, Jerry O. Talton
CHI7
2012 Data-driven Web Design
Ranjitha Kumar, Jerry O. Talton, Scott R. Klemmer
ICML2
2012 Learning design patterns with bayesian grammar induction
abstract
Design patterns have proven useful in many creative fields, providing content creators with archetypal, reusable guidelines to leverage in projects. Creating such patterns, however, is a time-consuming, manual process, typically relegated to a few experts in any given domain. In this paper, we describe an algorithmic method for learning design patterns directly from data using techniques from natural language processing and structured concept learning. Given a set of labeled, hierarchical designs as input, we induce a probabilistic formal grammar over these exemplars. Once learned, this grammar encodes a set of generative rules for the class of designs, which can be sampled to synthesize novel artifacts. We demonstrate the method on geometric models and Web pages, and discuss how the learned patterns can drive new interaction mechanisms for content creators.
Jerry O. Talton, Lingfeng Yang, Ranjitha Kumar, Maxine Lim, Noah D. Goodman, Radomír Mech
UIST1
2011 Bricolage: example-based retargeting for web design
abstract
The Web provides a corpus of design examples unparalleled in human history. However, leveraging existing designs to produce new pages is often difficult. This paper introduces the Bricolage algorithm for transferring design and content between Web pages. Bricolage employs a novel, structured-prediction technique that learns to create coherent mappings between pages by training on human-generated exemplars. The produced mappings are then used to automatically transfer the content from one page into the style and layout of another. We show that Bricolage can learn to accurately reproduce human page mappings, and that it provides a general, efficient, and automatic technique for retargeting content between a variety of real Web pages.
Ranjitha Kumar, Jerry O. Talton, Scott R. Klemmer
CHI2
2011 Flexible Tree Matching
Ranjitha Kumar, Jerry O. Talton, Timothy Roughgarden, Scott R. Klemmer
IJCAI2
2011 Metropolis procedural modeling
abstract
Procedural representations provide powerful means for generating complex geometric structures. They are also notoriously difficult to control. In this article, we present an algorithm for controlling grammar-based procedural models. Given a grammar and a high-level specification of the desired production, the algorithm computes a production from the grammar that conforms to the specification. This production is generated by optimizing over the space of possible productions from the grammar. The algorithm supports specifications of many forms, including geometric shapes and analytical objectives. We demonstrate the algorithm on procedural models of trees, cities, buildings, and Mondrian paintings.
Jerry O. Talton, Yu Lou 0003, Steve Lesser, Jared Duke, Radomír Mech, Vladlen Koltun
ACM Trans. Graph.1
2009 Exploratory modeling with collaborative design spaces
abstract
Enabling ordinary people to create high-quality 3D models is a long-standing problem in computer graphics. In this work, we draw from the literature on design and human cognition to better understand the design processes of novice and casual modelers, whose goals and motivations are often distinct from those of professional artists. The result is a method for creating exploratory modeling tools, which are appropriate for casual users who may lack rigidly-specified goals or operational knowledge of modeling techniques. Our method is based on parametric design spaces, which are often high dimensional and contain wide quality variations. Our system estimates the distribution of good models in a space by tracking the modeling activity of a distributed community of users. These estimates drive intuitive modeling tools, creating a self-reinforcing system that becomes easier to use as more people participate. We present empirical evidence that the tools developed with our method allow rapid creation of complex, high-quality 3D models by users with no specialized modeling skills or experience. We report analyses of usage patterns garnered throughout the year-long deployment of one such tool, and demonstrate the generality of the method by applying it to several design spaces.
Jerry O. Talton, Daniel Gibson, Lingfeng Yang, Pat Hanrahan, Vladlen Koltun
ACM Trans. Graph.1
2008 Two-Way Coupled SPH and Particle Level Set Fluid Simulation
abstract
Grid-based methods have difficulty resolving features on or below the scale of the underlying grid. Although adaptive methods (e.g. RLE, octrees) can alleviate this to some degree, separate techniques are still required for simulating small-scale phenomena such as spray and foam, especially since these more diffuse materials typically behave quite differently than their denser counterparts. In this paper, we propose a two-way coupled simulation framework that uses the particle level set method to efficiently model dense liquid volumes and a smoothed particle hydrodynamics (SPH) method to simulate diffuse regions such as sprays. Our novel SPH method allows us to simulate both dense and diffuse water volumes, fully incorporates the particles that are automatically generated by the particle level set method in under-resolved regions, and allows for two way mixing between dense SPH volumes and grid-based liquid representations.
Frank Losasso, Jerry O. Talton, Nipun Kwatra, Ronald Fedkiw
IEEE Trans. Vis. Comput. Graph.2
2007 Teaching graphics with the openGL shading language
abstract
A long-standing difficulty in the development of introductory courses in computer graphics is balancing the educational necessity of ensuring mastery of fundamental graphical concepts with the highly desirable goal of exciting and inspiring students to further study by enabling them to produce visually interesting programming projects. Recently, we have developed a modified curriculum predicated on the extensive integration of the OpenGL Shading Language with a more traditional pedagogical approach. We utilized this curriculum in the quarter-long, upper-division introductory graphics course taught in the Department of Computer Science at the University of California, Santa Cruz. Our experience indicates that making shading an integral part of the entry-level curriculum inculcates students with a comprehensive understanding of the algorithms and mathematical concepts that underlie modern graphical systems, while simultaneously equipping them with the tools necessary to produce complex projects with state-of-the-art technology.
Jerry O. Talton, Darren N. Fitzpatrick
SIGCSE1
2006 Scavenger hunt: computer science retention through orientation
abstract
This paper describes Scavenger Hunt, a team-based orientation activity for incoming freshmen in the Department of Computer Science at the University of Illinois at Urbana-Champaign. Like many large research universities, Illinois has struggled with the high attrition rate of first-year students in computing disciplines. Scavenger Hunt, which has been held each of the past three years, is intended to foster a sense of community within the department and acclimate new students to undergraduate life as computer science majors. A unique aspect of the activity is the use of handheld computers to manage most aspects of the competition, which enables physically handicapped students to participate on an equal footing with their able-bodied peers. Thus far, Scavenger Hunt has been directly responsible for the increased participation of new students in departmental activities and organizations. In addition, we have observed a significant correlation between student participation in Scavenger Hunt and retention rates in the department. Along with other retention-oriented activities, Scavenger Hunt is measurably improving the attitude of new students towards computer science.
Jerry O. Talton, Daniel L. Peterson, Samuel N. Kamin, Deborah Israel, Jalal Al-Muhtadi
SIGCSE1