In most sociotechnical systems, individuals are tracked through user accounts. This paper explores the various ways in which people create and use multiple user representations, specifically in online games. Using 8 years of population data from a popular multiplayer online game, EVE Online, we examine how multiple character creation and use occurs at scale and how operationalization of individuals between accounts and characters impacts methods. We suggest that conceptualizing participants in online games based on the assumption that one character equals one individual can lead to incorrect analyses regarding the demographics or behaviors of the population. Additionally, social network analysis suggests that a character-centric, rather than account-level, viewpoint can change the results of statistical relationships with network metrics such as eigenvector centrality.

Automatic recording of user behavior within a system (instrumentation) to develop and test theories has a rich history in psychology and system design. Often, researchers analyze instrumented behavior in isolation from other data. The problem with collecting instrumented behaviors without attitudinal, demographic, and contextual data is that researchers have no way to answer the 'why' behind the 'what'. We have combined the collection and analysis of behavioral instrumentation with other HCI methods to develop a system for Tracking Real-Time User Experience (TRUE). Using two case studies as examples, we demonstrate how we have evolved instrumentation methodology and analysis to extensively improve the design of video games. It is our hope that TRUE is adopted and adapted by the broader HCI community, becoming a useful tool for gaining deep insights into user behavior and improvement of design for other complex systems.

In this methodology paper we define a metric we call impact ratio.We use this ratio to measure the effectiveness of inspections and other evaluative techniques in getting usability improvements into products.We inspected ten commercial software products and achieved an average impact ratio of 78%.We discuss factors affecting this ratio and its value in helping us to appraise usability engineering's impact on products.

We offer an introduction to contextual design as an emergent method for building effective systems. Contextual design addresses a number of the inadequacies in previous methods by emphasizing: interview methods conducted in the context of the user's work, codesigning with the user, building an understanding of work in context, and summarizing conclusions through out the research. We contrast this design method to usability engineering and artifact examination.

The foundations for research and action in the area of group work are examined. Four alternative “world views” are presented. One of these, contextualism, is discussed in depth. Its methodological consequences for research and implications for reform of group meetings are explored.

No abstract available.

Human factors psychologists contribute in many ways to improving human-computer interaction. One contribution involves evaluating existing or prototype systems, in order to assess usability and identify problems. Another involves contributing more directly to the design of systems in the first place: that is, not only evaluating systems but bringing to bear empirical methods and theoretical considerations that help specify what are plausible designs in the first place. The goal of this panel is to discuss four case studies emphasizing this role of cognitive human factors, and identify relevant methods and theoretical considerations.

Performance and subjective reactions of 76 users of varying levels of computer experience were measured with 7 different interfaces representing command, menu, and iconic interface styles. The results suggest three general conclusions:

The focus here is on the lessons learned from the UDI project for building usability into the software development process. In the UDI project we attempted to engineer a usable system. That process involved:

A measurably easy-to-use interface has been built using a novel technique. Novices attempted an electronic mail task using a command-line interface containing no help, no menus, no documentation, and no instruction. A hidden operator intercepted commands when necessary, creating the illusion of a true interactive session. The software was repeatedly revised to recognize users' new commands; in essence, the users defined the interface. This procedure was used on 67 subjects. The first version of the software could recognize only 7% of all the subjects' spontaneously generated commands; the final version could recognize 76% of those commands. This experience contradicts the idea that people are not good at designing their own command languages. Through careful observation and analysis of user behavior, a mail interface unusable by novices evolved into one that let novices do useful work within minutes.