Technologies introduced to support complex and critical work practices merit rigorous and effective evaluation. However, evaluation strategies often fall short of evaluating real use by practitioners in the workplace and thereby miss an opportunity to gauge the true impact of the technology on the work. This article reports an in use, in situ evaluation of 2 cognitive artifacts that support the everyday work of handover in a healthcare setting. The evaluation drew inspiration from the theoretical viewpoint offered by distributed cognition, focusing on the information content, representational media, and context of use of the artifacts. The article discusses how this approach led to insights about the artifacts and their support of the work that could not have been obtained with more traditional evaluation techniques. Specifically, the argument is made that the ubiquitous approach of user testing with its reliance on think-alouds and observations of interaction is inadequate in this context and set an initial agenda for issues that should be addressed by in use, in situ evaluations.

Large, shared displays are used in support of many forms of col-laborative work and are generally assumed to benefit the work. We investigate this in a qualitative study of an intervention to introduce such a display to support the work of shift handover in a medical setting. Results suggest that the consequences of introducing a shared display can be more subtle than expected. In particular, we highlight the fact that the common distinction between private and public information is too coarse-grained and discuss the importance of considering how access to public information is initiated. We briefly touch upon implications for interaction design.