Cognitive style, a user's habitual approach to information processing, offers a promising approach to personalising information searching (IS) systems, yet the underlying style-related search behaviours remain poorly understood. This study investigates how the Wholist–Analytic and Verbal–Imagery dimensions of cognitive style influence search behaviour and prefrontal cortex (PFC) activation during the Post-focus stage of exploratory search. Forty participants completed comparison search tasks while we recorded behavioural metrics, subjective workload ratings, and functional near-infrared spectroscopy (fNIRS) data. Our results demonstrate that cognitive style significantly predicted search engine results page (SERP) interaction patterns: analytics and imagers adopted structured navigation with detailed reading, whereas wholists and verbalisers preferred sporadic navigation with rapid scanning. Critically, fNIRS revealed distinct PFC activation patterns, specifically in the Ventrolateral PFC (VLPFC) and Dorsolateral PFC (DLPFC), corresponding to these behavioural differences. By mapping neuro-cognitive profiles to IR behaviours, this work provides empirical grounding for designing ''style-aware'' adaptive IR interfaces that tailor information density and navigational support to individual cognitive profiles.

Cognitive style has been shown to influence users’ interaction with search interfaces. However, as a fundamental dimension of cognitive styles, the relationship between the Verbal-Imagery (VI) cognitive style dimension and search behaviour has not been studied thoroughly, and it is not clear whether VI cognitive style can be used to inform search user interface design. We present a study (N=29), investigating how search behaviour and mental workload (MWL) changes relate to VI cognitive styles by examining participants’ search behaviour across three increasingly complex tasks. MWL was subjectively rated by participants, and blood oxygenation changes in the prefrontal cortex were measured using functional near-infrared spectroscopy (fNIRS).

Conversational search systems, such as Google Assistant and Microsoft Cortana, provide a new search paradigm where users are allowed, via natural language dialogues, to communicate with search systems. Evaluating such systems is very challenging since search results are presented in the format of natural language sentences. Given the unlimited number of possible responses, collecting relevance assessments for all the possible responses is infeasible. In this paper, we propose POSSCORE, a simple yet effective automatic evaluation method for conversational search. The proposed embedding-based metric takes the influence of part of speech (POS) of the terms in the response into account. To the best knowledge, our work is the first to systematically demonstrate the importance of incorporating syntactic information, such as POS labels, for conversational search evaluation. Experimental results demonstrate that our metrics can correlate with human preference, achieving significant improvements over state-of-the-art baseline metrics.

Conversational search systems, such as Google assistant and Microsoft Cortana, enable users to interact with search systems in multiple rounds through natural language dialogues. Evaluating such systems is very challenging, given that any natural language responses could be generated, and users commonly interact for multiple semantically coherent rounds to accomplish a search task. Although prior studies proposed many evaluation metrics, the extent of how those measures effectively capture user preference remain to be investigated. In this article, we systematically meta-evaluate a variety of conversational search metrics. We specifically study three perspectives on those metrics: (1) reliability : the ability to detect “actual” performance differences as opposed to those observed by chance; (2) fidelity : the ability to agree with ultimate user preference; and (3) intuitiveness : the ability to capture any property deemed important: adequacy, informativeness, and fluency in the context of conversational search. By conducting experiments on two test collections, we find that the performance of different metrics vary significantly across different scenarios, whereas consistent with prior studies, existing metrics only achieve weak correlation with ultimate user preference and satisfaction. METEOR is, comparatively speaking, the best existing single-turn metric considering all three perspectives. We also demonstrate that adapted session-based evaluation metrics can be used to measure multi-turn conversational search, achieving moderate concordance with user satisfaction. To our knowledge, our work establishes the most comprehensive meta-evaluation for conversational search to date.

Systematic reviews are a comprehensive and parameterised form of literature review, found in most disciplines, that involve exhaustive analyses and rigorous interpretation of prior literature. Performing systematic reviews, however, can involve repetitive and laborious work in order to reach reliable standards. Strict guidelines and availability of published reviews make the task amenable to computerised assistance and automation using text mining, information extraction, and machine learning techniques. However, it is unclear which aspects of this Work Task are best suited for such support. This paper describes a three-month ethnographic study and CognitiveWork Analysis of the systematic reviews performed by a medical research group. Our findings show that the IR aspects of systematic reviews involve many tasks at two separate levels: 1) taxonomic organisation of documents and sub-document elements in relation to topic queries and domain-specific resources, and 2) extraction methods for structured summaries from the classified resources. This provides the basis for future work designing search tools with localised optimization and subtask automation to support specific phases of the process.

With greater access to computational resources, people use search to address many everyday challenges in their lives, including solving technology problems. Although there are now many useful ‘how-to’ resources online (especially videos on YouTube), it can still be difficult to identify, understand, and resolve certain kinds of technical problem. While research tasks have been studied for many years and we know the tactics people use, we know far less about searchers’ tactics for how-to technical tasks that involve actually being able to apply found information to resolve a problem. Crucial to our study was developing and studying a highly realistic, how-to technical task, for which there was no single guidance resource: making a phone safe for a child. After providing 39 participants with an actual phone to fix, and a search engine to perform the task, we analysed their search tactics using retrospective cued think aloud interviews. Our primary contribution is a set of 77 tactics used, in three categories, along with detail of how common they were. We conclude that people had a lot of tactics in their repertoire. Although it was not hard for participants to find relevant information, what was hard was for participants to find information they could use; indeed only 23% of participants successfully completed the entire task. Domain knowledge affected the choice of tactics used (although not necessarily towards better task success). We discuss these influences and make design recommendations for how future search systems can support those in resolving how-to technical tasks.

The field of neuroscience has fruitfully contributed to a wide variety of other fields, for example, economics, marketing and information systems, where the broad adoption and influence of neurophysiological (NP) research tools led to the creation of several new subfields, including neuroeconomics.

Neighbourhoods have been described as ‘the building blocks of public services society’. Their subjective nature, however, and the resulting difficulties in collecting data, means that in many countries there are no officially defined neighbourhoods either in terms of names or boundaries. This has implications not only for policy but also business and social decisions as a whole. With the absence of neighbourhood boundaries many studies resort to using standard administrative units as proxies. Such administrative geographies, however, often have a poor fit with those perceived by residents. Our approach detects these important social boundaries by automatically mining the Web en masse for passively declared neighbourhood data within postal addresses. Focusing on the United Kingdom (UK), this research demonstrates the feasibility of automated extraction of urban neighbourhood names and their subsequent mapping as vague entities. Importantly, and unlike previous work, our process does not require any neighbourhood names to be established a priori.

Theoretical abstractions, of many different aspects of search, have played a crucial role in driving research into human information seeking and retrieval forward. From models of the Information Seeking Process, to how we perceive search systems, these models help us to 1) conceptually formalise and separate aspects of the model's focus, 2) communicate more clearly about these aspects, 3) create hypotheses for subsequent research, and 4) produce implications for future systems. Implicit in these four aspects is that models and theories should have a focus and a purpose. After clarifying the relationships between models, theories, and meta-theories, this perspectives paper introduces the Tetris Model of Resolving Information Needs within the Information Seeking Process, the purpose of which is to better represent the behaviours around the Human Computer Interaction with Information Retrieval, which are often confounded within stage-based models of the Information Seeking Process. In particular, the possible sequence of actions performed by a searcher are typically linearly aligned from left-to-right, and thus imply a temporal progression. The differing focus of the Tetris model is to better capture the temporal experience of searching, by removing the implied progression of left-to-right. The aim of this perspectives paper, therefore, is to introduce this new Tetris Model, such that it can be used to formalise people's interactive experiences in a new way, so that we can more clearly communicate about them, create hypotheses from the model, and consider novel design implications based upon it.

Models of information seeking, including Kuhlthau's Information Search Process model, describe fundamentally different macro-level stages. Current search systems usually do not provide support for these stages, but provide a static set of features predominantly focused on supporting micro-level search interactions. This paper investigates the utility of search user interface (SUI) features at different macro-level stages of complex tasks. A user study was designed, using simulated work tasks, to explicitly place users within different stages of a complex task: pre-focus, focus, and post-focus. Active use, passive use and perceived usefulness of features were analysed in order to derive when search features are most useful. Our results identify significant differences in the utility of SUI features between each stage. Specifically, we have observed that informational features are naturally useful in every stage, while input and control features decline in usefulness after the pre-focus stage, and personalisable features become more useful after the pre-focus stage. From these findings, we conclude that features less commonly found in web search interfaces can provide value for users, without cluttering simple searches, when provided at the right times.

This Tutorial+Workshop will discuss opportunities and challenges involved in using neuro-physiological tools/techniques (such as fMRI, fNIRS, EEG, eye-tracking, GSR, HR, and facial expressions) and theories in information retrieval. The hybrid format will engage researchers and students at different levels of expertise, from those who are active in this area to those who are interested and want to learn more. The workshop will combine presentations, discussions and tutorial elements and consist of four segments (tutorial, completed research, work-in-progress, closing panel).

Serendipitously discovering new information can bring many benefits. Although we can design systems to highlight serendipitous information, serendipity cannot be easily orchestrated and is thus hard to study. In this paper, we deployed a working search engine that matched search results with Facebook 'Like' data, as a technology probe to examine naturally occurring serendipitous discoveries. Search logs and diary entries revealed the nature of these occasions in both leisure and work contexts. The findings support the use of the micro-serendipity model in search system design.

Neighbourhoods have been described by the UK Secretary of State for Communities and Local Government as the "building blocks of public service society". Despite this, difficulties in data collection combined with the concept's subjective nature have left most countries lacking official neighbourhood definitions. This issue has implications not only for policy, but for the field of computational social science as a whole (with many studies being forced to use administrative units as proxies despite the fact that these bear little connection to resident perceptions of social boundaries). In this paper we illustrate that the mass linguistic datasets now available on the internet need only be combined with relatively simple linguistic computational models to produce definitions that are not only probabilistic and dynamic, but do not require a priori knowledge of neighbourhood names.

A proposal summary for the EuroHCIR workshop at SIGIR2013.

While it is easy to identify whether someone has found a piece of information during a search task, it is much harder to measure how much someone has learned during the search process. Searchers who are learning often exhibit exploratory behaviors, and so current research is often focused on improving support for exploratory search. Consequently, we need effective measures of learning to demonstrate better support for exploratory search. Some approaches, such as quizzes, measure recall when learning from a fixed source of information. This research, however, focuses on techniques for measuring open‐ended learning, which often involve analyzing handwritten summaries produced by participants after a task. There are two common techniques for analyzing such summaries: (a) counting facts and statements and (b) judging topic coverage. Both of these techniques, however, can be easily confounded by simple variables such as summary length. This article presents a new technique that measures depth of learning within written summaries based on Bloom's taxonomy (B.S. Bloom & M.D. Engelhart, 1956). This technique was generated using grounded theory and is designed to be less susceptible to such confounding variables. Together, these three categories of measure were compared by applying them to a large collection of written summaries produced in a task‐based study, and our results provide insights into each of their strengths and weaknesses. Both fact‐to‐statement ratio and our own measure of depth of learning were effective while being less affected by confounding variables. Recommendations and clear areas of future work are provided to help continued research into supporting sensemaking and learning.

Abstract When users have poorly defined or complex goals, search interfaces that offer only keyword‐searching facilities provide inadequate support to help them reach their information‐seeking objectives. The emergence of interfaces with more advanced capabilities, such as faceted browsing and result clustering, can go some way toward addressing such problems. The evaluation of these interfaces, however, is challenging because they generally offer diverse and versatile search environments that introduce overwhelming amounts of independent variables to user studies; choosing the interface object as the only independent variable in a study would reveal very little about why one design outperforms another. Nonetheless, if we could effectively compare these interfaces, then we would have a way to determine which was best for a given scenario and begin to learn why. In this article, we present a formative inspection framework for the evaluation of advanced search interfaces through the quantification of the strengths and weaknesses of the interfaces in supporting user tactics and varying user conditions. This framework combines established models of users and their needs and behaviors to achieve this. The framework is applied to evaluate three search interfaces and demonstrates the potential value of this approach to interactive information retrieval evaluation.