Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Martin Halvey

dblp:27/417 · DBLP profile ↗
← Back
47ranked-venue papers
15as first author
8since 2021 · last 2026
0000-0001-6387-8679ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Databases, data management, data science and information retrieval · 28 · 9 first-author · 8 since 2021Human-computer interaction and ubiquitous computing · 24 · 4 first-author · 6 since 2021Graphics, computer vision, multimedia, augmented reality and games · 5 · 2 first-authorApplied, interdisciplinary, general and emerging computing · 3 · 3 first-authorArtificial intelligence and machine learning · 2 · 1 first-author

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Databases, data mining, and information retrieval
11 papers
Information retrieval · 79% Recommender systems · 16% Web and social media mining · 4%
Human-computer interaction and pervasive computing
9 papers
Haptics and multimodal interaction · 40% Interaction techniques and input · 20% Collaborative and social computing · 17%
Computer graphics and multimedia
4 papers
Multimedia analysis and retrieval · 76% Audio and music processing · 18% Multimedia systems and quality of experience · 6%

Topics — the 28 heaviest of 35, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Information retrieval
systematic review
0.812024
A Systematic Review of Cost, Effort, and Load Research in Information Search and Retrieval, 1972-2020 · ACM Trans. Inf. Syst. 2024
Haptics and multimodal interaction
thermal feedback
0.532016
The Effect of Thermal Stimuli on the Emotional Perception of Images · CHI 2016
"Baby it's cold outside": the influence of ambient temperature and humidity on thermal feedback · CHI 2012
Some like it hot: thermal feedback for mobile devices · CHI 2011
Information retrieval › user behavior
search behavior analysis
0.412020
Predicting Perceptual Speed from Search Behaviour · SIGIR 2020
Recommender systems
user modeling
0.412020
Predicting Perceptual Speed from Search Behaviour · SIGIR 2020
Information retrieval › evaluation
relevance judgment
0.422014
SIGIR 2014 workshop on gathering efficient assessments of relevance (GEAR) · SIGIR 2014
Evaluating the effort involved in relevance assessments for images · SIGIR 2014
Information retrieval › interactive information retrieval › search interaction
collaborative information retrieval
0.212015
Towards Quantifying the Impact of Non-Uniform Information Access in Collaborative Information Retrieval · SIGIR 2015
Interaction techniques and input › non-visual interaction › auditory interaction
auditory display
0.212015
A comparison of artificial driving sounds for automated vehicles · UbiComp 2015
Human-robot interaction
automated vehicles
0.212015
A comparison of artificial driving sounds for automated vehicles · UbiComp 2015
Information retrieval
evaluation
0.212014
SIGIR 2014 workshop on gathering efficient assessments of relevance (GEAR) · SIGIR 2014
Information retrieval
retrieval evaluation
0.212013
Is relevance hard work?: evaluating the effort of making relevant assessments · SIGIR 2013
Recommender systems › social recommendation
community recommendation
0.112008
Search trails using user feedback to improve video search · ACM Multimedia 2008
Multimedia analysis and retrieval › video retrieval
interactive video search
0.112008
Search trails using user feedback to improve video search · ACM Multimedia 2008
Multimedia analysis and retrieval
video retrieval
0.112008
Search trails using user feedback to improve video search · ACM Multimedia 2008
Interaction techniques and input
mobile interaction
0.122012
"Baby it's cold outside": the influence of ambient temperature and humidity on thermal feedback · CHI 2012
Some like it hot: thermal feedback for mobile devices · CHI 2011
Information retrieval › document processing
metadata creation
0.112007
An assessment of tag presentation techniques · WWW 2007
Web and social media mining › user behavior analysis
social interaction analysis
0.112007
Exploring social dynamics in online media sharing · WWW 2007
Web and social media mining
tagging
0.112007
An assessment of tag presentation techniques · WWW 2007
Collaborative and social computing
online communities
0.112007
Exploring social dynamics in online media sharing · WWW 2007
Collaborative and social computing › social network analysis
social network formation
0.112007
Exploring social dynamics in online media sharing · WWW 2007
Collaborative and social computing › social computing
social tagging
0.112007
An assessment of tag presentation techniques · WWW 2007
Data mining › pattern mining › temporal pattern mining
temporal association rule mining
0.112006
Temporal rules for mobile web personalization · WWW 2006
Recommender systems
web personalization
0.112006
Temporal rules for mobile web personalization · WWW 2006
Information retrieval › evaluation
test collection
0.112014
SIGIR 2014 workshop on gathering efficient assessments of relevance (GEAR) · SIGIR 2014
Information retrieval › evaluation › test collection
test collection evaluation
0.112014
Evaluating the effort involved in relevance assessments for images · SIGIR 2014
Information retrieval › evaluation › test collection
test collection construction
0.012013
Is relevance hard work?: evaluating the effort of making relevant assessments · SIGIR 2013
Collaborative and social computing
social network analysis
0.012010
ACM international workshop on social, adaptive and personalized multimedia interaction and access (SAPMIA 2010) · ACM Multimedia 2010
Multimedia systems and quality of experience › content distribution
video sharing
0.012007
Exploring social dynamics in online media sharing · WWW 2007
Ubiquitous computing and smart environments › mobile computing
mobile web browsing
0.012006
Temporal rules for mobile web personalization · WWW 2006

Methods — techniques the papers use, named apart from their topics

systematic literature review · 0.8user study · 0.5machine learning · 0.4decision tree · 0.4simulation · 0.2social network analysis · 0.2empirical evaluation · 0.2user feedback mining · 0.2search trails · 0.2user evaluation · 0.1environmental sensing · 0.1detection threshold measurement · 0.1temporal rule mining · 0.1usage log analysis · 0.1temporal analysis · 0.1markov model · 0.1
YearPublicationVenuePosition
2026 Expanded Tag Genomes for Cross-Domain Recommendation
abstract
Tag genome is widely used in recommender systems research to, for example, measure item similarity, make recommendations and generate recommendation explanations. Applying tag genome to problems in cross-domain recommendation, however, is complicated by the limited item overlap between cross-domain recommendation data sets and the available tag genomes. Furthermore, existing tag prediction models rely on content-based features that are not readily available in a majority of recommendation data sets. To address these issues, we generated tag genomes for both movies and books based on the Amazon data set, which is widely used in cross-domain recommendation research. These new tag genomes are over 200 × larger than the previous versions and can support comparative evaluation of tag-based and collaborative methods, facilitate the development of new cross-domain recommendation algorithms and provide a foundation for studying phenomena, such as serendipity and diversity, across multiple domains. Both data sets and the data generation pipeline are freely available at https://github.com/Bionic1251/Expanded-Tag-Genomes.
Denis Kotkov, Alan Medlar, Dorota Glowacka, Martin Halvey
CHIIR4
2024 The Influence of Presentation and Performance on User Satisfaction
abstract
Information Retrieval (IR) systems are designed to provide users with a ranked list of results based on their queries. The effectiveness of an IR system is gauged not just by its ability to retrieve relevant results but also by how it presents these results to users; an engaging presentation often correlates with increased user satisfaction. While existing research has delved into the link between user satisfaction, IR performance metrics, and presentation, these aspects have typically been investigated in isolation. Our research aims to bridge this gap by examining the relationship between query performance, presentation and user satisfaction. For our analysis, we conducted a between-subjects experiment comparing the effectiveness of various result card layouts for an ad-hoc news search interface. Drawing data from the TREC WaPo 2018 collection, we centered our study on four specific topics. Within each of these topics, we assessed six distinct queries with varying nDCG values. Our study involved 164 participants who were exposed to one of five distinct layouts containing result cards, such as “title”, “title+image”, or “title+image+summary”. Our findings indicate that while nDCG is a strong predictor of user satisfaction at the query level, there exists no linear relationship between the performance of the query, presentation of results and user satisfaction. However, when considering the total gain on the initial result page, we observed that presentation does play a significant role in user satisfaction (at the query level) for certain layouts with result cards such as, title+image or title+image+summary. Our results also suggest that the layout differences have complex and multifaceted impacts on satisfaction. We demonstrate the capacity to equalize user satisfaction levels between queries of varying performance by changing how results are presented. This emphasizes the necessity to harmonize both performance and presentation in IR systems, considering users’ diverse preferences. Ultimately, our insights can steer the evolution of more user-aligned IR systems, underscoring the balance between system performance and result presentation.
Kanaad Pathak, Leif Azzopardi, Martin Halvey
CHIIR3
2024 Ranking Heterogeneous Search Result Pages Using the Interactive Probability Ranking Principle
Kanaad Pathak, Leif Azzopardi, Martin Halvey
ECIR (2)3
2024 A Systematic Review of Cost, Effort, and Load Research in Information Search and Retrieval, 1972-2020
abstract
During the information search and retrieval (ISR) process, user-system interactions such as submitting queries, examining results, and engaging with information impose some degree of demand on the user’s resources. Within ISR, these demands are well recognised, and numerous studies have demonstrated that the cost, effort, and load (CEL) experienced during the search process are affected by a variety of factors. Despite this recognition, there is no universally accepted definition of the constructs of CEL within the field of ISR. Ultimately, this has led to problems with how these constructs have been interpreted and subsequently measured. This systematic review contributes a synthesis of literature, summarising key findings relating to how researchers have been defining and measuring CEL within ISR over the past 50 years. After manually screening 1,109 articles, we detailed and analysed 91 articles which examine CEL within ISR. The discussion focuses on comparing the similarities and differences between CEL definitions and measures before identifying the limitations of the current state of the nomenclature. Opportunities for future research are also identified. Going forward, we propose a CEL taxonomy that integrates the relationships between CEL and their related constructs, which will help focus and disambiguate future research in this important area.
Molly McGregor, Leif Azzopardi, Martin Halvey
ACM Trans. Inf. Syst.3
2023 Driven to Distraction: Examining the Influence of Distractors on Search Behaviours, Performance and Experience
abstract
Advertisements, sponsored links, clickbait, in-house recommendations and similar elements pervasively shroud featured content. Such elements vie for people’s attention, potentially distracting people from their task at hand. The effects of such “distractors” is likely to increase people’s cognitive workload and reduce their performance as they need to work harder to discern the relevant from non-relevant. In this paper, we investigate how people of varying cognitive abilities (measured using Perceptual Speed and Cognitive Failure instruments) are affected by these different types of distractions when completing search tasks. We performed a crowdsourced within-subjects user study, where 102 participants completed four search tasks using our news search engine over four different interface conditions: (i) one with no additional distractors; (ii) one with advertisements; (iii) one with sponsored links; and (iv) one with in-house recommendations. Our results highlight a number of important trends and findings. Participants perceived the interface condition without distractors as significantly better across numerous dimensions. Participants reported higher satisfaction, lower workload, higher topic recall, and found it easier to concentrate. Behaviourally, participants issued queries faster and clicked results earlier when compared to the interfaces with distractors. When using the interfaces with distractors, one in ten participants clicked on a distractor—and despite engaging with a distractor for less than twenty seconds, their task time increased by approximately two minutes. We found that the effects were magnified depending on cognitive abilities—with a greater impact of distractors on participants with lower perceptual speed, and for those with a higher propensity of cognitive failures. Distractors—regardless of their type—have negative consequences on a user’s search experience and performance. As a consequence, interfaces containing visually distracting elements are creating poorer search experiences due to the “distractor tax” being placed on people’s limited attention.
Leif Azzopardi, David Maxwell 0001, Martin Halvey, Claudia Hauff
CHIIR3
2022 Partners in life and online search: Investigating older couples' collaborative information seeking
abstract
Older adults frequently collaborate with their spouses in daily tasks and problem solving. Despite information seeking being an important aspect of collaboration, the information seeking behaviour of older adults and in particular couples remains under investigated. To address this gap, in this paper we present a qualitative investigation of older adults’ collaborative information seeking. Through in-depth interviews and demonstrations of real-life search tasks with eleven older couples, we show that older couples frequently engage in collaborative information seeking in daily tasks, interests, and to satisfy curiosity. Our research suggests that collaborative information seeking is a relationship maintenance behaviour among older couples, and that their long-term relationships may play a key role in how they communicate, make decisions, and develop divide and conquer strategies by taking on various roles during their collaborative information seeking. We also found that older couples construct shared views toward technology adoption and usage despite their individual differences. We include some reflections on the existing collaborative information systems and how they may adapt to fit older couples’ collaborative information seeking.
Winter Wei, Cosmin Munteanu, Martin Halvey
CHIIR3
2021 Investigating the Influence of Ads on User Search Performance, Behaviour, and Experience during Information Seeking
abstract
The phenomenon of banner blindness explains that users can mentally ignore online advertisements (ads). However, eye-tracking studies have shown that users still fixate on ads, and even without direct gaze, ads still fall within a user's peripheral vision, which may negatively overload cognition. It is therefore unknown how blind, banner blindness, truly is, and what other effect ads may have on user's information seeking. To address this gap, a within-subjects design experiment was conducted with 37 participants who performed search tasks from the TREC 2017 Common Core News Collection, where 3 search tasks contained various types of ads, and one search task had no ads. Although our results showed that on average, participants retrieved similar amounts of relevant documents regardless of whether ads were present or absent, participants took significantly longer achieving this performance when ads were present. Furthermore, when ads were absent, participants reported less frustration, and not only believed they learned more, but a post-task recall test showed that participants actually did learn up to 38% more. Consequently, our findings suggest that banner blindness is more costly than just mere annoyance, and that the influence of ads on user's information retrieval recall may extend current theories of visual crowding.
Olivia Foulds, Leif Azzopardi, Martin Halvey
CHIIR3
2021 Untangling Cost, Effort, and Load in Information Seeking and Retrieval
abstract
When performing Information Seeking and Retrieval (ISR) activities, people submit queries, examine results, assess documents and engage with the information to make decisions and complete tasks. All these activities come at a "cost'', but within the field of ISR there is no universally accepted definition of the concepts of Cost, Effort and Load (CEL). Instead, researchers have used the same terms interchangeably to describe similar but also different concepts. This lack of shared understanding has led to a disconnect between how these concepts are defined and discussed versus how they are interpreted and measured. Thus, the aim of this paper is two-fold: (i) to review the meaning of CEL related concepts used within ISR, and (ii) to create a shared taxonomy of the concepts relating to CEL in ISR. To seed our analysis, we conducted a literature review, where 397 papers were reviewed, and twenty-six papers that explicitly proposed measures or definitions of CEL were selected for analysis. By drawing upon theory from Psychology and other fields, we present the common definitions of CEL in order to ground our discussion of these concepts in ISR. We also highlight the issues associated with CEL measurement in ISR to help researchers reflect on the validity and precision of existing methods. We hope this perspectives paper serves as a basis for a taxonomy of how CEL concepts are used within ISR- where we have provided a series of working definitions that clearly delineate the different concepts being used, investigated and measured in ISR research.
Molly McGregor, Leif Azzopardi, Martin Halvey
CHIIR3
2020 Reflecting upon Perceptual Speed Tests in Information Retrieval: Limitations, Challenges, and Recommendations
abstract
Perceptual Speed (PS) is a cognitive ability defined by an individual's accuracy and speed to scan information while completing visual search tasks. Prior studies using PS tests have demonstrated that PS affects multiple factors in Information Retrieval (IR), such as a user's search performance, interaction with the system, time spent completing tasks, and subjective impression of their workload. With greater knowledge of PS, systems could be designed that accommodate users with low PS to improve their overall search experience. However, in this perspectives paper, we analyse how PS tests have been used in IR, and identify multiple uncertainties regarding PS content, administration, analysis, and reporting of findings. Consequently, we aim to stir discussion between IR researchers by drawing awareness to these issues. As a result, we further discuss challenges involved in advancing how future PS tests are used in IR. Finally, we propose recommendations that have the potential for enhancing the reliability and validity of current PS tests.
Olivia Foulds, Leif Azzopardi, Martin Halvey
CHIIR3
2020 Impact of Agent Reliability and Predictability on Trust in Real Time Human-Agent Collaboration
abstract
Trust is a prerequisite for effective human-agent collaboration. While past work has studied how trust relates to an agent's reliability, it has been mainly carried out in turn based scenarios, rather than during real-time ones. Previous research identified the performance of an agent as a key factor influencing trust. In this work, we posit that an agent's predictability also plays an important role in the trust relationship, which may be observed based on users' interactions. We designed a 2x2 within-groups experiment with two baseline conditions: (1) no agent (users' individual performance), and (2) near-flawless agent (upper bound). Participants took part in an interactive aiming task where they had to collaborate with different agents that varied in terms of their predictability, and were controlled in terms of their performance. Our results show that agents whose behaviours are easier to predict have a more positive impact on task performance, reliance and trust while reducing cognitive workload. In addition, we modelled the human-agent trust relationship and demonstrated that it is possible to reliably predict users' trust ratings using real-time interaction data. This work seeks to pave the way for the development of trust-aware agents capable of adapting and responding more appropriately to users.
Sylvain Daronnat, Leif Azzopardi, Martin Halvey, Mateusz Dubiel
HAI3
2020 Predicting Perceptual Speed from Search Behaviour
abstract
Perceptual Speed (PS) is a cognitive ability that is known to affect multiple factors in Information Retrieval (IR) such as a user's search performance and subjective experience. However PS tests are difficult to administer which limits the design of user-adaptive systems that can automatically infer PS to appropriately accommodate low PS users. Consequently, this paper evaluated whether PS can be automatically classified from search behaviour using several machine learning models trained on features extracted from TREC Common Core search task logs. Our results are encouraging: given a user's interactions from one query, a Decision Tree was able to predict a user's PS as low or high with 86% accuracy. Additionally, we identified different behavioural components for specific PS tests, implying that each PS test measures different aspects of a person's cognitive ability. These findings motivate further work for how best to design search systems that can adapt to individual differences.
Olivia Foulds, Alessandro Suglia, Leif Azzopardi, Martin Halvey
SIGIR4
2018 Beyond traditional collaborative search: Understanding the effect of awareness on multi-level collaborative information retrieval
Nyi Nyi Htun, Martin Halvey, Lynne Baillie
Inf. Process. Manag.2
2017 An Interface for Supporting Asynchronous Multi-Level Collaborative Information Retrieval
abstract
A great deal of research into Collaborative Information Retrieval (CIR) has assumed that search team members have the same level of unrestricted access to information. However, case studies and observations from different domains including government, healthcare and legal, have suggested that CIR sometimes involves people with unequal access to information. This type of scenario has been referred to as Multi-Level CIR (MLCIR). In addition to supporting collaboration, MLCIR systems must ensure that there is no unintended disclosure of sensitive information, this is an under investigated area of research. In this paper we present results of an evaluation of an interface we have designed for MLCIR scenarios. Pairs of participants used the interface under 3 different information access scenarios for a variety of search tasks. These scenarios included 1 CIR and 2 MLCIR scenarios, namely: full access (FA), document removal (DR) and term blacklisting (TR). Design interviews were conducted post evaluation to obtain qualitative feedback from participants. Evaluation results showed that our interface performed well for both DR and FA scenarios but for TR, team members with less access had a negative influence on their partner's search performance, demonstrating insights into how different MLCIR scenarios should be supported. Design interview results showed that our interface helped the participants to reformulate their queries, understand their partner's performance, reduce duplicated work and review their team's search history without disclosing sensitive information.
Nyi Nyi Htun, Martin Halvey, Lynne Baillie
CHIIR2
2017 How Can We Better Support Users with Non-Uniform Information Access in Collaborative Information Retrieval?
abstract
The majority of research in Collaborative Information Retrieval (CIR) has assumed that collaborating team members have uniform information access. However, practice and research has shown that there may not always be uniform information access among team members, e.g. in healthcare, government, etc. To the best of our knowledge, there has not been a controlled user evaluation to measure the impact of non-uniform information access on CIR outcomes. To address this shortcoming, we conducted a controlled user evaluation using 2 non-uniform access scenarios (document removal and term blacklisting) and 1 full and uniform access scenario. Following this, a design interview was undertaken to provide interface design suggestions. Evaluation results show that neither of the 2 non-uniform access scenarios had a significant negative impact on collaborative and individual search outcomes. Design interview results suggested that awareness of team's query history and intersecting viewed/judged documents could potentially help users share their expertise without disclosing sensitive information. Based on our results we provide important design recommendations to better support users with non-uniform information access in CIR.
Nyi Nyi Htun, Martin Halvey, Lynne Baillie
CHIIR2
2017 Using thermal stimuli to influence affect in different picture display sizes
abstract
The ability of images to evoke emotions in people has been well documented in previous research, as well as the differences in the emotional perception of images when viewed on different-sized screens and device types. The ability of thermal stimuli to evoke emotions in people when used for media augmentation has also been examined. However, little is known about how thermal stimuli can be used to enhance or reduce affect in images with varying emotional properties displayed in different sizes or on different devices. To the best of our knowledge, no work has been conducted to investigate whether there is any difference in the effect thermal augmentation has on images displayed in different sizes on different device types. This paper presents two user studies to address this research gap. Study 1 explored the effect thermal stimulation has on images displayed in different sizes. Images were displayed in sizes corresponding to the full screen display of a laptop, tablet and mobile phone. In study 2, we examined whether the actual presentation device (tablet and mobile) plays a role in the emotional perception of images displayed on mobile devices. Results showed that thermal augmentation was most effective in modulating emotions in small-sized pictures (427 × 240 pixels display size) and pictures displayed on a mobile phone. Thermal stimuli also reduced emotions in medium display sizes (corresponding to the full screen display of a tablet).
Moses Akazue, Martin Halvey, Lynne Baillie
Pers. Ubiquitous Comput.2
2016 The Effect of Thermal Stimuli on the Emotional Perception of Images
abstract
Thermal stimulation is a feedback channel that has the potential to influence the emotional response of people to media such as images. While previous work has demonstrated that thermal stimuli might have an effect on the emotional perception of images, little is understood about the exact emotional responses different thermal properties and presentation techniques can elicit towards images. This paper presents two user studies that investigate the effect thermal stimuli parameters (e.g. intensity) and timing of thermal stimuli presentation have on the emotional perception of images. We found that thermal stimulation increased valence and arousal in images with low valence and neutral to low arousal. Thermal augmentation of images also reduced valence and arousal in high valence and arousal images. We discovered that depending on when thermal augmentation is presented, it can either be used to create anticipation or enhance the inherent emotion an image is capable of evoking.
Moses Akazue, Martin Halvey, Lynne Baillie, Stephen A. Brewster
CHI2
2016 Video Test Collection with Graded Relevance Assessments
abstract
Relevance is a complex, but core, concept within the field of Information Retrieval. In order to allow system comparisons the many factors that influence relevance are often discarded to allow abstraction to a single score relating to relevance. This means that a great wealth of information is often discarded. In this paper we outline the creation of a video test collection with graded relevance assessments, to the best of our knowledge the first example of such a test collection for video retrieval. To directly address the shortcoming above we also gathered behavioural and perceptual data from assessors during the assessment process. All of this information along with judgements are available for download. Our intention is to allow other researchers to supplement the judgements to help create an adaptive test collection which contains supplementary information rather than a completely static collection with binary judgements.
Weng Qiying, Martin Halvey, Robert Villa
CHIIR2
2016 A Comparison of Primary and Secondary Relevance Judgements for Real-Life Topics
abstract
The notion of relevance is fundamental to the field of Information Retrieval. Within the field a generally accepted conception of relevance as inherently subjective has emerged, with an individual's assessment of relevance influenced by numerous contextual factors. In this paper we present a user study that examines in detail the differences between primary and secondary assessors on a set of "real-world" topics which were gathered specifically for the work. By gathering topics which are representative of the staff and students at a major university, at a particular point in time, we aim to explore differences between primary and secondary relevance judgements for real-life search tasks. Findings suggest that while secondary assessors may find the assessment task challenging in various ways (they generally possess less interest and knowledge in secondary topics and take longer to assess documents), agreement between primary and secondary assessors is high.
Simon Wakeling, Martin Halvey, Robert Villa, Laura Hasler
CHIIR2
2016 Beyond actions: Exploring the discovery of tactics from user logs
Jiyin He, Pernilla Qvarfordt, Martin Halvey, Gene Golovchinsky
Inf. Process. Manag.3
2015 A comparison of artificial driving sounds for automated vehicles
abstract
As automated vehicles currently do not provide sufficient feedback relating to the primary driving task, drivers have no assurance that an automated vehicle has understood and can cope with upcoming traffic situations [16]. To address this we conducted two user evaluations to investigate auditory displays in automated vehicles using different types of sound cues related to the primary driving sounds: acceleration, deceleration/braking, gear changing and indicating. Our first study compared earcons, speech and auditory icons with existing vehicle sounds. Our findings suggested that earcons were an effective alternative to existing vehicle sounds for presenting information related to the primary driving task. Based on these findings a second study was conducted to further investigate earcons modulated by different sonic parameters to present primary driving sounds. We discovered that earcons containing naturally mapped sonic parameters such as pitch and timbre were as effective as existing sounds in a simulated automated vehicle.
David Beattie, Lynne Baillie, Martin Halvey
UbiComp3
2015 Why aren't Users Using Protection? Investigating the Usability of Smartphone Locking
abstract
One of the main reasons why smartphone users do not adopt screen locking mechanisms is due to the inefficiency of entering a PIN/pattern each time they use their phone. To address this problem we designed a context-sensitive screen locking application which asked participants to enter a PIN/pattern only when necessary, and evaluated its impact on efficiency and satisfaction. Both groups of participants, who prior to the study either locked or did not lock their phone, adopted our application and felt that unlocking their phone only when necessary was more efficient, did not annoy them and offered a reasonable level of security. Participants responded positively to the option of choosing when a PIN/pattern is required in different contexts. Therefore, we recommend that designers of smartphone locking mechanisms should consider ceding a reasonable level of control over security settings to users to increase adoption and convenience, while keeping smartphones reasonably secure.
Nicholas Micallef, Mike Just, Lynne Baillie, Martin Halvey, Hilmi Günes Kayacik
MobileHCI4
2015 Towards Quantifying the Impact of Non-Uniform Information Access in Collaborative Information Retrieval
abstract
The majority of research into Collaborative Information Retrieval (CIR) has assumed a uniformity of information access and visibility between collaborators. However in a number of real world scenarios, information access is not uniform between all collaborators in a team e.g. security, health etc. This can be referred to as Multi-Level Collaborative Information Retrieval (MLCIR). To the best of our knowledge, there has not yet been any systematic investigation of the effect of MLCIR on search outcomes. To address this shortcoming, in this paper, we present the results of a simulated evaluation conducted over 4 different non-uniform information access scenarios and 3 different collaborative search strategies. Results indicate that there is some tolerance to removing access to the collection and that there may not always be a negative impact on performance. We also highlight how different access scenarios and search strategies impact on search outcomes.
Nyi Nyi Htun, Martin Halvey, Lynne Baillie
SIGIR2
2014 Many Fingers Make Light Work: Non-Visual Capacitive Surface Exploration
abstract
In this paper we investigate how we can change interactions with mobile devices so we can better support subtle low effort intermittent interaction. In particular we conducted an evaluation with varying interaction techniques which looked at non-visual touch based exploration of information on a capacitive surface. The results of this evaluation indicate that there is very little difference in terms of selection accuracy between the interaction techniques that we implemented and a slight but significant time reduction when using multiple fingers to search, over one finger. Users found locating information and relating information to physical landmarks easier than relating virtual locations to each other. In addition it was found that search strategy and interaction varied between tasks and also at different points in the task.
Martin Halvey, Andrew Crossan
ICMI1
2014 Evaluating the effort involved in relevance assessments for images
abstract
How assessors and end users judge the relevance of images has been studied in information science and information retrieval for a considerable time. The criteria by which assessors' judge relevance has been intensively studied, and there has been a large amount of work which has investigated how relevance judgments for test collections can be more cheaply generated, such as through crowd sourcing. Relatively little work has investigated the process individual assessors go through to judge the relevance of an image. In this paper, we focus on the process by which relevance is judged for images, and in particular, the degree of effort a user must expend to judge relevance for different topics. Results suggest that topic difficulty and how semantic/visual a topic is impact user performance and perceived effort.
Martin Halvey, Robert Villa
SIGIR1
2014 SIGIR 2014 workshop on gathering efficient assessments of relevance (GEAR)
abstract
Evaluation is a fundamental part of Information Retrieval, and in the conventional Cranfield evaluation paradigm, sets of relevance assessments are a fundamental part of test collections. This workshop revisits how relevance assessments can be efficiently created, seeking to provide a forum for discussion and exploration of the topic.
Martin Halvey, Robert Villa, Paul D. Clough
SIGIR1
2014 Supporting exploratory video retrieval tasks with grouping and recommendation
Martin Halvey, David Vallet, David Hannah, Joemon M. Jose
Inf. Process. Manag.1
2013 Is relevance hard work?: evaluating the effort of making relevant assessments
abstract
The judging of relevance has been a subject of study in information retrieval for a long time, especially in the creation of relevance judgments for test collections. While the criteria by which assessors? judge relevance has been intensively studied, little work has investigated the process individual assessors go through to judge the relevance of a document. In this paper, we focus on the process by which relevance is judged, and in particular, the degree of effort a user must expend to judge relevance. By better understanding this effort in isolation, we may provide data which can be used to create better models of search. We present the results of an empirical evaluation of the effort users must exert to judge the relevance of document, investigating the effect of relevance level and document size. Results suggest that 'relevant' documents require more effort to judge when compared to highly relevant and not relevant documents, and that effort increases as document size increases.
Robert Villa, Martin Halvey
SIGIR2
2012 "Baby it's cold outside": the influence of ambient temperature and humidity on thermal feedback
abstract
Thermal feedback is a new area of research in HCI and, as such, there has been very little investigation of the impact of environmental factors on its use for interaction. To address this shortcoming we conducted an experiment to investigate how ambient temperature and humidity could affect the usability of thermal feedback. If environmental conditions affect perception significantly, then it may not be suitable for mobile interactions. Evaluations were conducted outdoors in varying environmental conditions over a period of 5 months. Results showed that the ambient temperature has a significant impact on people's ability to detect stimuli and also their perception of these stimuli. Humidity has a negligible effect for most humidity values. Despite this, previous thermal feedback design recommendations still hold in varying temperatures and humidities showing that thermal feedback is a useful tool for mobile interaction.
Martin Halvey, Graham A. Wilson, Stephen A. Brewster, Stephen A. Hughes
CHI1
2012 Assessing and Predicting Vertical Intent for Web Queries
Ke Zhou 0003, Ronan Cummins, Martin Halvey, Mounia Lalmas-Roelleke, Joemon M. Jose
ECIR3
2012 Thermal icons: evaluating structured thermal feedback for mobile interaction
abstract
This paper expands the repertoire of non-visual feedback for mobile interaction, established through Earcons and Tactons, by designing structured thermal cues for conveying information. Research into the use of thermal feedback for HCI has not looked beyond basic 'yes-no' detection of stimuli to the unique identification of those stimuli. We first designed thermal icons that varied along two parameters to convey two pieces of information. We also designed intramodal tactile icons, combining one thermal and one vibrotactile parameter, to test perception of different tactile cues and so evaluate the possibility of augmenting vibrotactile displays with thermal feedback. Thermal icons were identified with 82.8% accuracy, while intramodal icons had 96.9% accuracy, suggesting thermal icons are a viable means of conveying information in mobile HCI, for when audio and/or vibrotactile feedback is not suitable or desired.
Graham A. Wilson, Stephen A. Brewster, Martin Halvey, Stephen A. Hughes
Mobile HCI3
2012 Investigating Gesture and Pressure Interaction with a 3D Display
Martin Halvey, David Hannah, Graham A. Wilson, Stephen A. Brewster
MMM1
2012 Effective venue image retrieval using robust feature extraction and model constrained matching for mobile robot localization
Yue Feng 0002, Jinchang Ren, Jianmin Jiang, Martin Halvey, Joemon M. Jose
Mach. Vis. Appl.4
2011 Some like it hot: thermal feedback for mobile devices
abstract
Thermal stimulation is a rich, emotive and salient feedback channel that is well suited to HCI, but one that is yet to be fully investigated. Thermal feedback may be suited to environments that are too loud for audio or too bumpy for vibrotactile feedback. This paper presents two studies into how well users could detect hot and cold stimuli presented to the fingertips, the palm, the dorsal surface of the forearm and the dorsal surface of the upper arm. Evaluations were carried out in static and mobile settings. Results showed that the palm is most sensitive, cold is more perceivable and comfortable than warm and that stronger and faster-changing stimuli are more detectable but less comfortable. Guidelines for the design of thermal feedback are outlined, with attention paid to perceptual and hedonic factors.
Graham A. Wilson, Martin Halvey, Stephen A. Brewster, Stephen A. Hughes
CHI2
2011 The effect of clothing on thermal feedback perception
abstract
Thermal feedback is a new area of research in HCI. To date, studies investigating thermal feedback for interaction have focused on virtual reality, abstract uses of thermal output or on use in highly controlled lab settings. This paper is one of the first to look at how environmental factors, in our case clothing, might affect user perception of thermal feedback and therefore usability of thermal feedback. We present a study into how well users perceive hot and cold stimuli on the hand, thigh and waist. Evaluations were carried out with cotton and nylon between the thermal stimulators and the skin. Results showed that the presence of clothing requires higher intensity thermal changes for detection but that these changes are more comfortable than direct stimulation on skin.
Martin Halvey, Graham A. Wilson, Yolanda Vazquez-Alvarez, Stephen A. Brewster, Stephen A. Hughes
ICMI1
2011 The effects of walking, feedback and control method on pressure-based interaction
abstract
This paper presents a study looking into the effects of walking and the use of visual and audio feedback on the application of pressure for linear targeting. Positional and Rate-based control methods are compared in order to determine which allows for more stable and accurate selections, both while sitting and mobile. Results suggest that Rate-based control is superior for both mobile (walking) and static (sitting) linear targeting, and that mobility significantly increases errors, selection time and subjective workload. The use of only audio feedback significantly increased errors and task time for Positional control and static Rate-based control, but not mobile Rate-based control. Despite this, the results still suggest that audio control of pressure interaction while walking is highly accurate and usable.
Graham A. Wilson, Stephen A. Brewster, Martin Halvey, Andrew Crossan, Craig D. Stewart
Mobile HCI3
2010 A multi faceted recommendation approach for explorative video retrieval tasks
abstract
In this paper we examine the use of multi faceted recommendations to aid users while carrying out exploratory video retrieval tasks. These recommendations are integrated into ViGOR (Video Grouping, Organisation and Retrieval), a system which employs grouping techniques to facilitate video retrieval tasks. Two types of recommendations based on past usage history are utilised, the first attempts to couple the multi-faceted nature of explorative video retrieval tasks with the current user interests in order to provide global recommendations, while the second exploits the organisational features of ViGOR in order to provide recommendations based on a specific aspect of the user's task.
David Vallet, Martin Halvey, David Hannah, Joemon M. Jose
IUI2
2010 ACM international workshop on social, adaptive and personalized multimedia interaction and access (SAPMIA 2010)
abstract
In an effort to address and overcome some of the open issues that hinder effective access and interaction of multimedia content, this workshop will bring together individuals from a number of research communities, including but not limited to Multimedia Distribution and Access, Social Network Analysis, Multimedia Content Analysis, and User Modelling Adaptation and Personalization. It is our belief that a synergetic approach involving these areas of work can exceed their individual potentials, leading to improved access, understanding, and retrieval of multimedia content. The main objective of this workshop is to provide a forum to disseminate work that explicitly exploits the synergy between multimedia content analysis, personalisation, and next generation networking and community aspects of social networks. We believe that this integration could result on robust, personalized multimedia services, providing users with an improved multimedia experience.
David Vallet, Naeem Ramzan, Martin Halvey, Charalampos Z. Patrikakis
ACM Multimedia3
2010 Towards Annotation of Video as Part of Search
Martin Halvey, Joemon M. Jose
MMM1
2010 An asynchronous collaborative search system for online video search
Martin Halvey, David Vallet, David Hannah, Yue Feng 0002, Joemon M. Jose
Inf. Process. Manag.1
2009 Diversity, Assortment, Dissimilarity, Variety: A Study of Diversity Measures Using Low Level Features for Video Retrieval
Martin Halvey, P. Punitha 0001, David Hannah, Robert Villa, Frank Hopfgartner, Anuj Goyal, Joemon M. Jose
ECIR1
2009 Aggregative query generation
abstract
This paper proposes an aggregative query generation which exploits a media document representation called feature term to create a query from multiple media examples, e.g. images. A feature term denotes an interval of one media feature dimension, such as a bin in colour histogram. This approach (1) can easily accumulate features from multiple query examples to generate an efficient query; (2) enables the exploration of text-based retrieval models for multimedia retrieval. Two criteria, minimised chi2and maximised entropy, are proposed to optimise feature term selection. Two ranking functions, KL divergence and tf-idf based BM25 model, are used for relevance estimation. Experiments on the Corel photo collection demonstrate the effectiveness of feature terms.
Reede Ren, Martin Halvey, Joemon M. Jose
ICME2
2008 Search trails using user feedback to improve video search
abstract
In this paper we present an innovative approach for aiding users in the difficult task of video search. We use community based feedback mined from the interactions of previous users of our video search system to aid users in their search tasks. This feedback is the basis for providing recommendations to users of our video retrieval system. The ultimate goal of this system is to improve the quality of the results that users find, and in doing so, help users to explore a large and difficult information space and help them consider search options that they may not have considered otherwise. In particular we wish to make the difficult task of search for video much easier for users. The results of a user evaluation indicate that we achieved our goals, the performance of the users in retrieving relevant videos improved, and users were able to explore the collection to a greater extent.
Frank Hopfgartner, David Vallet, Martin Halvey, Joemon M. Jose
ACM Multimedia3
2007 Exploring social dynamics in online media sharing
abstract
It is now feasible to view media at home as easily as text-based pages were viewed when the World Wide Web (WWW) first emerged. This development has supported media sharing and search services providing hosting, indexing and access to large, online media repositories. Many of these sharing services also have a social aspect to them. This paper provides an initial analysis of the social interactions on a video sharing and search service (www.youtube.com). Results show that many users do not form social networks in the online community and a very small number do not appear to contribute to the wider community. However, it does seem those people who do use the available tools have much a greater tendency to form social connections.
Martin Halvey, Mark T. Keane
WWW1
2007 An assessment of tag presentation techniques
abstract
With the growth of social bookmarking a new approach for metadata creation called tagging has emerged. In this paper we evaluate the use of tag presentation techniques. The main goal of our evaluation is to investigate the effect of some of the different properties that can be utilized in presenting tags e.g. alphabetization, using larger fonts etc. We show that a number of these factors can affect the ease with which users can find tags and use the tools for presenting tags to users.
Martin Halvey, Mark T. Keane
WWW1
2006 Time based patterns in mobile-internet surfing
abstract
In this paper we investigate environmental factors that can result in users having different preferences and behaviors at different times of the day. An analysis is carried out of a large sample of user data for Wireless Application Protocol (WAP) browsing to determine whether user surfing patterns vary depending on time. We examine traffic on an hourly and daily basis, and show that accesses to particular categories of pages vary relative to time. We also build Markov models, which are temporal; to predict user navigation, and illustrate those predictive models are more accurate and beneficial to mobile Internet users than traditional methods. This analysis provides insight into improving the effectiveness and efficiency of navigation prediction.
Martin Halvey, Mark T. Keane, Barry Smyth
CHI1
2006 Temporal rules for mobile web personalization
abstract
Many systems use past behavior, preferences and environmental factors to attempt to predict user navigation on the Internet. However we believe that many of these models have shortcomings, in that they do not take into account that users may have many different sets of preferences. Here we investigate an environmental factor, namely time, in making predictions about user navigation. We present methods for creating temporal rules that describe user navigation patterns. We also show the benefit of using these rules to predict user navigation and also show the benefits of these models over traditional methods. An analysis is carried out on a sample of usage logs for Wireless Application Protocol (WAP) browsing, and the results of this analysis verify our hypothesis.
Martin Halvey, Mark T. Keane, Barry Smyth
WWW1
2005 Time Based Segmentation of Log Data for User Navigation Prediction in Personalization
abstract
There are many systems that attempt to predict user navigation on the Internet through the use of past behavior, preferences and environmental factors. We believe that many of these models have shortcomings, in that they do not take into account that users may have many different sets of preferences, specifically, we investigate time as an environmental factor in making predictions about user navigation. We present a method for segmenting log files in order to learn time dependent models to predict user navigation patterns and show the benefits of these models over traditional methods. An analysis is carried out on a sample of usage logs for wireless application protocol (WAP) browsing, and the results of this analysis verify our hypothesis.
Martin Halvey, Mark T. Keane, Barry Smyth
Web Intelligence1