Jackie Ayoub

dblp:249/1304 · DBLP profile ↗
← Back
8ranked-venue papers
5as first author
7since 2021 · last 2025
0000-0003-0274-492XORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Human-computer interaction and ubiquitous computing · 4 · 2 first-author · 3 since 2021Applied, interdisciplinary, general and emerging computing · 3 · 2 first-author · 3 since 2021Artificial intelligence and machine learning · 1 · 1 since 2021Databases, data management, data science and information retrieval · 1 · 1 first-author · 1 since 2021
YearPublicationVenuePosition
2025 A Cognitive Framework for Timely AI Communication
Mark Steyvers, Lukas William Mayer, Jackie Ayoub
CogSci3
2025 Help Wanted - or Not: Bridging the Empathy Gap between Wheelchair Users and Passersby through AI-Mediated Communication with Politeness Strategies
Miao Song 0007, Ziwei Liu 0009, Danyang Tian, Jackie Ayoub, Ehsan Moradi-Pari
IUI4
2024 Building Contextualized Trust Profiles in Conditionally Automated Driving
abstract
Trust is crucial for ensuring the safety, security, and widespread adoption of automated vehicles (AVs), and if trust is lacking, drivers and the general public may hesitate to embrace this technology. This research seeks to investigate contextualized trust profiles in order to create personalized experiences for drivers in AVs with varying levels of reliability. A driving simulator experiment involving 70 participants revealed three distinct contextualized trust profiles (i.e.,confident copilots,myopic pragmatists, andreluctant automators) identified through K-means clustering, and analyzed in relation to drivers' dynamic trust, dispositional trust, initial learned trust, personality traits, and emotions. The experiment encompassed eight scenarios where participants were requested to take over control from the AV in three conditions: a control condition, a false alarm condition, and a miss condition. To validate the models, a multinomial logistic regression model was constructed using the shapley additive explanations explainer to determine the most influential features in predicting contextualized trust profiles, achieving an F1-score of 0.90 and an accuracy of 0.89. In addition, an examination of how individual factors impact contextualized trust profiles provided valuable insights into trust dynamics from a user-centric perspective. The outcomes of this research hold significant implications for the development of personalized in-vehicle trust monitoring and calibration systems to modulate drivers' trust levels, thereby enhancing safety and user experience in automated driving.
Lilit Avetisyan, Jackie Ayoub, Xi Jessie Yang, Feng Zhou 0003
IEEE Trans. Hum. Mach. Syst.2
2023 Real-Time Trust Prediction in Conditionally Automated Driving Using Physiological Measures
abstract
Trust calibration poses a significant challenge in the interaction between drivers and automated vehicles (AVs) in the context of human-automation collaboration. To effectively calibrate trust, it becomes crucial to accurately measure drivers’ trust levels in real time, allowing for timely interventions or adjustments in the automated driving. One viable approach involves employing machine learning models and physiological measures to model the dynamic changes in trust. This study introduces a technique that leverages machine learning models to predict drivers’ real-time dynamic trust in conditional AVs using physiological measurements. We conducted the study in a driving simulator where participants were requested to take over control from automated driving in three conditions that included a control condition, a false alarm condition, and a miss condition. Each condition had eight takeover requests (TORs) in different scenarios. Drivers’ physiological measures were recorded during the experiment, including galvanic skin response (GSR), heart rate (HR) indices, and eye-tracking metrics. Using five machine learning models, we found that eXtreme Gradient Boosting (XGBoost) performed the best and was able to predict drivers’ trust in real time with an f1-score of 89.1% compared to a baseline model of$K$-nearest neighbor classifier of 84.5%. Our findings provide good implications on how to design an in-vehicle trust monitoring system to calibrate drivers’ trust to facilitate interaction between the driver and the AV in real time.
Jackie Ayoub, Lilit Avetisyan, Xi Jessie Yang, Feng Zhou 0003
IEEE Trans. Intell. Transp. Syst.1
2022 An Investigation of Drivers' Dynamic Situational Trust in Conditionally Automated Driving
abstract
Understanding how trust is built over time is essential, as trust plays an important role in the acceptance and adoption of automated vehicles (AVs). This study aims to investigate the effects of system performance and participants’ trust preconditions on dynamic situational trust during takeover transitions. We evaluate the dynamic situational trust of 42 participants using both self-reported and behavioral measures while watching 30 videos with takeover scenarios. The study is a 3 by 2 mixed-subjects design, where the within-subjects variable is the system performance (i.e., accuracy levels of 95%, 80%, and 70%) and the between-subjects variable is the preconditions of the participants’ trust (i.e., overtrust and undertrust). Our results showed that participants quickly adjusted their self-reported situational trust levels, which were consistent with different accuracy levels of system performance in both trust preconditions. However, participants’ behavioral situational trust was affected by their trust preconditions across different accuracy levels. For instance, the overtrust precondition significantly increased the agreement fraction compared to the undertrust precondition. The undertrust precondition significantly decreased the switch fraction compared to the overtrust precondition. These results have important implications for designing an invehicle trust calibration system for conditional AVs.
Jackie Ayoub, Lilit Avetisyan, Mustapha Makki, Feng Zhou 0003
IEEE Trans. Hum. Mach. Syst.1
2022 Predicting Driver Takeover Time in Conditionally Automated Driving
abstract
It is extremely important to ensure a safe takeover transition in conditionally automated driving. One of the critical factors that quantifies the safe takeover transition is takeover time. Previous studies identified the effects of many factors on takeover time, such as takeover lead time, non-driving tasks, modalities of the takeover requests, and scenario urgency. However, there is a lack of research to predict takeover time by considering these factors all at the same time. Toward this end, we used eXtreme Gradient Boosting (XGBoost) to predict the takeover time using a dataset from a meta-analysis study [Zhanget al.(2019)]. In addition, we used SHAP (SHapley Additive exPlanation) to analyze and explain the effects of the predictors on takeover time. We identified seven most critical predictors that resulted in the best prediction performance. Their main effects and interaction effects on takeover time were examined. The results showed that the proposed approach provided both good performance and explainability. Our findings have implications on the design of in-vehicle monitoring and alert systems to facilitate the interaction between the drivers and the automated vehicle.
Jackie Ayoub, Na Du, Xi Jessie Yang, Feng Zhou 0003
IEEE Trans. Intell. Transp. Syst.1
2021 Combat COVID-19 infodemic using explainable natural language processing models
Jackie Ayoub, Xi Jessie Yang, Feng Zhou 0003
Inf. Process. Manag.1
2019 From Manual Driving to Automated Driving: A Review of 10 Years of AutoUI
abstract
This paper gives an overview of the ten-year development of the papers presented at the International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutoUI) from 2009 to 2018. We categorize the topics into two main groups, namely, manual driving-related research and automated driving-related research. Within manual driving, we mainly focus on studies on user interfaces (UIs), driver states, augmented reality and head-up displays, and methodology; Within automated driving, we discuss topics, such as takeover, acceptance and trust, interacting with road users, UIs, and methodology. We also discuss the main challenges and future directions for AutoUI and offer a roadmap for the research in this area.
Jackie Ayoub, Feng Zhou 0003, Shan Bao, Xi Jessie Yang
AutomotiveUI1