Pilots operating modern cockpits often face high cognitive demands due to complex interfaces and multitasking requirements, which can lead to overload and decreased performance. This study introduces AdaptiveCoPilot, a neuroadaptive guidance system that adapts visual, auditory, and textual cues in real time based on the pilot’s cognitive workload, measured via functional Near-Infrared Spectroscopy (fNIRS). A formative study with expert pilots (N=3) identified adaptive rules for modality switching and information load adjustments during preflight tasks. These insights informed the design of AdaptiveCoPilot, which integrates cognitive state assessments, behavioral data, and adaptive strategies within a context-aware Large Language Model (LLM). The system was evaluated in a virtual reality (VR) simulated cockpit with licensed pilots (N=8), comparing its performance against baseline and random feedback conditions. The results indicate that the pilots using AdaptiveCoPilot exhibited higher rates of optimal cognitive load states on the facets of working memory and perception, along with reduced task completion times. Based on the formative study, experimental findings, qualitative interviews, we propose a set of strategies for future development of neuroadaptive pilot guidance systems and highlight the potential of neuroadaptive systems to enhance pilot performance and safety in aviation environments.

The aim of this study was to experimentally test the effects of different electromyographic-based prosthetic control modes on user task performance, cognitive workload, and perceived usability to inform further human-centered design and application of these prosthetic control interfaces. We recruited 30 able-bodied participants for a between-subjects comparison of three control modes: direct control (DC), pattern recognition (PR), and continuous control (CC). Multiple human-centered evaluations were used, including task performance, cognitive workload, and usability assessments. To ensure that the results were not task-dependent, this study used two different test tasks, including the clothespin relocation task and Southampton hand assessment procedure-door handle task. Results revealed performance with each control mode to vary among tasks. When the task had high-angle adjustment accuracy requirements, the PR control outperformed DC. For cognitive workload, the CC mode was superior to DC in reducing user load across tasks. Both CC and PR control appear to be effective alternatives to DC in terms of task performance and cognitive load. Furthermore, we observed that, when comparing control modes, multitask testing and multifaceted evaluations are critical to avoid task-induced or method-induced evaluation bias. Hence, future studies with larger samples and different designs will be needed to expand the understanding of prosthetic device features and workload relationships.

Amputees use prosthetic devices to perform activities of daily living. However, some users reject their devices due to the lack of usability or high cognitive workload. Although virtual reality has been studied in this domain for training purposes, there has not been any investigation on usability and cognitive workload of using virtual reality simulations for training of prosthetic devices. The objective of this study was to compare cognitive workload and usability of using virtual reality-based simulation of electromyography based prosthetic devices and physical devices. The findings suggested that using virtual reality simulations were helpful in reducing cognitive workload and increasing perceived usability of prosthetic devices.

A mobile navigation application (App) can provide flexible wayfinding guidance, save time, and reduce stress for people in unfamiliar buildings or environments. Wayfinding is also a challenging task for individuals with disabilities. The objective of this study was to provide a comprehensive set of guidelines for designing navigation apps for individuals with disabilities. A review of the literature was conducted on scientific studies and commercially available navigation apps using Web of Science, Compendex, ACM Digital Library, IEEE Xplore, Wiley Online, Science Direct, SpringerLink, Taylor & Francis, Apple store, and Google Play. The findings led to 82 design guidelines categorized based on Nielsen’s usability principles. The guidelines were implemented in an interface prototype to help users navigate places within a shopping mall. The prototype demonstrated that the proposed design guidelines are easily applicable and provided a roadmap for the future design of navigation apps for people with different types of disabilities.

Limb amputation can cause severe functional disability for the performance of activities of daily living. Previous studies have found differences in cognitive demands imposed by prosthetic devices due to variations in their design. The objectives of this article were to 1) identify the range of cognitive workload (CW) assessment techniques used in prior studies comparing different prosthetic devices, 2) identify the device configurations or features that reduced CW of users, and 3) provide guidelines for designing future prosthetic devices to reduce CW. A literature search was conducted using Compendex, Inspec, Web of Science, Proquest, IEEE, Engineering Research Database, PubMed, Cochrane, and Google Scholar. Forty-three studies met the inclusion criteria. Findings suggested that CW of prosthetic devices was assessed using physiological, task performance, and subjective measures. However, due to the limitations of these methods, there is a need for more theoretical and model-based approaches to quantify CW. Device configurations such as hybrid input signals and use of multimodal feedback can reduce CW of prosthetic devices. Furthermore, to evaluate the effectiveness of a training strategy for reducing CW and improving device usability, both task performance and subjective measures should be considered. Based on the literature review, a set of guidelines was provided to improve the usability of future prosthetic devices and reduce CW.

Motor vehicle crashes are a leading cause of police officers’ deaths in the line of duty. Previous studies have found that officer distraction caused by in-vehicle technologies such as the mobile computer terminal (MCT) is one of the main causes of these crashes. The objective of this study was to evaluate the usability issues of existing MCTs implemented in police vehicles across the U.S. and to provide recommendations to improve future technologies. Two focus group meetings were conducted with police officers from different departments. The discussion was analyzed based on Molich and Nielsen’s usability principles and using a directed content analysis approach. The most frequently mentioned usability issues were related to the inappropriate presentation of information on the MCT and the lack of interface consistency and adaptability. The provided recommendations can be beneficial in improving police in-vehicle technology design and safety of officers in police operations.

Motor vehicle crashes are a leading cause of police officers' deaths in the line of duty. These crashes are mainly attributed to officers' use of in-vehicle technologies while driving, distraction, fatigue, and high-speed driving conditions. The objective of this study is to classify officers' driving situations using a combination of driver behavior and eye-tracking measures. The study compared three algorithms, including random forest (RF), support vector machine (SVM), and random Fourier features (RFF) to classify officers' driving situations (i.e., normal vs. pursuit driving) and in-vehicle technology use. The results suggested that driver behavior measures, combined with RF or SVM methods, are most promising for classifying officers' driving condition (accuracy of about 90%). However, it might be more efficient to apply RFF with driver behavior measures to classify officers' use of in-vehicle technologies while driving due to the time cost reduction of RFF as compared to SVM and RF algorithms. The findings can be applied to improve future police vehicles, training protocols, and to provide adaptive technology solutions to reduce officers' driving distraction and workload.

Previous studies have found that electromyography (EMG)-based prosthetic devices provide higher grasping force, increase functional performance, and have greater range of motion over conventional prostheses. However, cognitive workload (CW) is still one of the issues that can negatively affect device usability and satisfaction. In order to evaluate CW of prosthetic devices early in the design cycle, it is first necessary to select the most appropriate measures. Therefore, the objectives of this study were to: (1) review the CW measurement techniques used in prior EMG-based prosthetic device evaluations; and (2) provide guidelines to select the most appropriate measurement techniques. The findings suggested that cognitive performance models (CPM), subjective measures, task performance measures, and some physiological measures were sensitive in detecting CW differences among prosthetic device configurations and therefore could be useful tools in usability evaluation of these technologies. However, in order to reduce intrusiveness and cost, methods such as subjective workload measures, task performance, and CPM are more beneficial as compared to physiological measurements. Guidelines proposed in this study can be beneficial to select the most appropriate CW measurement techniques in order to improve sensitivity and accuracy and reduce intrusiveness and cost.

Two types of feedback, including knowledge of results (KR) and knowledge of performance (KP) are typically delivered as part of motor training using different sensory modalities. Twenty-four right-handed individuals performed a computer-based psychomotor training task using a contemporary haptic interface. Results revealed that KP was superior to KR for overall task performance retention, whereas KR was good for training specific aspects of performance. A combination of KP and KR through the same modality did not produce an additive positive learning effect for task performance. Auditory and haptic feedback improved retention over visual, but only with the use of multiple information cues. Design guidelines are provided for training systems for motor skill development and/or rehabilitation.

The goal of this study was to investigate the use of cognitive modeling to assess the usability of an upper-limb prosthesis with a focus on mental workload responses. Prior studies have investigated usability of upper-limb prostheses with subjective surveys and physiological measures. However, these approaches have limitations, including subject recall of conditions and physiological response contamination by head and body movements and user speech during task performance as well as sensitivity to physical fatigue and room lighting conditions. Cognitive modeling was used to assess mental workload in use of transradial upper-limb prosthesis. A case study was conducted with a participant with upper-limb amputation using two different types of electromyography-based control schemes, including conventional direct control (DC) and pattern recognition (PR) control in order to compare cognitive model outcomes with mental workload assessment using eye-tracking measures. Cognitive models time estimates were also compared with actual task completion time results from the case study to further assess the validity of cognitive modeling as an analytical tool for evaluating upper limb prosthesis usability. Findings of both the cognitive models and case study revealed the PR mode to be more intuitive, reduce cognitive load, and increase efficiency in prosthetic control as compared to the DC mode. Results of the present study revealed that cognitive modeling can be used as an analytical approach for assessing upper-limb prosthetic device usability in terms of workload outcomes. Future studies should validate the present findings with more precise time estimations and a larger user sample size.

Task outcome feedback is often used to sustain human work motivation and ensure overall productivity. Feedback can also be useful for reducing learning periods for new tasks. Two types of feedback, including knowledge of results (KR) and knowledge of performance (KP), are commonly delivered as part of motor training by using various sensory modalities (e.g., visual, auditory or kinesthetic). Unfortunately, there is a lack of a design basis for such sensory feedback systems to optimize human motivation. Twenty-four right-handed participants were recruited for computer-based psychomotor task training using a contemporary haptic interface. During task performance, KP, KR or combo feedback was presented to participants through one of three sensory modalities, including visual, auditory or haptic. An Intrinsic Motivation Inventory (IMI) questionnaire was used to evaluate participant motivation under each specific condition. Results revealed task outcome related feedback (KR or combo) to be superior to process-based feedback (KP) in terms of sustaining human intrinsic motivation during the training period. The haptic modality was also found to have a stronger motivating effect than the visual or auditory modalities. Findings of this study are beneficial for future feedback designs to sustain human motivation during occupational skill training, such as assembly operations.

The goal of this study was to compare the usability of two control schemes for a transradial myoelectric prosthesis, including conventional direct control (DC) and pattern recognition (PR) control, when used by able-bodied individuals. Three types of response measures were captured to assess the control schemes, including learnability, performance, and cognitive workload. Prior research has applied performance and cognitive workload metrics for evaluation of prosthetics; however, workload measures applied in these studies (e.g., heart rate, electroencephalography, and respiration rate) have many limitations. This study used eye tracking to compare cognitive load implications of the different control schemes for a two degrees-of-freedom myoelectric prosthesis. In total, 12 participants were assigned to either control condition (six persons each) or perform a clothespin relocation task. Results revealed the PR scheme to be more intuitive for users and superior to DC across all response measures. We observed a lower learning percentage (i.e., greater learning potential), lower cognitive load, and greater productivity in task performance. This preliminary study illustrates efficacy of using eye-tracking-based measures of cognitive load and standardize test paradigms for assessment of upper limb prosthetic usability and supports PR prosthetic device control as an intuitive alternative to DC.

Many occupations require both physical exertion and the ability to navigate in an environment, simultaneously. This study investigated how intensity of physical activity influences direction determination and distance estimation. Thirty high fit young males participated in a lab study. Results showed that while high fit young males were accurate in determining direction across levels of physical exertion, they were significantly less accurate in distance estimation under high exertion intensity. Although physical activity level did not influence direction determination accuracy, response time was significantly shorter when participants were subject to low physical loading in comparison to medium and high loading. In addition, we found that distance estimation response time increased as physical workload increased. Findings of this study can be used to enhance presentation of navigation information in occupations that require concurrent physical activity and navigation.

The purpose of this study was to compare the cognitive workload of able-bodied individuals when using a myoelectric prosthetic under direct control (DC) or electromyography pattern recognition (PR) control. Different from existing clinical evaluations involving dual-task performance, pupillography measured with an eye-tracking system was used to quantitatively assess user cognitive workload in using a 2 degree-of-freedom prosthesis for a clothespin task. Test results revealed the PR control to produce superior task performance and to require lower cognitive load than demanded of participants under the DC condition. This study provided evidence of both performance and workload advantages of PR control over DC control. PR control was more intuitive to the prosthesis user and, therefore, required less cognitive effort. Furthermore, the study identified a new effective measure of cognitive workload in upper limb prosthesis use via pupillography.