Quantification of carotid atherosclerosis is important in monitoring patients at risk of cardiovascular events and in evaluating therapies. High-resolution 3D carotid magnetic resonance imaging (MRI) has been developed to provide extended coverage of the carotid arteries. However, the extended coverage poses a challenge as several hundreds of 2D axial images are required to be segmented for analysis. We propose a multi-dimensional hybrid framework that requires only a sparse set of manual segmentation. Dense surrogate ground truth boundaries required to train the framework are automatically generated by propagating the sparse manual segmentation using the proposed region of interest (ROI) U-Net. Furthermore, the Point U-Net was developed to generate surrogate ground truth for carotid branches without manual segmentation. The proposed framework leverages the advantages of 3D and 2D convolution neural networks (CNNs) to segment the outer wall and lumen from 3D MRI. The 3D multiscale U-Net provides a rough outer wall segmentation, which serves as the ROI to guide outer wall and lumen segmentation by the 2D ROI U-Net. The 3D Multiscale U-Net localizes the ROI automatically, bypassing the need for manual ROI identification. The 3D Multiscale U-Net was further improved by a 3D inception module installed at the bottleneck and the novel loss functions that promote longitudinal continuity and minimize the overlap of the internal and external carotid arteries. Extensive evaluation on the publicly available Carotid Artery Vessel Wall Segmentation challenge dataset shows that our approach outperforms the top-ranked solution in the challenge and state-of-the-art segmentation methods.

Facial micro-expressions (MEs) refer to brief spontaneous facial movements that can reveal a person's genuine emotion. They are valuable in lie detection, criminal analysis, and other areas. While deep learning-based ME recognition (MER) methods achieved impressive success, these methods typically require pre-processing using conventional optical flow-based methods to extract facial motions as inputs. To overcome this limitation, we proposed a novel MER framework using self-supervised learning to extract facial motion for ME (SelfME). To the best of our knowledge, this is the first work using an automatically self-learned motion technique for MER. However, the self-supervised motion learning method might suffer from ignoring symmetrical facial actions on the left and right sides of faces when extracting fine features. To address this issue, we developed a symmetric contrastive vision transformer (SCViT) to constrain the learning of similar facial action features for the left and right parts of faces. Experiments were conducted on two benchmark datasets showing that our method achieved state-of-the-art performance, and ablation studies demonstrated the effectiveness of our method.

Segmentation of the carotid section encompassing the common carotid artery (CCA), the bifurcation and the internal carotid artery (ICA) from three-dimensional ultrasound (3DUS) is required to measure the vessel wall volume (VWV) and localized vessel-wall-plus-plaque thickness (VWT), shown to be sensitive to treatment effect. We proposed an approach to combine a centerline extraction network (CHG-Net) and a dual-stream centerline-guided network (DSCG-Net) to segment the lumen-intima (LIB) and media-adventitia boundaries (MAB) from 3DUS images. Correct arterial location is essential for successful segmentation of the carotid section encompassing the bifurcation. We addressed this challenge by using the arterial centerline to enhance the localization accuracy of the segmentation network. The CHG-Net was developed to generate a heatmap indicating high probability regions for the centerline location, which was then integrated with the 3DUS image by the DSCG-Net to generate the MAB and LIB. The DSCG-Net includes a scale-based and a spatial attention mechanism to fuse multi-level features extracted by the encoder, and a centerline heatmap reconstruction side-branch connected to the end of the encoder to increase the generalization ability of the network. Experiments involving 224 3DUS volumes produce a Dice similarity coefficient (DSC) of 95.8±1.9% and 92.3±5.4% for CCA MAB and LIB, respectively, and 93.2±4.4% and 89.0±10.0% for ICA MAB and LIB, respectively. Our approach outperformed four state-of-the-art 3D CNN models, even after their performances were boosted by centerline guidance. The efficiency afforded by the framework would allow it to be incorporated into the clinical workflow for improved quantification of plaque change.

Internships help students connect what they have learned in the classroom to the real world, and students with access to internships are more likely to graduate and secure employment. However, many students are unable to find an internship by the time they graduate. This experience report describes a program where volunteer software engineers mentor students as they work on open-source projects in the summer, offered as an alternative to a traditional internship experience. We catalog the considerations involved in providing an experience similar to a traditional internship, describe our program's design, and provide two years' worth of participant evaluations and career outcomes as a measure of efficacy. The program served mostly undergraduates from non-R1 schools who are underrepresented in technology, and achieved similar educational outcomes to a traditional internship program. Most promisingly, mentors were willing to serve as a professional reference for 80% of students and the number of graduating seniors who secured full-time employment in technology was 7 points higher than average (despite occurring during the COVID-19 pandemic).

While three-dimensional (3D) late gadolinium-enhanced (LGE) magnetic resonance (MR) imaging provides good conspicuity of small myocardial lesions with short acquisition time, it poses a challenge for image analysis as a large number of axial images are required to be segmented. We developed a fully automatic convolutional neural network (CNN) called cascaded triplanar autoencoder M-Net (CTAEM-Net) to segment myocardial scar from 3D LGE MRI. Two sub-networks were cascaded to segment the left ventricle (LV) myocardium and then the scar within the pre-segmented LV myocardium. Each sub-network contains three autoencoder M-Nets (AEM-Nets) segmenting the axial, sagittal and coronal slices of the 3D LGE MR image, with the final segmentation determined by voting. The AEM-Net integrates three features: (1) multi-scale inputs, (2) deep supervision and (3) multi-tasking. The multi-scale inputs allow consideration of the global and local features in segmentation. Deep supervision provides direct supervision to deeper layers and facilitates CNN convergence. Multi-task learning reduces segmentation overfitting by acquiring additional information from autoencoder reconstruction, a task closely related to segmentation. The framework provides an accuracy of 86.43% and 90.18% for LV myocardium and scar segmentation, respectively, which are the highest among existing methods to our knowledge. The time required for CTAEM-Net to segment LV myocardium and the scar was 49.72 ± 9.69s and 120.25 ± 23.18s per MR volume, respectively. The accuracy and efficiency afforded by CTAEM-Net will make possible future large population studies. The generalizability of the framework was also demonstrated by its competitive performance in two publicly available datasets of different imaging modalities.

Many colleges lack the resources to teach computer science students the skills to succeed in interviews and work on real-world products. Internships solve both problems, but are often not accessible to under-served students and colleges, adding to the under-representation of minorities in technology. This poster reports the results of a program providing unpaid open-source internships with volunteer industry mentors.

Coronavirus 2019 has made a significant impact on the world. One effective strategy to prevent infection for people is to wear masks in public places. Certain public service providers require clients to use their services only if they properly wear masks. There are, however, only a few research studies on automatic face mask detection. In this paper, we proposed RetinaFaceMask, the first high-performance single stage face mask detector. First, to solve the issue that existing studies did not distinguish between correct and incorrect mask wearing states, we established a new dataset containing these annotations. Second, we proposed a context attention module to focus on learning discriminated features associated with face mask wearing states. Third, we transferred the knowledge from the face detection task, inspired by how humans improve their ability via learning from similar tasks. Ablation studies showed the advantages of the proposed model. Experimental findings on both the public and new datasets demonstrated the state-of-the-art performance of our model.