Abstract Neural implicit surfaces have emerged as an effective, learnable representation for shapes of arbitrary topology. However, representing open surfaces remains a challenge. Different methods, such as unsigned distance fields (UDF), have been proposed to tackle this issue, but a general solution remains elusive. The generalized winding number (GWN), which is often used to distinguish interior points from exterior points of 3D shapes, is arguably the most promising approach. The GWN changes smoothly in regions where there is a hole in the surface, but it is discontinuous at points on the surface. Effectively, this means that it can be used in lieu of an implicit surface representation while providing information about holes, but, unfortunately, it does not provide information about the distance to the surface necessary for e.g. ray tracing, and special care must be taken when implementing surface reconstruction. Therefore, we introduce the semi‐signed distance field (SSDF) representation which comprises both the GWN and the surface distance. We compare the GWN and SSDF representations for the applications of surface reconstruction, interpolation, reconstruction from partial data, and latent vector analysis using two very different data sets. We find that both the GWN and SSDF are well suited for neural representation of open surfaces.

OBJECTIVE: In this study, wepropose an automatic diagnostic algorithm for detecting otitis media based on wideband tympanometry measurements. METHODS: We develop a convolutional neural network for classification of otitis media based on the analysis of the wideband tympanogram. Saliency maps are computed to gain insight into the decision process of the convolutional neural network. Finally, we attempt to distinguish between otitis media with effusion and acute otitis media, a clinical subclassification important for the choice of treatment. RESULTS: The approach shows high performance on the overall otitis media detection with an accuracy of 92.6%. However, the approach is not able to distinguish between specific types of otitis media. CONCLUSION: Out approach can detect otitis media with high accuracy and the wideband tympanogram holds more diagnostic information than the commonly used techniques wideband absorbance measurements and simple tympanograms. SIGNIFICANCE: This study shows how advanced deep learning methods enable automatic diagnosis of otitis media based on wideband tympanometry measurements, which could become a valuable diagnostic tool.

In this study, we propose an automatic diagnostic algorithm for detecting otitis media based on otoscopy images of the tympanic membrane. A total of 1336 images were assessed by a medical specialist into three diagnostic groups: acute otitis media, otitis media with effusion, and no effusion. To provide proper treatment and care and limit the use of unnecessary antibiotics, it is crucial to correctly detect tympanic membrane abnormalities, and to distinguish between acute otitis media and otitis media with effusion. The proposed approach for this classification task is based on deep metric learning, and this study compares the performance of different distance-based metric loss functions. Contrastive loss, triplet loss and multi-class N-pair loss are employed, and compared with the performance of standard cross-entropy and class-weighted cross-entropy classification networks. Triplet loss achieves high precision on a highly imbalanced data set, and the deep metric methods provide useful insight into the decision making of a neural network. The results are comparable to the best clinical experts and paves the way for more accurate and operator-independent diagnosis of otitis media.

Obstructive sleep apnea (OSA) is characterized by decreased breathing events that occur through the night, with severity reported as the apnea-hypopnea index (AHI), which is associated with certain craniofacial features. In this study, we used data from 1366 patients collected as part of Stanford Technology Analytics and Genomics in Sleep (STAGES) across 11 US and Canadian sleep clinics and analyzed 3D craniofacial scans with the goal of predicting AHI, as measured using gold standard nocturnal polysomnography (PSG). First, the algorithm detects pre-specified landmarks on mesh objects and aligns scans in 3D space. Subsequently, 2D images and depth maps are generated by rendering and rotating scans by 45-degree increments. Resulting images were stacked as channels and used as input to multi-view convolutional neural networks, which were trained and validated in a supervised manner to predict AHI values derived from PSGs. The proposed model achieved a mean absolute error of 11.38 events/hour, a Pearson correlation coefficient of 0.4, and accuracy for predicting OSA of 67% using 10-fold cross-validation. The model improved further by adding patient demographics and variables from questionnaires. We also show that the model performed at the level of three sleep medicine specialists, who used clinical experience to predict AHI based on 3D scan displays. Finally, we created topographic displays of the most important facial features used by the model to predict AHI, showing importance of the neck and chin area. The proposed algorithm has potential to serve as an inexpensive and efficient screening tool for individuals with suspected OSA.

Numerical simulations offer a feasible alternative to the direct acoustic measurement of individual head-related transfer functions (HRTFs). For the acquisition of high quality 3D surface scans, as required for these simulations, several approaches exist. In this paper, we systematically analyze the variations between different approaches and evaluate the influence of the accuracy of 3D scans on the resulting simulated HRTFs. To assess this effect, HRTFs were numerically simulated based on 3D scans of the head and pinna of the FABIAN dummy head generated with 6 different methods. These HRTFs were analyzed in terms of interaural time difference, interaural level difference, energetic error in auditory filters and by their modeled localization performance. From the results, it is found that a geometric precision of about 1 mm is needed to maintain accurate localization cues, while a precision of about 4 mm is sufficient to maintain the overall spectral shape.

Better understanding of the anatomical variability of the human cochlear is important for the design and function of Cochlear Implants. Proper non-rigid alignment of high-resolution cochlear μ CT data is a challenge for the typical cubic B-spline registration model. In this paper we study one way of incorporating skeleton-based similarity as an anatomical registration prior. We extract a centerline skeleton of the cochlear spiral, and generate corresponding parametric pseudo-landmarks between samples. These correspondences are included in the cost function of a typical cubic B-spline registration model to provide a more global guidance of the alignment. The resulting registrations are evaluated using different metrics for accuracy and model behavior, and compared to the results of a registration without the prior.

Motion tracking is a widely used technique to analyze and measure adult human movement. However, these methods cannot be transferred directly to motion tracking of infants due to the big differences in the underlying human model. However, motion tracking of infants can be used for automatic analysis of infant development and might be able to tell something about possible motor disabilities such as cerebral palsy. In this paper, we address marker less 3D body part detection of infants using a widely available depth sensor and discuss some of the major challenges that arise. We present a method to detect and identify a set of the anatomical extremities and the results are evaluated based on manually annotated 3D positions.

A custom designed markerless tracking system was demonstrated to be applicable for positron emission tomography (PET) brain imaging. Precise head motion registration is crucial for accurate motion correction (MC) in PET imaging. State-of-the-art tracking systems applied with PET brain imaging rely on markers attached to the patient's head. The marker attachment is the main weakness of these systems. A healthy volunteer participating in a cigarette smoking study to image dopamine release was scanned twice for 2 h with (11)C-racolopride on the high resolution research tomograph (HRRT) PET scanner. Head motion was independently measured, with a commercial marker-based device and the proposed vision-based system. A list-mode event-by-event reconstruction algorithm using the detected motion was applied. A phantom study with hand-controlled continuous random motion was obtained. Motion was time-varying with long drift motions of up to 18 mm and regular step-wise motion of 1-6 mm. The evaluated measures were significantly better for motion-corrected images compared to no MC. The demonstrated system agreed with a commercial integrated system. Motion-corrected images were improved in contrast recovery of small structures.

We present a system for head motion tracking in 3D brain imaging. The system is based on facial surface reconstruction and tracking using a structured light (SL) scanning principle. The system is designed to fit into narrow 3D medical scanner geometries limiting the field of view. It is tested in a clinical setting on the high resolution research tomograph (HRRT), Siemens PET scanner with a head phantom and volunteers. The SL system is compared to a commercial optical tracking system, the Polaris Vicra system, from NDI based on translatory and rotary ground truth motions of the head phantom. The accuracy of the systems was similar, with root mean square (rms) errors of 0.09 degrees for ±20 degrees axial rotations, and rms errors of 0.24 mm for ± 25 mm translations. Tests were made using (1) a light emitting diode (LED) based miniaturized video projector, the Pico projector from Texas Instruments, and (2) a customized version of this projector replacing a visible light LED with a 850 nm near infrared LED. The latter system does not provide additional discomfort by visible light projection into the patient's eyes. The main advantage over existing head motion tracking devices, including the Polaris Vicra system, is that it is not necessary to place markers on the patient. This provides a simpler workflow and eliminates uncertainties related to marker attachment and stability. We show proof of concept of a marker less tracking system especially designed for clinical use with promising results.

A method for implicit surface reconstruction is proposed. The novelty in this paper is the adaptation of Markov Random Field regularization of a distance field. The Markov Random Field formulation allows us to integrate both knowledge about the type of surface we wish to reconstruct (the prior) and knowledge about data (the observation model) in an orthogonal fashion. Local models that account for both scene-specific knowledge and physical properties of the scanning device are described. Furthermore, how the optimal distance field can be computed is demonstrated using conjugate gradients, sparse Cholesky factorization, and a multiscale iterative optimization scheme. The method is demonstrated on a set of scanned human heads and, both in terms of accuracy and the ability to close holes, the proposed method is shown to have similar or superior performance when compared to current state-of-the-art algorithms.