Accurately estimating the informativeness of individual samples in a dataset is an important objective in deep learning, as it can guide sample selection, which can improve model efficiency and accuracy by removing redundant or potentially harmful samples. We propose $\text{\textit{Laplace Sample Information}}$ ($\mathsf{LSI}$) measure of sample informativeness grounded in information theory widely applicable across model architectures and learning settings. $\mathsf{LSI}$ leverages a Bayesian approximation to the weight posterior and the KL divergence to measure the change in the parameter distribution induced by a sample of interest from the dataset. We experimentally show that $\mathsf{LSI}$ is effective in ordering the data with respect to typicality, detecting mislabeled samples, measuring class-wise informativeness, and assessing dataset difficulty. We demonstrate these capabilities of $\mathsf{LSI}$ on image and text data in supervised and unsupervised settings. Moreover, we show that $\mathsf{LSI}$ can be computed efficiently through probes and transfers well to the training of large models.

Fault testing in the production line of automotive traction machines is essential to ensure the desired lifetime. Since repetitive partial discharges (PDs) caused by anomalies in the insulation system lead to premature breakdowns of electrical machines, a reliable PD detection is of great importance. This paper proposes deep learning (DL) methods to improve the discrimination of PD from background noise in comparison with the state-of-the-art amplitude based PD detection in the production line. First, a systematic data extraction and labeling procedure is introduced to obtain correctly labeled datasets from arbitrary PD measurements. In addition, datasets are enhanced with low signal-to-noise ratio PD pulses by applying a special data augmentation approach. 13 different convolutional, recurrent and fully connected neural networks are compared for various time-frequency representations of the input signals. Hyperparameters for input transform, network topology and solver are optimized for all 13 combinations to ensure a fair case study. As a result, the two-dimensional convolutional neural network with continuous wavelet transform achieves the best accuracy of around 99.76% on a test dataset of PD signals originating from previously not utilized test objects. All DL models considered in this comparison outperform the state-of-the-art threshold-based PD classification. Even for PD events with an amplitude close to the noise level, the detection rate is still around 95% for the best network. Furthermore, without applying the proposed data augmentation procedure, the DL models investigated are not able to distinguish small PD pulses from noise.