Abstract This paper introduces robustness verification for semantic segmentation neural networks (in short, semantic segmentation networks [SSNs]), building on and extending recent approaches for robustness verification of image classification neural networks. Despite recent progress in developing verification methods for specifications such as local adversarial robustness in deep neural networks (DNNs) in terms of scalability, precision, and applicability to different network architectures, layers, and activation functions, robustness verification of semantic segmentation has not yet been considered. We address this limitation by developing and applying new robustness analysis methods for several segmentation neural network architectures, specifically by addressing reachability analysis of up-sampling layers, such as transposed convolution and dilated convolution. We consider several definitions of robustness for segmentation, such as the percentage of pixels in the output that can be proven robust under different adversarial perturbations, and a robust variant of intersection-over-union (IoU), the typical performance evaluation measure for segmentation tasks. Our approach is based on a new relaxed reachability method, allowing users to select the percentage of a number of linear programming problems (LPs) to solve when constructing the reachable set, through a relaxation factor percentage. The approach is implemented within NNV, then applied and evaluated on segmentation datasets, such as a multi-digit variant of MNIST known as M2NIST. Thorough experiments show that by using transposed convolution for up-sampling and average-pooling for down-sampling, combined with minimizing the number of ReLU layers in the SSNs, we can obtain SSNs with not only high accuracy (IoU), but also that are more robust to adversarial attacks and amenable to verification. Additionally, using our new relaxed reachability method, we can significantly reduce the verification time for neural networks whose ReLU layers dominate the total analysis time, even in classification tasks.

Abstract Verification has emerged as a means to provide formal guarantees on learning-based systems incorporating neural network before using them in safety-critical applications. This paper proposes a new verification approach for deep neural networks (DNNs) with piecewise linear activation functions using reachability analysis. The core of our approach is a collection of reachability algorithms using star sets (or shortly, stars), an effective symbolic representation of high-dimensional polytopes. The star-based reachability algorithms compute the output reachable sets of a network with a given input set before using them for verification. For a neural network with piecewise linear activation functions, our approach can construct both exact and over-approximate reachable sets of the neural network. To enhance the scalability of our approach, a star set is equipped with an outer-zonotope (a zonotope over-approximation of the star set) to quickly estimate the lower and upper bounds of an input set at a specific neuron to determine if splitting occurs at that neuron. This zonotope pre-filtering step reduces significantly the number of linear programming optimization problems that must be solved in the analysis, and leads to a reduction in computation time, which enhances the scalability of the star set approach. Our reachability algorithms are implemented in a software prototype called the neural network verification tool, and can be applied to problems analyzing the robustness of machine learning methods, such as safety and robustness verification of DNNs. Our experiments show that our approach can achieve runtimes twenty to 1400 times faster than Reluplex, a satisfiability modulo theory-based approach. Our star set approach is also less conservative than other recent zonotope and abstract domain approaches.

Occupancy identification using Electricity Consumption data has been shown as an effective, non-intrusive strategy aiding the design of efficient Energy Management solutions. This paper introduces DeepECO, a Deep Learning framework for the Occupancy Classification task. It studies the impact of different feature selection algorithms, namely Principal Component Analysis (PCA) and a new game-theoretic approach called SHapley Additive exPlanation (SHAP) on the network performance. Three different metrics- Classification Accuracy, Mathew's Correlation Coefficient and F2 score are used for evaluation and comparison between the mentioned algorithms. The results obtained serve as a comprehensive evaluation of different feature selection methods for deep CNNs and their effectiveness in addressing the given problem.

This paper presents a switching scheme-based placement method to reduce the effect of various sources of nonlinearity arising due to layout routing parasitic in a current-steering digital-to-analog converter (DAC), thereby providing excellent static and dynamic performance. The proposed technique reduces both the individual and the cumulative effect of different nonidealities. Improvement in both the static and the dynamic performance is observed when compared with that provided by conventional common centroid placement. A 10-bit 500-MHz differential current-steering DAC has been designed and evaluated in 65-nm CMOS process as a case study, which provides a ~72-dB spurious-free dynamic range at a 122-Ms/s input frequency.