Abstract In this technological era, human activity recognition (HAR) plays a significant role in several applications like surveillance, health services, Internet of Things, etc. Recent advancements in deep learning and video summarization have motivated us to integrate these techniques for HAR. This paper introduces a computationally efficient HAR technique based on a deep learning framework, which works well in realistic and multi-view environments. Deep convolutional neural networks (DCNNs) normally suffer from different constraints, including data size dependencies, computational complexity, overfitting, training challenges and vanishing gradients. Additionally, with the use of advanced mobile vision devices, the demand for computationally efficient HAR algorithms with the requirement of limited computational resources is high. To address these issues, we used integration of DCNN with video summarization using keyframes. The proposed technique offers a solution that enhances performance with efficient resource utilization. For this, first, we designed a lightweight and computationally efficient deep learning architecture based on the concept of identity skip connections (features reusability), which preserves the gradient loss attenuation and can handle the enormous complexity of activity classes. Subsequently, we employed an efficient keyframe extraction technique to minimize redundancy and succinctly encapsulate the entire video content in a lesser number of frames. To evaluate the efficacy of the proposed method, we performed the experimentation on several publicly available datasets. The performance of the proposed method is measured in terms of evaluation parameters Precision, Recall, F-Measure and Classification Accuracy. The experimental results demonstrated the superiority of the presented algorithm over other existing state-of-the-art methods.

This paper aims to develop a tool for automated translation of NL text into RTs. As a result, we developed a prototype to translate NL text within EARS and RUPP’s RTs. The prototype also computes six quality metrics values before and after processing the NL text into RTs. Preliminary results show improvement in the quality of NL requirements and translation approach. We have evaluated the working process and capabilities of the prototype by applying 16 problem specifications. Demonstration video: https://youtu.be/4Ac3jZpLacc Source code & Artifacts: https://tinyurl.com/nl2rt-git

Segmentation of moving object in video with moving background is a challenging problem and it becomes more difficult with varying illumination. The authors propose a dense optical flow‐based background subtraction technique for object segmentation. The proposed technique is fast and reliable for segmentation of moving objects in realistic unconstrained videos. In the proposed work, they stabilise the camera motion by computing homography matrix, then they perform statistical background modelling using single Gaussian background modelling approach. Moving pixels are identified using dense optical flow in the background modelled scenario. The dense optical flow provides motion information of each pixel between consecutive frames, therefore for moving pixel identification they compute motion flow vector of each pixel between consecutive frames. To distinguish between foreground and background pixels, they labelled each pixel and thresholding the magnitude of motion flow vector identifies the moving pixels. The effectiveness of the proposed algorithm has been evaluated both qualitatively and quantitatively. The proposed algorithm has been evaluated on several realistic videos of different complex conditions. To assess the performance of the proposed work, the authors compared their algorithm with other state‐of‐art methods and found that the proposed method outperforms the other methods.

In recent years, research in the field of keyframe extraction become more attractive due to its use in advanced applications like video surveillance. In this paper, we introduce a novel algorithm of keyframe extraction which utilizes Binary Robust Invariant Scalable Keypoint features to obtain the dissimilarity level of consecutive frames and establishes shot transition boundary, from where we extract keyframes. The frame at which dissimilarity level is high is taken as a keyframe. The proposed algorithm is tested on ten different videos of animation category. Performance of the method is assessed using the evaluation metrics- Figure of merit, Detection percentage, Accuracy and missing factor. The experimental results and analysis shows improved performance of the proposed algorithm over the other state-ofthe-art methods.

Shadow detection and removal is an important problem in computer vision. The real challenge in moving shadow detection and removal is to classify moving shadow points which are many times misclassified as moving object points in a video sequences. Various shadow detection and removal algorithms have been proposed for images but only a few works have been done for moving objects. In this study, a novel method for shadow detection and removal is proposed using discrete wavelet transform (DWT). The authors have used DWT because of its multi‐resolution property that decomposes an image into four different bands without loss of the spatial information. For detection and removal of shadow, they have proposed a new threshold in the form of relative standard deviation. The value of threshold is automatically determined and does not require any supervised learning or manual calibration. The proposed method is flexible and depends on only one parameter, namely, wavelet coefficients. Results of shadow detection and removal from moving object after applying the proposed method are compared with the results of other state‐of‐the‐art methods in terms of visual performance and a number of quantitative performance parameters. The proposed method is found to be better and more robust than other methods.

Research in motion analysis is a challenging field and it has a variety of video surveillance applications. For any video surveillance application, background detection and removal plays an important role in segmentation of the moving objects. This study proposes a new method for segmentation of the moving object, which is based on single change detection applied on Daubechies complex wavelet coefficients of two consecutive frames. The authors have chosen Daubechies complex wavelet transform as it is shift invariant and has a better directional selectivity as compared with real‐valued wavelet transforms. Single change detection is a method to obtain video object plane by inter‐frame difference of two consecutive frames, and it provides automatic detection of appearances of new objects. The proposed method does not require any other parameter except wavelet coefficients. Segmentation results of the moving objects after applying the proposed method are compared with those obtained after applying other spatial and wavelet domain segmentation methods in terms of visual performance and a number of quantitative measures viz misclassification penalty, relative position‐based measure, structural content, normalised absolute error and average difference and the proposed method is found better than the other methods.

In this paper, we have proposed a new method for segmentation of moving objects, which is based on single change detection applied on curvelet coefficients of two consecutive frames. The wavelet transform is widely used in moving object segmentation but it can not describe curve discontinuities. Therefore we have used curvelet transform for segmentation of moving objects. The proposed method is simple and does not require any other parameter except curvelet coefficients. Results after applying the proposed method for segmentation of moving object are compared with other state-of-the-art methods in terms of visual as well as quantitative performance measures viz. Misclassification penalty, Relative position based measure and Structural content. The proposed method is found to be better than other methods.

Multiclass object classification is a difficult problem in computer vision application, because of highly variable nature of different objects. The primary goal of this paper is to classify object into one of the chosen classes. The proposed method uses Dual tree complex wavelet transform coefficients as a feature of object. Dual tree complex wavelet transform is having advantage of its better edge representation and approximate shift-invariant property as compared to real valued wavelet transform. We have used multiclass support vector machine classifier for classification of objects. The proposed method has been tested on dataset prepared by authors of this paper. We have tested the proposed method on multiple levels of Dual tree complex wavelet transform. Quantitative evaluation results demonstrate that the proposed method gives better performance for multiclass object classification in comparison to other state-of-the-art methods.