The rapid development of deepfake technology has led to the generation of a large amount of tampered video and image content, posing a major challenge to content authenticity verification. In particular, detecting deepfakes in image sequences (e.g., agricultural product packaging) is particularly difficult because the anomalies introduced by the tampering techniques are often subtle and temporally continuous. In this paper, we propose a new deepfake detection method based on time series, combining independent component analysis (FastICA) with anomaly detection techniques. We first apply FastICA to extract independent components from image sequences to identify anomalous visual patterns that are unique to deepfake tampering. In addition, we use an efficient anomaly detection algorithm, LSHiforest, to achieve scalable and accurate identification of suspicious sequences. Experimental results show that the proposed method can still detect deepfake content with high accuracy in challenging scenarios with complex temporal dynamics. Our work provides a promising solution for real‐time and large‐scale detection of deepfake content in dynamic media.

Electroencephalography (EEG) data serve as a reliable method for fatigue detection due to their intuitive representation of drivers’ mental processes. However, existing research on feature generation has overlooked the effective and automated aspects of this process. The challenge of extracting features from unpredictable and complex EEG signals has led to the frequent use of deep learning models for signal classification. Unfortunately, these models often neglect generalizability to novel subjects. To address these concerns, this study proposes the utilization of a modified deep convolutional neural network, specifically the Inception‐dilated ResNet architecture. Trained on spectrograms derived from segmented EEG data, the network undergoes analysis in both temporal and spatial‐frequency dimensions. The primary focus is on accurately detecting and classifying fatigue. The inherent variability of EEG signals between individuals, coupled with limited samples during fatigue states, presents challenges in fatigue detection through brain signals. Therefore, a detailed structural analysis of fatigue episodes is crucial. Experimental results demonstrate the proposed methodology’s ability to distinguish between alertness and sleepiness, achieving average accuracy rates of 98.87% and 82.73% on Figshare and SEED‐VIG datasets, respectively, surpassing contemporary methodologies. Additionally, the study examines frequency bands’ relative significance to further explore participants’ inclinations in states of alertness and fatigue. This research paves the way for deeper exploration into the underlying factors contributing to mental fatigue.

Action recognition (AR) has many applications, including surveillance, health/disabilities care, man-machine interactions, video-content-based monitoring, and activity recognition. Because human action videos contain a large number of frames, implemented models must minimize computation by reducing the number, size, and resolution of frames. We propose an improved method for detecting human actions in low-size and low-resolution videos by employing convolutional neural networks (CNNs) with channel attention mechanisms (CAMs) and autoencoders (AEs). By enhancing blocks with more representative features, convolutional layers extract discriminating features from various networks. Additionally, we use random sampling of frames before main processing to improve accuracy while employing less data. The goal is to increase performance while overcoming challenges such as overfitting, computational complexity, and uncertainty by utilizing CNN-CAM and AE. Identifying patterns and features associated with selective high-level performance is the next step. To validate the method, low-resolution and low-size video frames were used in the UCF50, UCF101, and HMDB51 datasets. Additionally, the algorithm has relatively minimal computational complexity. Consequently, the proposed method performs satisfactorily compared to other similar methods. It has accuracy estimates of 77.29, 98.87, and 97.16%, respectively, for HMDB51, UCF50, and UCF101 datasets. These results indicate that the method can effectively classify human actions. Furthermore, the proposed method can be used as a processing model for low-resolution and low-size video frames.

Scientific and therapeutic advances in perinatology and neonatology have improved the survival prospects of preterm and extremely-low-birth-weight infants. Infants’ cries are a valuable noninvasive tool for monitoring their neurologic health, especially if they are premature. Automatic acoustic analysis and data mining are employed in this study to determine the discriminative features of preterm and full-term infant cries. The use of machine learning for recognizing sounds in a newborn's cry language has received less attention than previous methods for analyzing the sounds. Moreover, to extract appropriate features from infant cries, adequate knowledge and appropriate signal descriptors are required. Accordingly, to analyze infant cry language, we propose an approach that uses fractal descriptors to extract discriminant features from spectrograms of windowed signals, followed by iterative neighborhood component analysis (iNCA) to select appropriate features. Additionally, the improved deep support vector machine (DeepSVM) is used to classify the infants’ crying types and their meanings. The proposed method is verified using a newborn sound dataset. According to the classification of five types of crying perception based on various characteristics, 98.34% of all crying perceptions have been recognized. Although there are many classes examined, the feature extraction method based on the fractal method and our optimal classification have a much higher diagnostic accuracy compared with similar methods for analyzing baby crying language. The proposed method can overcome many problems associated with analyzing babies’ crying sounds and understanding their language, such as uncertainty and unusual errors in classification.

An emergency medical vehicle can save the patient’s life if it arrives at his location as quickly as possible. Unmanned aerial vehicles (UAVs) offer wide visibility and mobility, making them a viable choice for smart cities and intelligent transportation systems (ITSs) as edge devices for the Internet of Things (IoT). Based on population behavior and overcrowding, video surveillance through the Internet of multimedia things (IoMT) and public safety in smart cities can help determine the most efficient routes for emergency medical vehicles. This study investigates UAV overcrowding and abnormal population activity patterns, which affect the flow of emergency medical vehicles and traffic flow. Moreover, the purpose of this article is to analyze received video frames from UAVs in order to identify the most efficient route for emergency medical vehicles in smart cities to transfer patients in the event of abnormalities or overcrowding. In order to detect overcrowding on the streets, a hybrid Cascade-ResNet is utilized, which detects congestion based on many data points. Based on our proposed approach, we achieve a 2.5% improvement over similar methods because it is effective, flexible, and accurate. UAV video frames can be used to communicate with emergency response vehicles, to monitor traffic congestion, and to monitor other aspects of smart city life.

Extensive user check-in data incorporating user preferences for location is collected through Internet of Things (IoT) devices, including cell phones and other sensing devices in location-based social network. It can help traveling enterprises intelligently predict users' interests and preferences, provide them with scientific tourism paths, and increase the enterprises income. Thus, successive point-of-interest (POI) recommendation has become a hot research topic in augmented Intelligence of Things (AIoT). Presently, various methods have been applied to successive POI recommendations. Among them, the recurrent neural network-based approaches are committed to mining the sequence relationship between POIs, but ignore the high-order relationship between users and POIs. The graph neural network-based methods can capture the high-order connectivity, but it does not take the dynamic timeliness of POIs into account. Therefore, we propose anInteraction-enhanced andTime-awareGraphConvolutionNetwork (ITGCN) for successive POI recommendation. Specifically, we design an improved graph convolution network for learning the dynamic representation of users and POIs. We also designed a self-attention aggregator to embed high-order connectivity into the node representation selectively. The enterprise management systems can predict the preferences of users, which is helpful for future planning and development. Finally, experimental results prove that ITGCN brings better results compared to the existing methods.

Currently, COVID-19 is circulating in crowded places as an infectious disease. COVID-19 can be prevented from spreading rapidly in crowded areas by implementing multiple strategies. The use of unmanned aerial vehicles (UAVs) as sensing devices can be useful in detecting overcrowding events. Accordingly, in this article, we introduce a real-time system for identifying overcrowding due to events such as congestion and abnormal behavior. For the first time, a monitoring approach is proposed to detect overcrowding through the UAV and social monitoring system (SMS). We have significantly improved identification by selecting the best features from the water cycle algorithm (WCA) and making decisions based on deep transfer learning. According to the analysis of the UAV videos, the average accuracy is estimated at 96.55%. Experimental results demonstrate that the proposed approach is capable of detecting overcrowding based on UAV videos' frames and SMS's communication even in challenging conditions.

In metropolitan environments, unmanned aerial vehicles (UAVs) equipped with video surveillance equipment can monitor crowd behavior and maintain public safety. In high-traffic areas where humans are more likely to make mistakes, a smart city needs modern technology to forecast the behavior of its residents. In order to improve citywide traffic flow, urban transportation systems (UTSs) monitor and learn how people behave in crowds. Using UAVs for video surveillance in smart cities, our research describes a unique way to assess crowd condition, which expands the scope of human-vehicle interactions. Moreover, we use fuzzy logic ranking to improve the system’s ability to detect anomalies in crowds. In order to improve decision-making, a novel deep transfer learning (DTL) technique is applied to the UAV’s received frames. A 98.5% accuracy rate, satisfactory performance, and robustness to population behavior are all characteristics of the proposed integrated model. In UTSs and urban areas, our novel intelligent system analyzes human behavior based on vehicle-human interactions. In areas with low and high traffic congestion, the modified ResNet (mResNet) architecture predicts the crowd’s condition based on fuzzy logic (FLA). Through decision-making based on accurate crowd conditions, best general paths can be selected using the algorithm.

Abstract Multiple sclerosis (MS) is a chronic, debilitating, and often progressive inflammatory disease of the nervous system. The disease is highly stressful, which accelerates the risk of depression in people diagnosed with it and possibly exacerbates MS activity. One approach to reducing stress levels in such patients is to utilize virtual reality (VR). Using VR technology and recording physiological signals before and after displaying different environments to the individual, this article proposed a novel therapy procedure for improving stress levels. In the first phase, by distinguishing the stress level obtained from each environment watched by the patient, their corresponding labels are determined by two psychiatrists. Accordingly, the automated model is designed based on the analysis of VR scenes and can accurately classify MS patients' stress levels after watching the 3D environment. The proposed model consists of a fractal descriptor and SVM‐RBF classifier to recognize VR scenes that can significantly reduce the stress level in MS patients. The accuracy of estimating MS patients' stress levels after watching different simulated VR environments is higher than 97%. By employing this method to classify VR scenes better and rehabilitate MS patients, it will be possible to significantly reduce their stress levels.

The high mortality rate and prevalence of cardiovascular disease (CVD) make early detection of the disease essential. Due to its simplicity and low cost, the phonocardiogram (PCG) system is widely used in healthcare applications for the recognition of CVD in multiclass problems. On the basis of the PCG signal, this paper proposes a hybrid method for classifying cardiac sounds with deep extracted features through two-step learning. For fine-grained features in Graph Convolutional Networks (GCNs), sampling and prior layers are employed. A PCG signal is divided into equal parts with overlap using the windowing process. L-spectrograms extract frequency-domain information from signals to figure out their power spectrum. Furthermore, the deep GCN tries to determine the association between CVD and spectrogram images to recognize CVD signals better. Combining retrieved features with convolutional neural network (CNN) characteristics reveals an image's intrinsic associations. To generate relational feature representations, correlations between clusters and GCN are visualized using a graph structure. CNN's discriminative ability has been enhanced by incorporating GCN attributes. Using Michigan Heart Sound and Murmur Database and PhysioNet/CinC 2016 Challenge results, we are 99.44% and 96.16% accurate, respectively. Through a combination of GCN architecture, CNN design, and deep features, the hybrid model significantly improves CVD classification accuracy. Measuring metrics demonstrate that the proposed approach detects CVD more effectively than previous approaches.

Autonomous unmanned aerial vehicles (UAVs) are essential for detecting and tracking specific events, such as automatic navigation. The intelligent monitoring of people’s social distances in crowds is one of the most significant events caused by the coronavirus. The virus is spreading more quickly among the crowds, and the disease cycle continues in congested areas. Due to the error that occurs when humans monitor their activity, an automated model is required to alert to social distance violations in crowds. As a result, this article proposes a two-step framework based on autonomous UAV videos, including human tracking and deep learning-based recognition of the crowd’s social distance. The deep architecture is a modified-fast and lightweight ShuffleNet learning structure. First, the Kalman filter is used to determine the positions of individuals, and then the modified ShuffleNet is used to refine the bounding boxes obtained and determine the social distance. The social distance is calculated using the initial refinement of the bounding box obtained during the tracking step and the scale in frames of the human body. The observed average accuracy, average processing time (APT), and processed frame per second (FPS) for three congestion datasets were 97.5%, 84 milliseconds, and 11.5 FPS, respectively. Real-time decision-making was achieved by reducing the size and resolution of the frames. Additionally, the frames were re-labeled to reduce the computational complexity associated with detecting social distancing. The experimental results demonstrated that the proposed method could operate more quickly and accurately on various resolution frames of UAV videos with difficult conditions.