As drone use has become more widespread, there is a critical need to ensure safety and security. A key element of this is robust and accurate drone detection and localization. While cameras and other optical sensors like LiDAR are commonly used for object detection, their performance degrades under adverse lighting and environmental conditions. Therefore, this has generated interest in finding more reliable alternatives, such as millimeter-wave (mmWave) radar. Recent research on mmWave radar object detection has predominantly focused on 2D detection of road users. Although these systems demonstrate excellent performance for 2D problems, they lack the sensing capability to measure elevation, which is essential for 3D drone detection. To address this gap, we propose CubeDN, a single-stage end-to-end radar object detection network specifically designed for flying drones. CubeDN overcomes challenges such as poor elevation resolution by utilizing a dual radar configuration and a novel deep learning pipeline. It simultaneously detects, localizes, and classifies drones of two sizes, achieving decimeter-level tracking accuracy at closer ranges with overall 95% average precision (AP) and 85% average recall (AR). Furthermore, CubeDN completes data processing and inference at 10Hz, making it highly suitable for practical applications.

In this study, we present ML-Track, an innovative uncooperative passive tracking system leveraging WiFi communication signals between multiple devices. Our approach is realized with three pivotal techniques. First, we introduce a novel protocol termed multi-link round-trip CSI, which enables multi-link bistatic Doppler detection within a WiFi network. Second, a phase error cancellation method is developed, and we demonstrate a 0.92 rad reduction in error (0.96 to 0.04 rad) experimentally. Lastly, we propose a particle-filter-based back-end to track a moving human in the room passively without the need for the participant to carry any type of cooperative or active device. A prototype system is constructed using four Raspberry Pi CM4 units and subjected to real-world evaluations. Experimental results indicate a median error of approximately 0.23 m for tracking, which corresponds to a relative error of 5.8% based on the 4 m side length of the experimental field. Compared to existing studies, a distinct advantage of our system is it can run with non-MIMO (single-antenna) WiFi devices, making it particularly suitable for budget or low-profile WiFi hardware. This compatibility makes it an ideal fit for real-world Internet-of-Things (IoT) devices. Moreover, in terms of computational demands, our solution excels, delivering real-time performance on the Raspberry Pi CM4 while utilizing just 20% of its CPU capability and drawing a modest 2.5 watts of power.

WiFi channel state information (CSI)-based activity recognition has sparked numerous studies due to its widespread availability and privacy protection. However, when applied in practical applications, general CSI-based recognition models may face challenges related to the limited generalization capability, since individuals with different behavior habits will cause various fluctuations in the CSI data and it is difficult to gather enough training data to cover all kinds of motion habits. To tackle this problem, we design a diffusion model-based contrastive learning framework for human activity recognition (CLAR) using WiFi CSI. On the basis of the contrastive learning framework, we primarily introduce two components for CLAR to enhance the CSI-based activity recognition. To generate diverse augmented data and complement limited training data, we propose a diffusion model-based time series-specific augmentation model. In contrast to typical diffusion models that directly apply conditions to the generative process, potentially resulting in distorted CSI data, our tailored model dissects these condition into the high-frequency and low-frequency components, and then applies these conditions to the generative process with varying weights. This can alleviate the data distortion and yield high-quality augmented data. To efficiently capture the difference of the sample importance, we present an adaptive weight algorithm. Different from the typical contrastive learning methods which equally consider all the training samples, this algorithm adaptively adjusts the weights of positive sample pairs for learning better data representations. The experiments suggest that the CLAR achieves significant gains compared to the state-of-the-art methods.

Indoor localization using WiFi signals has been studied since the emergence of WiFi communication. This paper presents a novel training-free approach to indoor localization using a customized WiFi protocol for data collection and a factor graph-based back-end for localization. The protocol measures the round-trip phase, which is very sensitive to small changes in displacement. This is because the sub-wavelength displacements introduce significant phase changes in WiFi signal. However, the phase cannot provide absolute range information due to angle wrap. Consequently, it can only be used for relative distance (displacement) measurement. By tracking the round-trip phase over time and unwrapping it, a relative distance measurement can be realized and achieve a mean absolute error (MAE) of 0.06m. For 2-D localization, factor graph optimization is applied to the round-trip phase measurements between the STA (station) and four APs (access points). Experiments show the proposed concept can offer a decimeter-level (0.26m MAE and 0.24m 50%CDF) performance for real-world indoor localization.

This paper presents a wireless Doppler sensing system using WiFi round-trip channel state information (RTCSI), which is implemented using the channel state information (CSI) from the Raspberry Pi CM4 onboard WiFi chip and a customized WiFi protocol. Utilizing the CSI phase in WiFi sensing is challenging as hardware asynchronization introduces significant phase errors. Similar to WiFi round-trip time (RTT) ranging, RTCSI was proposed to cancel the adverse effect of asynchronization through two-way communication. However, previous work mainly focuses on measuring RTCSI over frequency (different WiFi channels) to simulate a wide-band ranging. In this work, RTCSI is measured over time and a Doppler sensing prototype is built to detect a moving target in the wireless channel. Our findings show that this RTCSI-based Doppler sensing system is sensitive and effective in the real world. Moreover, it may be integrated with other techniques further to improve the performance in joint communications and sensing.

Micro-Doppler signatures contain considerable information about target dynamics. However, the radar sensing systems are easily affected by noisy surroundings, resulting in uninterpretable motion patterns on the micro-Doppler spectrogram. Meanwhile, radar returns often suffer from multipath, clutter and interference. These issues lead to difficulty in, for example motion feature extraction, activity classification using micro Doppler signatures ($\mu$-DS), etc. In this paper, we propose a latent feature-wise mapping strategy, called Feature Mapping Network (FMNet), to transform measured spectrograms so that they more closely resemble the output from a simulation under the same conditions. Based on measured spectrogram and the matched simulated data, our framework contains three parts: an Encoder which is used to extract latent representations/features, a Decoder outputs reconstructed spectrogram according to the latent features, and a Discriminator minimizes the distance of latent features of measured and simulated data. We demonstrate the FMNet with six activities data and two experimental scenarios, and final results show strong enhanced patterns and can keep actual motion information to the greatest extent. On the other hand, we also propose a novel idea which trains a classifier with only simulated data and predicts new measured samples after cleaning them up with the FMNet. From final classification results, we can see significant improvements.

The use of Wi-Fi signals for human sensing has gained significant interest over the past decade. Such techniques provide affordable and reliable solutions for healthcare-focused events such as vital sign detection, prevention of falls and long-term monitoring of chronic diseases, among others. Currently, there are two major approaches for Wi-Fi sensing: (1) passive Wi-Fi radar (PWR) which uses well established techniques from bistatic radar, and channel state information (CSI) based wireless sensing (SENS) which exploits human-induced variations in the communication channel between a pair of transmitter and receiver. However, there has not been a comprehensive study to understand and compare the differences in terms of effectiveness and limitations in real-world deployment. In this paper, we present the fundamentals of the two systems with associated methodologies and signal processing. A thorough measurement campaign was carried out to evaluate the human activity detection performance of both systems. Experimental results show that SENS system provides better detection performance in a line-of-sight (LoS) condition, whereas PWR system performs better in a non-LoS (NLoS) setting. Furthermore, based on our findings, we recommend that future Wi-Fi sensing applications should leverage the advantages from both PWR and SENS systems.

Human sensing using WiFi signal transmissions is attracting significant attention for future applications in e-healthcare, security, and the Internet of Things (IoT). The majority of WiFi sensing systems are based around processing of channel state information (CSI) data which originates from commodity WiFi access points (APs) that have been primed to transmit high data-rate signals with high repetition frequencies. However, in reality, WiFi APs do not transmit in such a continuous uninterrupted fashion, especially when there are no users on the communication network. To this end, we have developed a passive WiFi radar system for human sensing which exploits WiFi signals irrespective of whether the WiFi AP is transmitting continuous high data-rate Orthogonal Frequency-Division Multiplexing (OFDM) signals, or periodic WiFi beacon signals while in an idle status (no users on the WiFi network). In a data transmission phase, we employ the standard cross ambiguity function (CAF) processing to extract Doppler information relating to the target, while a modified version is used for lower data-rate signals. In addition, we investigate the utility of an external device that has been developed to stimulate idle WiFi APs to transmit usable signals without requiring any type of user authentication on the WiFi network. In this article, we present experimental data which verifies our proposed methods for using any type of signal transmission from a standalone WiFi device, and demonstrate the capability for human activity sensing.

Passive wireless sensing using WiFi signals has become a very active area of research over the past few years. Such techniques provide a cost-effective and non-intrusive solution for human activity sensing especially in healthcare applications. One of the main approaches used in wireless sensing is based on fine-grained WiFi Channel State Information (CSI) which can be extracted from commercial Network Interface Cards (NICs). In this paper, we present a new signal processing pipeline required for effective wireless sensing. An experiment involving five participants performing six different activities was carried out in an office space to evaluate the performance of activity recognition using WiFi CSI in different physical layouts. Experimental results show that the CSI system has the best detection performance when activities are performed half-way in between the transmitter and receiver in a line-of-sight (LoS) setting. In this case, an accuracy as high as 91% is achieved while the accuracy for the case where the transmitter and receiver are co-located is around 62%. As for the case when data from all layouts is combined, which better reflects the real-world scenario, the accuracy is around 67%. The results showed that the activity detection performance is dependent not only on the locations of the transmitter and receiver but also on the positioning of the person performing the activity.

WiFi signals for physical activity sensing show great practical potentials for pervasive healthcare applications due to the widespread WiFi deployments and high levels of public acceptance of such systems. Traditionally, WiFi-based sensing uses the Channel State Information (CSI) from an off-the-shelf WiFi Access Point (AP) which transmits signals that have high pulse repetition frequencies. However, when there are no users on the local network only beacon signals are transmitted from the WiFi AP which significantly deteriorates the sensitivity and specificity of such systems. Surprisingly, WiFi based sensing under these conditions have received little attention given that WiFi APs are frequently in idle state. This paper presents a practical system based on passive radar techniques which does not require any special setup or firmware changes to be able to work with any commercial WiFi device. To cope with the low duty cycles associated with beacon signal transmissions, a modified Cross Ambiguity Function (CAF) has been proposed to reduce redundant samples. In addition, an external device has been developed to send WiFi probe request signals which stimulates an idle AP to transmit WiFi probe responses, thus generate usable transmission signals for sensing applications without the need to authenticate and join the network. Detection performance shows that the proposed concept can significantly improve activity detection and is a viable candidate in future healthcare applications.

In this paper, we propose an ultra-low-resolution infrared (IR) images based activity recognition method which is suitable for monitoring in elderly care-house and modern smart home. The focus is on the analysis of sequences of IR frames, including single subject doing daily activities. The pixels are considered as independent variables because of the lacking of spatial dependencies between pixels in the ultra-low resolution image. Therefore, our analysis is based on the temporal variation of the pixels in vectorised sequences of several IR frames, which results in a high dimensional feature space and an "n<; <; p" problem. Two different sparse analysis strategies are used and compared: Sparse Discriminant Analysis (SDA) and Sparse Principal Component Analysis (SPCA). The extracted sparse features are tested with four widely used classifiers: Support Vector Machines (SVM), Random Forests (RF), K-Nearest Neighbours (KNN) and Logistic Regression (LR). To prove the availability of the sparse features, we also compare the classification results of the noisy data based sparse features and non-sparse based features respectively. The comparison shows the superiority of sparse methods in terms of noise tolerance and accuracy.

Unsupervised Domain Adaptation (UDA) aims to transfer domain knowledge from existing well-defined tasks to new ones where labels are unavailable. In the real-world applications, as the domain (task) discrepancies are usually uncontrollable, it is significantly motivated to match the feature distributions even if the domain discrepancies are disparate. Additionally, as no label is available in the target domain, how to successfully adapt the classifier from the source to the target domain still remains an open question. In this paper, we propose the Re-weighted Adversarial Adaptation Network (RAAN) to reduce the feature distribution divergence and adapt the classifier when domain discrepancies are disparate. Specifically, to alleviate the need of common supports in matching the feature distribution, we choose to minimize optimal transport (OT) based Earth-Mover (EM) distance and reformulate it to a minimax objective function. Utilizing this, RAAN can be trained in an end-to-end and adversarial manner. To further adapt the classifier, we propose to match the label distribution and embed it into the adversarial training. Finally, after extensive evaluation of our method using UDA datasets of varying difficulty, RAAN achieved the state-of-the-art results and outperformed other methods by a large margin when the domain shifts are disparate.

Device free activity recognition and monitoring has become a promising research area with increasing public interest in pattern of life monitoring and chronic health conditions. This paper proposes a novel framework for in-home Wi-Fi signal-based activity recognition in e-healthcare applications using passive micro-Doppler (m-D) signature classification. The framework includes signal modeling, Doppler extraction and m-D classification. A data collection campaign was designed to verify the framework where six m-D signatures corresponding to typical daily activities are sucessfully detected and classified using our software defined radio (SDR) demo system. Analysis of the data focussed on potential discriminative characteristics, such as maximum Doppler frequency and time duration of activity. Finally, a sparsity induced classifier is applied for adaptting the method in healthcare application scenarios and the results are compared with those from the well-known Support Vector Machine (SVM) method.

This paper describes two Doppler only indoor passive Wi-Fi tracking methods based on high Doppler resolution passive radar. Two filters are investigated in this paper, the extended Kalman filter and the sequential importance resampling (SIR) particle filter. Experimental results for these two tracking filters are presented using results from software defined passive Wi-Fi radar using a standard 802.11 access point as an illuminator. The experimental results show that the SIR particle filter performs well using Wi-Fi signals for indoor tracking with a high degree of accuracy. Proposals for simplifying the SIR particle and application to multiple target tracking are also discussed.

In this paper, we investigate the feasibility of uncooperatively and covertly detecting people moving behind walls using passive bistatic WiFi radar at standoff distances. A series of experiments was conducted which involved personnel targets moving inside a building within the coverage area of a WiFi access point. These targets were monitored from outside the building using a 2.4-GHz passive multistatic receiver, and the data were processed offline to yield range and Doppler information. The results presented show the first through-the-wall (TTW) detections of moving personnel using passive WiFi radar. The measured Doppler shifts agree with those predicted by bistatic theory. Further analysis of the data revealed that the system is limited by the signal-to-interference ratio (SIR), and not the signal-to-noise ratio. We have also shown that a new interference suppression technique based on the CLEAN algorithm can improve the SIR by approximately 19 dB. These encouraging initial findings demonstrate the potential for using passive WiFi radar as a low-cost TTW detection sensor with widespread applicability.