For reliable millimeter-wave (mmWave) networks, this paper proposes cooperative sensing with multi-camera operation in an image-to-decision proactive handover framework that directly maps images to a handover decision. In the framework, camera images are utilized to allow for the prediction of blockage effects in a mmWave link, whereby a network controller triggers a handover in a proactive fashion. Furthermore, direct mapping allows for the scalability of the number of pedestrians. This paper experimentally investigates the feasibility of adopting cooperative sensing with multiple cameras that can compensate for one another's blind spots. The optimal mapping is learned via deep reinforcement learning to resolve the high dimensionality of images from multiple cameras. An evaluation based on experimentally obtained images and received powers verifies that a mapping that enhances channel capacity can be learned in a multi-camera operation. The results indicate that our proposed framework with multi-camera operation outperforms a conventional framework with single-camera operation in terms of the average capacity.

This study demonstrates the feasibility of proactive received power prediction by leveraging spatiotemporal visual sensing information towards reliable millimeter-wave (mmWave) networks. As the received power on a mmWave link can attenuate aperiodically owing to human blockages, a long-term series of the future received power cannot be predicted by analyzing the received signals prior to the blockage occurring. We propose a novel mechanism that predicts the time series of received power from the next moment to as many as several hundred milliseconds ahead. The key idea is to leverage camera imagery and machine learning (ML). Time-sequential images may involve the spatial geometry and mobility of obstacles representing mmWave signal propagation. ML is used to construct a prediction model from a dataset of sequential images labeled with received power in several hundred milliseconds ahead of the time at which each image is obtained. The simulation and experimental evaluations conducted using IEEE 802.11ad devices and a depth camera demonstrated that the proposed mechanism employing convolutional long short-term memory predicted a time series of received power up to 500 ms ahead, with an inference time of less than 3 ms and a root-mean-square error of 3.4 dB.

This paper experimentally finds the optimum number of input images of a machine learning-based mmWave received signal strength (RSS) value prediction scheme from depth images. By modeling the relationships between time-sequential depth images and RSS values based on machine learning, it is possible to predict the future RSS values, and thereby, a predictive handover makes a moment of degradation of the RSS value avoidable. As prediction models of RSS value, three machine learning models are compared: the convolutional neural networks (CNN), the combination of CNN and convolutional long short-term memory (CNN+ConvLSTM), and random forest. As the number of input images increases, the prediction accuracy generally improves, however, too numerous input images may make the prediction accuracy worse because of over-fitting. Experimental results reveal that the number of input images that are input in order to predict the RSS value the most accurately is 16.