Training and preparing first responders and humanitarian robots for Mass Casualty Incidents (MCIs) often poses a challenge owing to the lack of realistic and easily accessible test facilities. While such facilities can offer realistic scenarios post an MCI that can serve training and educational purposes for first responders and humanitarian robots, they are often hard to access owing to logistical constraints. To overcome this challenge, we present HEROES- a versatile Unreal Engine-based simulator for designing novel training simulations for humans and emergency robots for such urban search and rescue operations. The proposed HEROES simulator is capable of generating synthetic datasets for machine learning pipelines that are used for training robot navigation. This work addresses the necessity for a comprehensive training platform in the robotics community, ensuring pragmatic and efficient preparation for real-world emergency scenarios. The strengths of our simulator lie in its adaptability, scalability, and ability to facilitate collaboration between robot developers and first responders, fostering synergy in developing effective strategies for search and rescue operations in MCIs. We conducted a preliminary user study with an average score of 8.1 out of 10 supporting the ability of HEROES to generate sufficiently varied environments and a score of 7.8 out of 10 affirming the usefulness of the simulation environment. HEROES has been integrated with ROS and has been used to train an RL model for a real robot as a proof of concept.

Abstract The slowness principle is a concept inspired by the visual cortex of the brain. It postulates that the underlying generative factors of a quickly varying sensory signal change on a different, slower time scale. By applying this principle to state-of-the-art unsupervised representation learning methods one can learn a latent embedding to perform supervised downstream regression tasks more data efficient. In this paper, we compare different approaches tounsupervised slow representation learningsuch as $$L_p$$ Lp norm based slowness regularization and the SlowVAE, and propose a new term based on Brownian motion used in our method, the S-VAE. We empirically evaluate these slowness regularization terms with respect to their downstream task performance and data efficiency in state estimation and behavioral cloning tasks. We find that slow representations show great performance improvements in settings where only sparse labeled training data is available. Furthermore, we present a theoretical and empirical comparison of the discussed slowness regularization terms. Finally, we discuss how the Fréchet Inception Distance (FID), commonly used to determine the generative capabilities of GANs, can predict the performance of trained models in supervised downstream tasks.

This paper introduces mathematical models of touch sensors for mobile robots based on visibility. Serving a purpose similar to the pinhole camera model for computer vision, the introduced models are expected to provide a useful, idealized characterization of task-relevant information that can be inferred from their outputs or observations. Possible tasks include navigation, localization and mapping when a mobile robot is deployed in an unknown environment. These models allow direct comparisons to be made between traditional depth sensors, highlighting cases in which touch sensing may be interchangeable with time of flight or vision sensors, and char-acterizing unique advantages provided by touch sensing. The models include contact detection, compression, load bearing, and deflection. The results could serve as a basic building block for innovative touch sensor designs for mobile robot sensor fusion systems.

Mobile robots are increasingly being used to assist with active pursuit and law enforcement. One major limitation for such missions is the resource (battery) allocated to the robot. Factors like nature and agility of evader, terrain over which pursuit is being carried out, plausible traversal velocity and the amount of necessary data to be collected all influence how long the robot can last in the field and how far it can travel. In this paper, we develop an analytical model that analyzes the energy utilization for a variety of components mounted on a robot to estimate the maximum operational range achievable by the robot operating on a single battery discharge. We categorize the major consumers of energy as: 1.) ancillary robotic functions such as computation, communication, sensing etc., and 2.) maneuvering which involves propulsion, steering etc. Both these consumers draw power from the common power source but the achievable range is largely affected by the proportion of power available for maneuvering. For this case study, we performed experiments with real robots on planar and graded surfaces and evaluated the estimation error for each case.

In this paper, we focus on large-scale environment monitoring by utilizing a fully decentralized team of mobile robots. The robots utilize the resource constrained-decentralized active sensing scheme to select the most informative (uncertain) locations to observe while conserving allocated resources (battery, travel distance, etc.). We utilize a distributed Gaussian process (GP) framework to split the computational load over our fleet of robots. Since each robot is individually generating a model of the environment, there may be conflicting predictions for test locations. Thus, in this paper, we propose an algorithm for aggregating individual prediction models into a single globally consistent model that can be used to infer the overall spatial dynamics of the environment. To make a prediction at a previously unobserved location, we propose a novel gating network for a mixture-of-experts model wherein the weight of an expert is determined by the responsibility of the expert over the unvisited location. The benefit of posing our problem as a centralized fusion with a distributed GP computation approach is that the robots never communicate with each other, individually optimize their own GP models based on their respective observations, and off-load all their learnt models on the base station only at the end of their respective mission times. We demonstrate the effectiveness of our approach using publicly available datasets.

We propose a homing constrained bi-objective optimization variant of budget-limited informative path planning for monitoring a spatio-temporal environment. The objective function consists of weighted combination of two components: model performance which must be maximized and travel distance which must be bounded by the maximum operational range. Besides this, we have additional constraints that guarantee that the robots will return to home (base station) upon completion of their respective missions. Optimizing over this objective function is essentially NP-hard owing to the conflicting constituents. Moreover, the appropriate choice of weights and additional homing guarantees further adds to complications. We employ Gaussian Process (GP) model [1] which is highly data driven i.e., the larger the amount of training data, the better the model performance. However, owing to limited resources, a robot can only collect a limited amount of training samples. Thus, with the introduction of our bi-objective cost function, it becomes possible to plan budget-limited (e.g., battery, flight time, travel distance etc.) informative tours using autonomous mobile robots to effectively select only the most informative (uncertain) locations from the environment. In this work, we develop an algorithm to autonomously choose the appropriate weights for the components based on available resources while ensuring homing and maintaining model quality. We perform simulations to verify the effectiveness of our proposed objective function on the publicly available Ozone Concentration dataset gathered from USA.