Control of off-road vehicles is challenging due to the complex dynamic interactions with the terrain. Accurate modeling of these interactions is important to optimize driving performance, but the relevant physical phenomena, such as slip, are too complex to model from first principles. Therefore, we present an offline meta-learning algorithm to construct a rapidly-tunable model of residual dynamics and disturbances. Our model processes terrain images into features using a visual foundation model (VFM), then maps these features and the vehicle state to an estimate of the current actuation matrix using a deep neural network (DNN). We then combine this model with composite adaptive control to modify the last layer of the DNN in real time, accounting for the remaining terrain interactions not captured during offline training. We provide mathematical guarantees of stability and robustness for our controller, and demonstrate the effectiveness of our method through simulations and hardware experiments with a tracked vehicle and a car-like robot. We evaluate our method outdoors on different slopes with varying slippage and actuator degradation disturbances, and compare against an adaptive controller that does not use the VFM terrain features. We show significant improvement over the baseline in both hardware experimentation and simulation.

Control of off-road vehicles is challenging due to the complex dynamic interactions with the terrain. Accurate modeling of these interactions is important to optimize driving performance, but the relevant physical phenomena, such as slip, are too complex to model from first principles. Therefore, we present an offline meta-learning algorithm to construct a rapidly-tunable model of residual dynamics and disturbances. Our model processes terrain images into features using a visual foundation model (VFM), then maps these features and the vehicle state to an estimate of the current actuation matrix using a deep neural network (DNN). We then combine this model with composite adaptive control to modify the last layer of the DNN in real time, accounting for the remaining terrain interactions not captured during offline training. We provide mathematical guarantees of stability and robustness for our controller, and demonstrate the effectiveness of our method through simulations and hardware experiments with a tracked vehicle and a car-like robot. We evaluate our method outdoors on different slopes with varying slippage and actuator degradation disturbances, and compare against an adaptive controller that does not use the VFM terrain features. We show significant improvement over the baseline in both hardware experimentation and simulation.

We present a new method to automatically generate semantic segmentation annotations for thermal imagery captured from an aerial vehicle by utilizing satellite-derived data products alongside onboard global positioning and attitude estimates. This new capability overcomes the challenge of developing thermal semantic perception algorithms for field robots due to the lack of annotated thermal field datasets and the time and costs of manual annotation, enabling precise and rapid annotation of thermal data from field collection efforts at a massively-parallelizable scale. By incorporating a thermal-conditioned refinement step with visual foundation models, our approach can produce highly-precise semantic segmentation labels using low-resolution satellite land cover data for little-tono cost. It achieves 98.5% of the performance from using costly high-resolution options and demonstrates between 70-160% improvement over popular zero-shot semantic segmentation methods based on large vision-language models currently used for generating annotations for RGB imagery. Code will be available at: https://github.com/connorlee77/aerial-auto-segment.

The ongoing Distributed Aperture Radar Tomographic Sensors (DARTS) project at NASA Jet Propulsion Laboratory aims to mature and demonstrate multi-static SAR measurements for fine-scale 3D imaging of surface topography, vegetation, and surface deformation and change. The project explores the use of drones as SAR platforms and integrates software-defined radar on RF system-on-chip for compact and flexible radar instruments. This paper highlights the progress in DARTS hardware development, experiments, and data processing. The recent experiments have successfully demonstrated monostatic interferometry as well as acquisition and processing of bi-static SAR imagery. By leveraging the advantages of multi-static SAR and drone-based platforms, the project aims to build a testbed for future missions design and enhanced SAR imaging capabilities for scientific applications.

We present a new method to adapt an RGB-trained water segmentation network to target-domain aerial thermal imagery using online self-supervision by leveraging texture and motion cues as supervisory signals. This new thermal capability enables current autonomous aerial robots operating in near-shore environments to perform tasks such as visual navigation, bathymetry, and flow tracking at night. Our method overcomes the problem of scarce and difficult-to-obtain near-shore thermal data that prevents the application of conventional supervised and unsupervised methods. In this work, we curate the first aerial thermal near-shore dataset, show that our approach outperforms fully-supervised segmentation models trained on limited target-domain thermal data, and demonstrate real-time capabilities onboard an Nvidia Jetson embedded computing platform. Code and datasets used in this work will be available at: https://github.com/connorlee77/uav-thermal-water-segmentation.

Recent innovations in small satellite, ultra-wideband direct RF sampling, and synchronization technologies have made multistatic and MIMO coherent SAR constellations a feasible concept for future missions. The Distributed Aperture Radar Tomographic Sensors (DARTS) mission concept at NASA JPL aims to measure Earth's surface topography and vege-tation using TomoSAR techniques. This paper describes the development of an embedded ultra-wideband next generation software defined radar (SDRadar) testbed capable of multi-band operation implemented with the Xilinx RF System on Chip (RFSoC) architecture, which features 8x 6.4 GSPS DACs and 8x 4 GSPS ADCs. The RFSoC SDRadar repre-sents a state of the art testbed for rapid prototyping of radio, radar, and synchronization technologies. We provide preliminary testing results for airborne monostatic radar imaging from a small uninhabited aerial system (sUAS), successfully demonstrating multi-band operation using first and second Nyquist zone direct RF sampling.

The advent of smaller SAR satellites and cheaper access to space is bringing the notion of a multistatic SAR constellation into the realm of feasibility. Researchers at JPL are studying a Distributed Aperture Radar Tomographic Sensors (DARTS) mission concept intended to measure Earth's surface topography and vegetation using TomoSAR techniques. This paper describes progress on the airborne testbed for the DARTS study. The testbed is the union of a software-defined radio that implements a radar and synchronization link together with a small uninhabited aerial system (sUAS) that serves as a platform with precise control of the observation geometry. Initial experiments have demonstrated successful multi-sensor synchronization as well as acquisition and processing of monostatic SAR imagery.

Distributed Aperture Radar Tomographic Sensors (DARTS) is a mission concept being studied at the NASA Jet Propulsion Laboratory in collaboration with the California Institute of Technology to enable global and repeated imaging of surface topography and three-dimensional vegetation structure using single-pass tomographic SAR technique. The observing system consists of a distributed formation of multiple small synthetic aperture radar platforms deployed in space with variable distances to achieve look angle diversity and sensitivity to the vertical distribution of vegetation components. Our goal is to identify the optimal system configuration starting from documented community needs and mature the critical technologies that lead to a viable implementation of DARTS. Here, we provide an overview of DARTS and describe our approach for designing and demonstrating single-pass SAR tomographic systems as part of an on-going funded NASA Instrument Incubator Program effort.

Aircraft that can launch ballistically and convert to autonomous, free-flying drones have applications in many areas such as emergency response, defense, and space exploration, where they can gather critical situational data using onboard sensors. This paper presents a ballistically-launched, autonomously-stabilizing multirotor prototype (SQUID - Streamlined Quick Unfolding Investigation Drone) with an onboard sensor suite, autonomy pipeline, and passive aerodynamic stability. We demonstrate autonomous transition from passive to vision-based, active stabilization, confirming the multirotor's ability to autonomously stabilize after a ballistic launch in a GPS-denied environment.