In complex environments where visibility is severely compromised, such as smoke-filled areas or dense forests, traditional single-sensor systems often fail to provide accurate and reliable data for robots to autonomously navigate and avoid obstacles effectively, posing significant operational challenges and safety risks. Ground-based sensing platforms are further limited by their restricted mobility, hindering access to remote or hazardous areas. Multimodal sensing, which combines various sensor technologies, offers a robust solution to these challenges. Drones, with their high maneuverability and ability to reach inaccessible locations, can capture detailed data from varied altitudes and perspectives. In this demonstration, we introduce SPECTRA, a drone-based multispectral sensing platform that combines thermal cameras, LiDAR, mmWave, and RGB cameras to reliably perform tasks in challenging environments. SPECTRA is a software-hardware co-design platform that can enable and fuse different sensors locally based on the dynamic environment and interpret user tasks using Large Language Models (LLM). We demonstrate SPECTRA's ability to explore and execute assigned tasks in complex environments.

Kangaroo Mother Care (KMC), involving chest-to-chest skin contact between an infant and caregiver, is proven to be an effective intervention for preterm and full-term infants. Accurate monitoring of KMC duration and infant's vital signs during KMC is clinically important. Existing monitoring methods, however, rely on manual efforts and require rigid sensors or wires/electrodes on the infant's body. We propose Joey, a fabric-based approach to continuously monitor KMC duration and two vital signs essential to an infant's well-being: heart rate and respiration rate. Joey is a soft fabric necklace worn by the caregiver. It leverages the transmission of electrocardiogram (ECG) signals across individuals during skin-to-skin contact. With a minimalist fabric sensor structure, Joey measures KMC duration via the presence of mixed ECG signals. It then isolates the infant's ECG from this mixture with a proposed signal extraction algorithm and employs a diffusion-based denoising model to mitigate motion artifacts, enabling reliable inference of infant's vital signs. We fabricate Joey prototypes with off-the-shelf hardware and evaluate its performance with user studies. Results demonstrate that Joey achieves an average F1 score of 96% for KMC duration measurement, and clinically-acceptable accuracy in infant's vital sign estimation with a mean absolute error of 2.3 beats per minute and 2.9 breaths per minute in estimating heart rate and respiration rate. Clinical interviews further confirm the usability of Joey's sensing fabric for infant skin. A demonstration video of Joey is available at: mobilex.cs.columbia.edu/joey

Kangaroo Mother Care (KMC), involving chest-to-chest skin contact between an infant and caregiver, is proven to be an effective intervention for preterm and full-term infants. Accurate monitoring of KMC duration and infant's vital signs during KMC is clinically important. Existing monitoring methods, however, rely on manual efforts and require rigid sensors or wires/electrodes on the infant's body. We propose Joey, a fabric-based approach to continuously monitor KMC duration and two vital signs essential to an infant's well-being: heart rate and respiration rate. Joey is a soft fabric necklace worn by the caregiver. It leverages the transmission of electrocardiogram (ECG) signals across individuals during skin-to-skin contact. With a minimalist fabric sensor structure, Joey measures KMC duration via the presence of mixed ECG signals. It then isolates the infant's ECG from this mixture with a proposed signal extraction algorithm and employs a diffusion-based denoising model to mitigate motion artifacts, enabling reliable inference of the infant's vital signs. We demonstrate Joey's sensing capability with hand-shaking experiments, showing the real-time mixed ECGs. A demonstration video of Joey for actual KMC practice is available at: mobilex.cs.columbia.edu/joey

The stethoscope is one of the most important diagnostic tools used by healthcare professionals, through a process called auscultation, to screen patients for abnormalities of the heart and lungs. While there are digital stethoscopes on the market which ease this process, it still takes years of training to properly use these devices to listen for abnormal sounds within the body. We present ARSteth, an intelligent stethoscope platform that improves the accessibility of stethoscopes for the general population, allowing anyone to perform auscultation in the comfort of their own homes. Our platform utilizes a combination of augmented reality (AR), acoustic intelligence, and human-machine interaction to dynamically guide users on where to place the stethoscope on different parts of the body (auscultation points), through visual and audio cues. Through user studies, we show that ARSteth, on average, can guide users within 13.2 mm from optimal auscultation points marked by licensed physicians in 13.09 seconds for each auscultation point. By guiding users towards more effective auscultation points, make preventative health screening more accessible and effective for everyone we are able to achieve higher confidence on classifying heart murmurs.

Cardiopulmonary ailments are a major cause of mortality. Stethoscopes are one of the most important tools that healthcare professionals use to screen patients for a variety of ailments, especially those related to the heart and lungs. Despite the growth of digital stethoscopes on the market, it takes years of training to properly use stethoscopes to listen for abnormal sounds within the body. In this demonstration, we present an intelligent stethoscope platform that makes stethoscopes more accessible to the general population. Our platform utilizes augmented reality (AR) to provide real-time guidance on where to properly place the stethoscope on the body, enabling the general population to screen themselves for ailments.