Achieving multi-lead electrocardiography (ECG) in consumer-grade wearables remains challenging, as most devices provide only a few electrodes and cannot capture spatially diverse cardiac signals. Conventional 12-lead ECG, while clinically standard, requires ten electrodes across the body, confining its use to medical environments. We present EarSleeve, a modular dual-electrode eartip sleeve that transforms off-the-shelf earphones into a 12-lead ECG sensing platform through a human-in-the-loop design. Each sleeve embeds two conductive electrodes and electrically links both sides to form a four-electrode configuration. EarSleeve simultaneously records six limb leads and reconstructs 12-lead–equivalent ECG signals by sequentially contacting standard chest locations. In a 12-user study, EarSleeve captures clear ECG waveforms across all leads and is evaluated against an FDA-cleared reference. Results demonstrate the feasibility of reconstructing 12-lead–equivalent ECG signals using a minimum-electrode configuration under controlled conditions. To our knowledge, EarSleeve is the first system to achieve this with off-the-shelf earphones.

Large Language Models (LLMs) have shown immense human-like capabilities for reasoning and generating digital content. However, their ability to freely sense, interact, and actuate the physical domain remains significantly limited due to three fundamental challenges: (1) physical environments require specialized sensors for different tasks, yet deploying dedicated sensors for each application is impractical; (2) events and objects of interest are often localized to small areas within large spaces, making them difficult to detect with static sensor networks; and (3) foundation models need flexible actuation capabilities to meaningfully interact with the physical world. To bridge this gap, we introduce EmbodiedFly, an embodied LLM agent combining a foundation model pipeline with a reconfigurable drone platform to observe, understand, and interact with the physical world. Our co-design approach features (1) a FM orchestration framework connecting multiple LLMs, VLMs, and an open-set object detection model; (2) a novel image segmentation technique that identifies task-relevant areas; and (3) a custom drone platform that autonomously reconfigures with appropriate sensors and actuators based on commands from the FM orchestration framework. Through real-world deployments, we demonstrate that EmbodiedFly completes diverse physical tasks with up to \(85\%\) higher success rates compared to traditional approaches leveraging static deployments.

Foundation models (FM) have shown immense human-like capabilities for generating digital media. However, foundation models that can freely sense, interact, and actuate the physical domain is far from being realized. This is due to 1) requiring dense deployments of sensors to fully cover and analyze large spaces, while 2) events often being localized to small areas, making it difficult for FMs to pinpoint relevant areas of interest relevant to the current task. We propose FlexiFly, a platform that enables FMs to "zoom in" and analyze relevant areas with higher granularity to better understand the physical environment and carry out tasks. FlexiFly accomplishes by introducing 1) a novel image segmentation technique that aids in identifying relevant locations and 2) a modular and reconfigurable sensing and actuation drone platform that FMs can actuate to "zoom in" with relevant sensors and actuators. We demonstrate through real smart home deployments that FlexiFly enables FMs and LLMs to complete diverse tasks up to 85% more successfully. FlexiFly is critical step towards FMs and LLMs that can naturally interface with the physical world.

Speech super-resolution techniques offer a promising solution to enhance audio quality in wearable devices, particularly when addressing the challenges of reduced sampling rates necessitated by battery life constraints and network instability. However, existing methods either prove computationally prohibitive for mobile platforms, or lack sufficient performance. We present TraMSR, a novel hybrid model combining transformer and Mamba architectures for acoustic speech super-resolution. TraMSR achieves superior performance while significantly reducing computational demands compared to state-of-the-art methods. Our model outperforms GAN-based approaches by up to 7.3% in Perceptual Evaluation of Speech Quality (PESQ) and 1.8% in Short-Time Objective Intelligibility (STOI), with an order of magnitude smaller memory footprint and up to 465 times faster inference speed.

Foundation models excel in tasks such as content generation, zero-shot classifications, and reasoning. However, they struggle with sensing, interacting, and actuating in the physical world due to their dependence on limited sensors and actuators in providing timely contextual information or physical interactions. This reliance restricts the system's adaptability and coverage. To address these issues and create an embodied AI with foundation models (FMs), we introduce Embodied Reconfigurable Drone Agent (EmbodiedRDA). EmbodiedRDA features a custom drone platform that can autonomously swap payloads to reconfigure itself with a diverse list of sensors and actuators. We designed FM agents to instruct the drone to equip itself with appropriate physical modules, analyze sensor data, make decisions, and control the drone's actions. This enables the system to perform a variety of tasks in dynamic physical environments, bridging the gap between the digital and physical worlds.