We present a scalable end-to-end system for vision-based monitoring of natural environments, and illustrate its use for the analysis of avian nesting cycles. Our system enables automated analysis of thousands of images, where manual processing would be infeasible. We automate the analysis of raw imaging data using statistics that are tailored to the task of interest. These “features” are a representation to be fed to classifiers that exploit spatial and temporal consistencies. Our testbed can detect the presence or absence of a bird with an accuracy of 82%, count eggs with an accuracy of 84%, and detect the inception of the nesting stage within a day. Our results demonstrate the challenges and potential benefits of using imagers as biological sensors. An exploration of system performance under varying image resolution and frame rate suggest that an in situ adaptive vision system is technically feasible.

One of the most important goals of current and future sensor networks is energy-efficient communication of images. This paper presents a quantitative comparison between the energy costs associated with 1) direct transmission of uncompressed images and 2) sensor platform-based JPEG compression followed by transmission of the compressed image data. JPEG compression computations are mapped onto various resource-constrained platforms using a design environment that allows computation using the minimum integer and fractional bit-widths needed in view of other approximations inherent in the compression process and choice of image quality parameters. Advanced applications of JPEG, such as region of interest coding and successive/progressive transmission, are also examined. Detailed experimental results examining the tradeoffs in processor resources, processing/transmission time, bandwidth utilization, image quality, and overall energy consumption are presented.

Energy-efficient image communication is one of the most important goals for a large class of current and future sensor network applications. This paper presents a quantitative comparison between the energy costs associated with 1) direct transmission of uncompressed images and 2) sensor platform-based JPEG compression followed by transmission of the compressed image data. JPEG compression computations are mapped onto various resource-constrained sensor platforms using a design environment that allows computation using the minimum integer and fractional bit-widths needed in view of other approximations inherent in the compression process and choice of image quality parameters. Detailed experimental results examining the tradeoffs in processor resources, processing/transmission time, bandwidth utilization, image quality, and overall energy consumption are presented.

Severe energy limitations, and a paucity of computation pose a set of difficult design challenges for sensor networks. Recent progress in two seemingly disparate research areas namely, distributed robotics and low power embedded systems has led to the creation of mobile (or robotic) sensor networks. Autonomous node mobility brings with it its own challenges, but also alleviates some of the traditional problems associated with static sensor networks. We illustrate this by presenting the design of the robomote, a robot platform that functions as a single mobile node in a mobile sensor network. We briefly describe two case studies where the robomote has been used for table top experiments with a mobile sensor network.

Networked infomechanical systems (NIMS) introduces a new actuation capability for embedded networked sensing. By exploiting a constrained actuation method based on rapidly deployable infrastructure, NIMS suspends a network of wireless mobile and fixed sensor nodes in three-dimensional space. This permits run-time adaptation with variable sensing location, perspective, and even sensor type. Discoveries in NIMS environmental investigations have raised requirements for 1) new embedded platforms integrating many diverse sensors with actuators, and 2) advances for in-network sensor data processing. This is addressed with a new and generally applicable processor-preprocessor architecture described in this paper. Also this paper describes the successful integration of R, a powerful statistical computing environment, into the embedded NIMS node platform.

Monitoring of environmental phenomena with embedded networked sensing confronts the challenges of both unpredictable variability in the spatial distribution of phenomena coupled with the demands for a high spatial sampling rate in three dimensions. For example, low distortion mapping of critical solar radiation properties in forest environments may require two-dimensional spatial sampling rates of greater than 10 samples/m/sup 2/ over transects exceeding 1000 m/sup 2/. Clearly, adequate sampling coverage of such transect requires an impractically large number of sensing nodes. A new approach, networked infomechanical system (NIMS), has been introduced to combine autonomous-articulated and static sensor nodes enabling sufficient spatiotemporal sampling density over large transects to meet a general set of environmental mapping demands. This paper describes our work on the critical parts of NIMS, the task allocation module. We present our methodologies and the two basic greedy task allocation policies - based on time of the task arrival (time policy) and distance from the robot to the task (distance policy). We present results from NIMS deployed in a forest reserve and from a lab testbed. The results show that both policies are adequate for the task of spatiotemporal sampling, but also complement each other. Finally, we suggest the future direction of research that would both help us better quantify the performance of our system and create more complex policies.

Monitoring environmental phenomena by distributed sensor sampling confronts the challenge of unpredictable variability in the spatial distribution of phenomena often coupled with demands for a high spatial sampling rate. The introduction of actuation-enabled robotics sensors permits a system to optimize the sampling distribution through runtime adaptation. However, such systems must efficiently dispense sampling points or otherwise suffer from poor temporal response. In this paper, we propose and characterize an active modeling system. In our approach, as the robotic sensor acquires measurement samples of the environment, it builds a model of the phenomenon. Our algorithm is based on an incremental optimization process where the robot supports a continuous, iterative process of 1) collecting samples with maximal coverage in the design space; 2) building the environmental model; 3) predicting sampling point locations that contribute the greatest certainty regarding the phenomenon; and 4) sampling the environment based on a combined measure of information gain and navigation and sampling cost. This can provide significant reductions in the magnitude of field estimation error with a modest navigational trajectory time. We evaluate our algorithm through a simulation, using a combination of static and mobile sensors sampling light illumination field.

Recent technological progress in integrated low power CMOS based imaging devices has led to new type of sensors such as Cyclops. Cyclops is a CMOS image sensor, with reduced complexity and power that allows it to mate with typical sensor network nodes such as Motes. This motivates a new class of sensor networks which exploit vision.In this demonstration we introduce a network of Motes that carry Cyclops sensors. In this network, each individual node can be programmed to perform specific operation on the image. These operations include detecting objects in the scene, detecting edges, reporting histogram of the image, getting the image across the network or getting only particular region of interest.The demonstration showcases the functionality of our network to detect objects. Each node in the network is programmed to detect presence of the objects in its field of view. In addition, users can request the whole image or particular region of interest which the presence of the object has been detected. Performance studies as well as architectural choices will be presented along with outstanding challenges and opportunities.

Despite their increasing sophistication, wireless sensor networks still do not exploit the most powerful of the human senses: vision. Indeed, vision provides humans with unmatched capabilities to distinguish objects and identify their importance. Our work seeks to provide sensor networks with similar capabilities by exploiting emerging, cheap, low-power and small form factor CMOS imaging technology. In fact, we can go beyond the stereo capabilities of human vision, and exploit the large scale of sensor networks to provide multiple, widely different perspectives of the physical phenomena.To this end, we have developed a small camera device called Cyclops that bridges the gap between the computationally constrained wireless sensor nodes such as Motes, and CMOS imagers which, while low power and inexpensive, are nevertheless designed to mate with resource-rich hosts. Cyclops enables development of new class of vision applications that span across wireless sensor network. We describe our hardware and software architecture, its temporal and power characteristics and present some representative applications.

The capabilities and distributed nature of networked sensors are uniquely suited to the characterization of distributed phenomena in the natural environment. However, environmental characterization by fixed distributed sensors encounters challenges in complex environments. In this paper we describe Networked Infomechanical Systems (NIMS), a new distributed, robotic sensor methodology developed for applications including characterization of environmental structure and phenomena. NIMS exploits deployed infrastructure that provides the benefits of precise motion, aerial suspension, and low energy sustainable operations in complex environments. NIMS nodes may explore a three-dimensional environment and enable the deployment of sensor nodes at diverse locations and viewing perspectives. NIMS characterization of phenomena in a three dimensional space must now consider the selection of sensor sampling points in both time and space. Thus, we introduce a new approach of mobile node adaptive sampling with the objective of minimizing error between the actual and reconstructed spatiotemporal behavior of environmental variables while minimizing required motion. In this approach, the NIMS node first explores as an agent, gathering a statistical description of phenomena using a nested stratified random sampling approach. By iteratively increasing sampling resolution, guided adaptively by the measurement results themselves, this NIMS sampling enables reconstruction of phenomena with a systematic method for balancing accuracy with sampling resource cost in time and motion. This adaptive sampling method is described analytically and also tested with simulated environmental data. Experimental evaluations of adaptive sampling algorithms have also been completed. Specifically, NIMS experimental systems have been developed for monitoring of spatiotemporal variation of atmospheric climate phenomena. A NIMS system has been deployed at a field biology station to map phenomena in a 50m width and 50m span transect in a forest environment. In addition, deployments have occurred in testbed environments allowing additional detailed characterization of sampling algorithms. Environmental variable mapping of temperature, humidity, and solar illumination have been acquired and used to evaluate the adaptive sampling methods reported here. These new methods have been shown to provide a significant advance for efficient mapping of spatially distributed phenomena by NIMS environmental robotics.

Due to lack of experimental data and sophisticated models derived from such data, most data processing algorithms from the sensor network literature are evaluated with data generated from simple parametric models. Unfortunately, the type of data input used in the evaluation often significantly affects the algorithm performance. Our case studies of a few widely-studied sensor network data processing algorithms demonstrated the need to evaluate algorithms with data across a range of parameters. In conclusion, we propose our synthetic data generation framework.

A key challenge in sensor networks is ensuring the sustainability of the system at the required performance level, in an autonomous manner. Sustainability is a major concern because of severe resource constraints in terms of energy, bandwidth and sensing capabilities in the system. In this paper, we envision the use of a new design dimension to enhance sustainability in sensor networks - the use of controlled mobility. We argue that this capability can alleviate resource limitations and improve system performance by adapting to deployment demands. While opportunistic use of external mobility has been considered before, the use of controlled mobility is largely unexplored. We also outline the research issues associated with effectively utilizing this new design dimension. Two system prototypes are described to present first steps towards realizing the proposed vision.

Monitoring of environmental phenomena with embedded networked sensing confronts the challenges of both unpredictable variability in the spatial distribution of phenomena, coupled with demands for a high spatial sampling rate in three dimensions. For example, low distortion mapping of critical solar radiation properties in forest environments may require two-dimensional spatial sampling rates of greater than 10 samples/m2 over transects exceeding 1000 m2. Clearly, adequate sampling coverage of such a transect requires an impractically large number of sensing nodes. This paper describes a new approach where the deployment of a combination of autonomous-articulated and static sensor nodes enables sufficient spatiotemporal sampling densityo ver large transects to meet a general set of environmental mapping demands.To achieve this we have developed an embedded networked sensor architecture that merges sensing and articulation with adaptive algorithms that are responsive to both variabilityin environmental phenomena discovered bythe mobile sensors and to discrete events discovered byst atic sensors. We begin byde scribing the class of important driving applications, the statistical foundations for this new approach, and task allocation. We then describe our experimental implementation of adaptive, event aware, exploration algorithms, which exploit our wireless, articulated sensors operating with deterministic motion over large areas. Results of experimental measurements and the relationship among sampling methods, event arrival rate, and sampling performance are presented.

Technological progress in integrated, low power CMOS imaging [1] and maturing low power wireless sensor network platforms, motivate a new and rich design space exploiting in network dense imaging. In particular, by combining comparably low power CMOS cameras and low power wireless sensor nodes, and implementing on board compression and image analysis techniques, we can greatly enhance the application of dense wireless sensor networks to phenomena that are most readily observed in the optical domain.

We study the feasibility of extending the lifetime of a wireless sensor network by exploiting mobility. In our system, a small percentage of network nodes are autonomously mobile, allowing them to move in search of energy, recharge, and delivery energy to immobile, energy-depleted nodes. We term this approach energy harvesting. We characterize the problem of uneven energy consumption, suggest energy harvesting as a possible solution, and provide a simple analytical framework to evaluate energy consumption and our scheme. Data from initial feasibility experiments using energy harvesting show promising results.

This paper introduces Robomote, a robotic solution developed to explore problems in large-scale distributed robotics and sensor networks. The design explicitly aims at enabling research in sensor networking, adhoc networking, massively distributed robotics, and extended longevity. The platform must meet many demanding criteria not limited to but including: miniature size, low power, low cost, simple fabrication, and a sensor/actuator suite that facilitates navigation and localization. We argue that a robot test bed such as Robomote is necessary for practical research with large networks of mobile robots. Further, we present a preliminary analysis of Robomotes' success to this end.