Energy-efficient visual sensing is of paramount importance to enable battery-backed low power IoT and mobile applications. Unfortunately, modern image sensors still consume hundreds of milliwatts of power, mainly due to analog readout. This is because current systems always supply a fixed voltage to the sensor's analog circuitry, leading to higher power profiles. In this work, we propose to aggressively scale the analog voltage supplied to the camera as a means to significantly reduce sensor power consumption. To that end, we characterize the power and fidelity implications of analog voltage scaling on three off-the-shelf image sensors. Our characterization reveals that analog voltage scaling reduces sensor power but also degrades image quality. Furthermore, the degradation in image quality situationally affects the task accuracy of vision applications.

Energy-efficient visual sensing is crucial for enabling battery-backed low power IoT and mobile applications. However, modern image sensors still exhibit high power consumption, primarily attributed to analog readout. This high power consumption arises from the conventional practice of supplying a fixed voltage to the analog circuitry of image sensors. Towards that end, we propose to aggressively scale analog voltage supplied to the camera as means to significantly reduce sensor power consumption. This demonstration showcases the potential of dynamic voltage scaling on commercial image sensors within an RPi-based video streaming pipeline. We enable users to flexibly configure sensor voltage settings and observe the impact on both image fidelity and sensor power consumption. Furthermore, this demonstration offers a framework for studying the implications of flexible voltage specification in the context of a person tracking application.

Huge advancements have been made over the years in terms of modern image-sensing hardware and visual computing algorithms (e.g., computer vision, image processing, and computational photography). However, to this day, there still exists a current gap between the hardware and software design in an imaging system, which silos one research domain from another. Bridging this gap is the key to unlocking new visual computing capabilities for end applications in commercial photography, industrial inspection, and robotics. In this survey, we explore existing works in the literature that can be leveraged to replace conventional hardware components in an imaging system with software for enhanced reconfigurability. As a result, the user can program the image sensor in a way best suited to the end application. We refer to this as software-defined imaging (SDI), where image sensor behavior can be altered by the system software depending on the user’s needs. The scope of our survey covers imaging systems for single-image capture, multi-image, and burst photography, as well as video. We review works related to the sensor primitives, image signal processor (ISP) pipeline, computer architecture, and operating system elements of the SDI stack. Finally, we outline the infrastructure and resources for SDI systems, and we also discuss possible future research directions for the field.

Energy-efficient visual sensing is extremely important to enable battery powered mobile and IoT applications. While several scheduling techniques have been proposed to save the digital power of sensing, the analog power [1] of capturing an image still remains a daunting barrier for a camera's energy-efficiency. To that end, we characterize the power and performance implications of analog voltage scaling on off-the-shelf image sensors. Our characterization reveals that while reducing the analog voltage supplied to image sensor helps promote sensor power efficiency, it also impairs imaging fidelity, specifically by making images brighter and noisier. Furthermore, we find that brighter and noisier images situationally affect the task accuracy of vision applications. In this poster, we propose an investigation towards a system that adaptively scales analog voltage to optimize sensor energy, while respecting the fidelity needs of visual tasks.

High spatiotemporal resolution can offer high precision for vision applications, which is particularly useful to capture the nuances of visual features, such as for augmented reality. Unfortunately, capturing and processing high spatiotemporal visual frames generates energy-expensive memory traffic. On the other hand, low resolution frames can reduce pixel memory throughput, but reduce also the opportunities of high-precision visual sensing. However, our intuition is that not all parts of the scene need to be captured at a uniform resolution. Selectively and opportunistically reducing resolution for different regions of image frames can yield high-precision visual computing at energy-efficient memory data rates.