Multidimensional optical imaging systems for information processing and visualization technologies have numerous applications in fields such as manufacturing, medical sciences, entertainment, robotics, surveillance, and defense. Among different three-dimensional (3-D) imaging methods, integral imaging is a promising multiperspective sensing and display technique. Compared with other 3-D imaging techniques, integral imaging can capture a scene using an incoherent light source and generate real 3-D images for observation without any special viewing devices. This review paper describes passive multidimensional imaging systems combined with different integral imaging configurations. One example is the integral-imaging-based multidimensional optical sensing and imaging systems (MOSIS), which can be used for 3-D visualization, seeing through obscurations, material inspection, and object recognition from microscales to long range imaging. This system utilizes many degrees of freedom such as time and space multiplexing, depth information, polarimetric, temporal, photon flux and multispectral information based on integral imaging to record and reconstruct the multidimensionally integrated scene. Image fusion may be used to integrate the multidimensional images obtained by polarimetric sensors, multispectral cameras, and various multiplexing techniques. The multidimensional images contain substantially more information compared with two-dimensional (2-D) images or conventional 3-D images. In addition, we present recent progress and applications of 3-D integral imaging including human gesture recognition in the time domain, depth estimation, mid-wave-infrared photon counting, 3-D polarimetric imaging for object shape and material identification, dynamic integral imaging implemented with liquid-crystal devices, and 3-D endoscopy for healthcare applications.

This paper presents an overview of research work and some novel strategies and results on using data fusion in 3-D imaging when using multiple information sources. We examine a variety of approaches and applications such as 3-D imaging integrated with polarimetric and multispectral imaging, low levels of photon flux for photon-counting 3-D imaging, and image fusion in both multiwavelength 3-D digital holography and 3-D integral imaging. Results demonstrate the benefits data fusion provides for different purposes, including visualization enhancement under different conditions, and 3-D reconstruction quality improvement.

Recently, there has been a substantial increase in efforts to develop 3-D visualization technologies that can provide the viewers with a realistic 3-D visual experience. Various terms such as “reality communication” have been used to categorize these efforts. In order to provide the viewers with a complete and realistic visual sensation, the display or visualization system and the displayed content need to match the physiological 3-D information sensing capabilities of the human visual system which can be quite complex. These may include spatial and temporal resolutions, depth perception, dynamic range, spectral contents, nonlinear effects, and vergence accommodation effects. In this paper, first we present an overview of some of the 3-D display research efforts which have been extensively pursued in Asia, Europe, and North America among other areas. Based on the limitations and comfort-based requirements of the human visual system when viewing a nonnatural visual input from 3-D displays, we present an analytical framework that combines main perception and human visual requirements with analytical tools and principles used in related disciplines such as optics, computer graphics, computational imaging, and signal processing. Building on the widely used notion of light fields, we define a notion of perceivable light fields to account for the human visual system physiological requirements, and propagate it back to the display device to determine the display device specifications. This helps us clarify the fundamental and practical requirements of the 3-D display devices for reality viewing communication. In view of the proposed analytical framework, we overview various methods that can be applied to overcome the extensive information needed to be displayed in order to meet the requirements imposed by the human visual system.

The ability to sense, track, identify, and monitor biological micro/nanoorganisms in a real-time, automated, and integrated system is of great importance from both scientific and technological standpoints. Such a system and its possible variants would have numerous applications in a wide spectrum of fields, including defense against biological warfare, disease control, environmental health and safety, and medical treatments. In this paper, we review a comprehensive mixture of optical and computational tools developed in our group aiming at real-time sensing and recognition of biological microorganisms. Digital in-line holographic microscopy is used with both coherent and partially coherent illumination to probe the specimen interferometerically. The interference pattern is then recorded on an optoelectronic image sensor and transferred to a computer where special statistical algorithms are performed to segment, recognize, and track the microorganisms within the field of view of the microscope. The advantages of proposed holographic sensing are described compared to conventional two-dimensional imaging systems. In addition, the theoretical aspects and fundamental limitations of digital in-line holographic microscopy are discussed, which determine the relationship between system parameters and achievable performance. The proposed optical-digital integrated system for automated, real-time sensing and recognition of biological microorganisms has been deemed promising with the potential of widespread application. We demonstrate how the proposed techniques function together in a series of experiments.

Compressive imaging (CI) is a natural branch of compressed sensing (CS). Although a number of CI implementations have started to appear, the design of efficient CI system still remains a challenging problem. One of the main difficulties in implementing CI is that it involves huge amounts of data, which has far-reaching implications for the complexity of the optical design, calibration, data storage and computational burden. In this paper, we solve these problems by using a two-dimensional separable sensing operator. By so doing, we reduce the complexity by factor of 106for megapixel images. We show that applying this method requires only a reasonable amount of additional samples.

Three dimensional (3-D) imaging and display have been subjects of much research due to their diverse benefits and applications. However, due to the necessity to capture, record, process, and display an enormous amount of optical data for producing high-quality 3-D images, the developed 3-D imaging techniques were forced to compromise their performances (e.g., gave up the continuous parallax, restricting to a fixed viewing point) or to use special devices and technology (such as coherent illuminations, special spectacles) which is inconvenient for most practical implementation. Today's rapid progress of digital capture and display technology opened the possibility to proceed toward noncompromising, easy-to-use 3-D imaging techniques. This technology progress prompted the revival of the integral imaging (II)technique based on a technique proposed almost one century ago. II is a type of multiview 3-D imaging system that uses an array of diffractive or refractive elements to capture the 3-D optical data. It has attracted great attention recently, since it produces autostereoscopic images without special illumination requirements. However, with a conventional II system it is not possible to produce 3-D images that have both high resolution, large depth-of-field, and large viewing angle. This paper provides an overview of the approaches and techniques developed during the last decade to overcome these limitations. By combining these techniques with upcoming technology it is to be expected that II-based 3-D imaging systems will reach practical applicability in various fields.