Augmented reality (AR) devices seek to create compelling visual experiences that merge virtual imagery with the natural world. These devices often rely on wearable near-eye display systems that can optically overlay digital images to the left and right eyes of the user separately. Ideally, the two eyes should be shown images with minimal radiometric differences (e.g., the same overall luminance, contrast, and color in both eyes), but achieving this binocular equality can be challenging in wearable systems with stringent demands on weight and size. Basic vision research has shown that a spectrum of potentially detrimental perceptual effects can be elicited by imagery with radiometric differences between the eyes, but it is not clear whether and how these findings apply to the experience of modern AR devices. In this work, we first develop a testing paradigm for assessing multiple aspects of visual appearance at once, and characterize five key perceptual factors when participants viewed stimuli with interocular contrast differences. In a second experiment, we simulate optical see-through AR imagery using conventional desktop LCD monitors and use the same paradigm to evaluate the multi-faceted perceptual implications when the AR display luminance differs between the two eyes. We also include simulations of monocular AR systems (i.e., systems in which only one eye sees the displayed image). Our results suggest that interocular contrast differences can drive several potentially detrimental perceptual effects in binocular AR systems, such as binocular luster, rivalry, and spurious depth differences. In addition, monocular AR displays tend to have more artifacts than binocular displays with a large contrast difference in the two eyes. A better understanding of the range and likelihood of these perceptual phenomena can help inform design choices that support high-quality user experiences in AR.

The human visual system evolved in environments with statistical regularities. Binocular vision is adapted to these such that depth perception and eye movements are more precise, faster, and performed comfortably in environments consistent with the regularities. We measured the statistics of eye movements and binocular disparities in virtual-reality (VR) - gaming environments and found that they are quite different from those in the natural environment. Fixation distance and direction are more restricted in VR, and fixation distance is farther. The pattern of disparity across the visual field is less regular in VR and does not conform to a prominent property of naturally occurring disparities. From this we predict that double vision is more likely in VR than in the natural environment. We also determined the optimal screen distance to minimize discomfort due to the vergence-accommodation conflict, and the optimal nasal-temporal positioning of head-mounted display (HMD) screens to maximize binocular field of view. Finally, in a user study we investigated how VR content affects comfort and performance. Content that is more consistent with the statistics of the natural world yields less discomfort than content that is not. Furthermore, consistent content yields slightly better performance than inconsistent content.

Can a device that can perform hyperacuity vision tasks be built? In this paper, a feasibility study based on separation discrimination is conducted. Two types of ideal detectors are considered. The first is the stimulus defined statistically (SDS) detector by Geisler and Davilla. The second is one that estimates the uncertainty and then takes out its effect. In the first method, an array of many ideal stimulus defined exactly (SDE) detectors covers uncertainties and forms the ideal SDS detector. When the separation distance between the SDE detectors is around 1 arcmin, the SDS detector can achieve nearly optimal performance. To cover the motion uncertainty with nearly optimal performance, the SDE detector at each position needs to cover 16 directions, and at each direction, it needs to cover speeds with an increment of 0.5 degrees/s. Typically, the SDS detector needs 7776 SDE detectors to deal with a speed up to 2 degrees/s stimulus movement with a randomly selected direction and a 9 min x 9 min position uncertainty region. This ideal observer can achieve a hyperacuity threshold of 2-4 arcsec. Its threshold is almost constant over the range of speeds covered by the SDS detector. Using the second method, position estimation and motion tracking capability is examined. With perfect position estimation and motion tracking, the SDS detector can be reduced to a single SDE detector that is tuned to correct position and motion direction and speed. Two lower bounds on the estimation variance are examined, namely: 1) the Cramer-Rao bound and 2) the Ziv-Zakai bound. The results showed that if an estimation algorithm that can achieve the performance of bounds can be found, then the second method could achieve a hyperacuity capability of 1 s or less. The human visual system may more likely adopt the first method, but the second is simpler to use in building up a device using microprocessors. In this paper, dot-pair templates are used, which precisely match to dot-pair stimuli, to compute the likelihood and make a decision. The main difference between this paper and that of Geisler and Davilla lies in using a discrete sum over an array of SDE detectors to closely approximate continuous integration over the uncertain region, which makes it much easier in hardware implementation.