motion parallax

Estimating the distance to objects is crucial for autonomous vehicles, but cost, weight or power constraints sometimes prevent the use of dedicated depth sensors. In this case, the distance has to be estimated from on-board mounted RGB cameras, which is a complex task especially for environments such as natural outdoor landscapes. In this paper, we present a new depth estimation method suitable for use in such landscapes. First, we establish a bijective relationship between depth and the visual parallax of two consecutive frames and show how to exploit it to perform motion-invariant pixel-wise depth estimation...

An important function of the visual system is to represent 3D scene structure from a sequence of 2D images projected onto the retinae. During observer translation, the relative image motion of stationary objects at different distances (motion parallax) provides potent depth information. However, if an object moves relative to the scene, this complicates the computation of depth from motion parallax since there will be an additional component of image motion related to scene-relative object motion. To correctly compute depth from motion parallax, only the component of image motion caused by self-motion should be used by the brain...

A wide field of view (FOV) is required to improve the user experience in mobile applications of light-field displays (LFDs). However, the FOV of liquid-crystal-display-based LFDs is narrow owing to the thick gap between the light-direction-control element and the pixel plane. The thin-encapsulated self-emissive displays, such as organic light-emitting diodes (OLEDs), are beneficial for widening the FOV without losing spatial resolution. With OLEDs, a 72-degree FOV, 12-view, 166-ppi LFD with smooth motion parallax is demonstrated...

A multi-directional backlight autostereoscopic display system with high resolution, low crosstalk, and motion parallax is developed in this paper. The proposed multi-directional backlight system is based on the Bragg mismatched reconstruction of volume holographic optical element (VHOE), and includes a set of light sources which are uniformly arrayed along one direction. Each light source produces its corresponding directional lighting to follow the human eye position detected by an eye tracker. Two scenarios are presented to build the multi-directional backlight system...

We present anl omnidirectional 3D autostereoscopic aerial display with continuous parallax. Integral photography (IP) combined with polyhedron-shaped aerial imaging plates (AIPs) is utilized to achieve an extended view angle of 3D aerial images. With optical theoretical analysis and an aerial in situ rotation design, a 3D aerial display with an enlarged viewing angle is realized. In particular, the proposed 3D aerial display can realize any assigned angle within 360 deg. We also optimize the aerial display with artifact image removal and floating image brightness analysis...

In natural contexts, sensory processing and motor output are closely coupled, which is reflected in the fact that many brain areas contain both sensory and movement signals. However, standard reductionist paradigms decouple sensory decisions from their natural motor consequences, and head-fixation prevents the natural sensory consequences of self-motion. In particular, movement through the environment provides a number of depth cues beyond stereo vision that are poorly understood. To study the integration of visual processing and motor output in a naturalistic task, we investigated distance estimation in freely moving mice...

STUDY DESIGN: In vitro study. OBJECTIVE: The purpose of the present study was to utilize an idealized cervical spine model to determine whether the parallax effect or changes in the position of the spine relative to the x-ray generator influence intervertebral motion parameters on dynamic cervical spine radiographs. SUMMARY OF BACKGROUND DATA: The utility of flexion-extension radiographs in clinical practice remains in question due to poor reliability of the parameters utilized to measure motion...

Machine learning only uses single-channel grayscale features to model the target, and the filter solution process is relatively simple. When the target has a large change relative to the initial frame, the tracking effect is poor. When there is the same kind of target interference in the target search area, the tracking results will be poor. The tracking algorithm based on the fully convolutional Siamese network can solve these problems. By learning the similarity measurement function, the similarity between the template and the target search area is evaluated, and the target area is found according to the similarity...

Detection of objects that move in a scene is a fundamental computation performed by the visual system. This computation is greatly complicated by observer motion, which causes most objects to move across the retinal image. How the visual system detects scene-relative object motion during self-motion is poorly understood. Human behavioral studies suggest that the visual system may identify local conflicts between motion parallax and binocular disparity cues to depth and may use these signals to detect moving objects...

We propose a holographic stereogram synthesis method which uses holograms that are optically captured by self-interference incoherent digital holography (SIDH) based on a geometric phase lens. SIDH is a promising solution for hologram acquisition under low-coherence lighting condition. A mechanical scanning system is constructed to acquire multiple perspective holograms. Numerical simulations and experimental analyses conducted using high-resolution diffractive optical element demonstrate that the proposed method can produce a wide-viewing hologram which can realize realistic 3D scenarios with depth cues such as accommodation and motion parallax...

This study reports the development of prototype swept-source optical coherence tomography (SS-OCT) technology for imaging the anterior eye. Advances in vertical-cavity surface-emitting laser (VCSEL) light sources, signal processing, optics and mechanical designs, enable a unique combination of high speed, long range, and deep penetration that addresses the challenges of anterior eye imaging. We demonstrate SS-OCT with a 325 kHz A-scan rate, 12.2 µm axial resolution (in air), and 15.5 mm depth range (in air) at 1310 nm wavelength...

There are two distinct sources of retinal image motion: objects moving in the world and observer movement. When the eyes move to track a target of interest, the retinal velocity of some object in the scene will depend on both eye velocity and that object's motion in the world. Thus, to compute the object's velocity relative to the head, a coordinate transformation must be performed by vectorially adding eye velocity and retinal velocity. In contrast, a very different interaction between retinal and eye velocity signals has been proposed to underlie estimation of depth from motion parallax (MP), which involves computing the ratio of retinal and eye velocities...

Binocular disparity provides one of the important depth cues within stereoscopic three-dimensional (3D) visualization technology. However, there is limited research on its effect on learning within a 3D augmented reality (AR) environment. This study evaluated the effect of binocular disparity on the acquisition of anatomical knowledge and perceived cognitive load in relation to visual-spatial abilities. In a double-center randomized controlled trial, first-year (bio)medical undergraduates studied lower extremity anatomy in an interactive 3D AR environment either with a stereoscopic 3D view (n = 32) or monoscopic 3D view (n = 34)...

The autostereoscopic 3D display has two important indicators, both the number of viewpoints and display resolution. However, it's a challenge to improve both the viewpoint and the resolution. Here, we develop a fixed-position multiview and lossless resolution autostereoscopic 3D display system that includes the dynamic liquid crystal (LC) grating screen. This display system consists of an LC display panel and an LC grating screen. The synchronization of the frame switching of the LC display panel and the LC grating screen shutter enables the preserved resolution...

Parallax, as a visual effect, is used for depth perception of objects. But is there also the effect of parallax in the context of electric field imagery? In this work, the example of weakly electric fish is used to investigate how the self-generated electric field that these fish utilize for orientation and communication alike, may be used as a template to define electric parallax. The skin of the electric fish possesses a vast amount of electroreceptors that detect the self-emitted dipole-like electric field...

Headbobs are up-down movements of the cranium associated with the use of motion parallax for depth perception. Mongolian gerbils (aka jirds; Meriones unguiculatus) often execute a series of headbobs prior to jumping between surfaces. Gerbils were tested in a jumping stand task and headbobs videotaped under three light levels approximating low daylight, dawn/dusk, and moonlight across a range of distances to target. Headbobs per trial increased linearly with increasing distance to the target platform, whereas headbob frequency (rate of headbobbing pre-jump on the start platform) increased with gap distance up to an intermediate level and then decreased...

Glasses-free three-dimensional (3D) displays are one of the game-changing technologies that will redefine the display industry in portable electronic devices. However, because of the limited resolution in state-of-the-art display panels, current 3D displays suffer from a critical trade-off among the spatial resolution, angular resolution, and viewing angle. Inspired by the so-called spatially variant resolution imaging found in vertebrate eyes, we propose 3D display with spatially variant information density...

This paper presents a practical yet effective solution for integrating an RGB-D camera and an inertial sensor to handle the depth dropouts that frequently happen in outdoor environments, due to the short detection range and sunlight interference. In depth drop conditions, only the partial 5-degrees-of-freedom pose information (attitude and position with an unknown scale) is available from the RGB-D sensor. To enable continuous fusion with the inertial solutions, the scale ambiguous position is cast into a directional constraint of the vehicle motion, which is, in essence, an epipolar constraint in multi-view geometry...

Motion parallax and binocular disparity contribute to the perceived depth of three-dimensional (3D) objects. However, depth is often misperceived, even when both cues are available. This may be due in part to conflicts with unmodelled cues endemic to computerized displays. Here we evaluated the impact of display-based cue conflicts on depth cue integration by comparing perceived depth for physical and virtual objects. Truncated square pyramids were rendered using Blender and 3D printed. We assessed perceived depth using a discrimination task with motion parallax, binocular disparity, and their combination...

To create a realistic 3D perception on glasses-free displays, it is critical to support continuous motion parallax, greater depths of field, and wider fields of view. A new type of Layered or Tensor light field 3D display has attracted greater attention these days. Using only a few light-attenuating pixelized layers (e.g., LCD panels), it supports many views from different viewing directions that can be displayed simultaneously with a high resolution. This paper presents a novel flexible scheme for efficient layer-based representation and lossy compression of light fields on layered displays...