motion parallax

Arthropods' eyes are effective biological vision systems for object tracking and wide field of view because of their structural uniqueness; however, unlike mammalian eyes, they can hardly acquire the depth information of a static object because of their monocular cues. Therefore, most arthropods rely on motion parallax to track the object in three-dimensional (3D) space. Uniquely, the praying mantis (Mantodea) uses both compound structured eyes and a form of stereopsis and is capable of achieving object recognition in 3D space...

The three-dimensional (3D) light field display (LFD) with dense views can provide smooth motion parallax for the human eye. Increasing the number of views will widen the lens pitch, however, resulting in a decrease in view resolution. In this paper, an approach to smooth motion parallax based on optimizing the divergence angle of the light beam (DALB) for 3D LFD with narrow pitch is proposed. DALB is controlled by lens design. A views-fitting optimization algorithm is established based on a mathematical model between DALB and view distribution...

A computer-generated hologram (CGH) enables the display of virtual images and videos as well as the communication and storage of holographic data. The point-based method, which is a CGH-calculation method for representing the surface of an object as a set of point-light sources, has not been sufficiently studied in terms of realistic representation. This paper proposes a CGH-calculation method for realistic rendering using ray tracing to be used with a point-based method. Experiments were conducted with an optical system to confirm the effectiveness of the proposed method in terms of hidden-surface removal in mirror images and its implementation on multiple mirror surfaces...

We provide the first perceptual quantification of user's sensitivity to radial optic flow artifacts and demonstrate a promising approach for masking this optic flow artifact via blink suppression. Near-eye HMDs allow users to feel immersed in virtual environments by providing visual cues, like motion parallax and stereoscopy, that mimic how we view the physical world. However, these systems exhibit a variety of perceptual artifacts that can limit their usability and the user's sense of presence in VR. One well-known artifact is the vergence-accommodation conflict (VAC)...

Stereoscopic, head-tracked display systems can show users realistic, world-locked virtual objects and environments (i.e., rendering perspective-correct binocular images with accurate motion parallax). However, discrepancies between the rendering pipeline and physical viewing conditions can lead to perceived instability in the rendered content resulting in reduced immersion and, potentially, visually-induced motion sickness. Precise requirements to achieve perceptually stable world-locked rendering (WLR) are unknown due to the challenge of constructing a wide field of view, distortion-free display with highly accurate head and eyetracking...

The rendering of specular highlights is a critical aspect of 3D rendering on autostereoscopic displays. However, the conventional highlight rendering techniques on autostereoscopic displays result in depth conflicts between highlights and diffuse surfaces. To address this issue, we propose a viewpoint-dependent highlight depiction method with head tracking, which incorporates microdisparity of highlights in binocular parallax and preserves the motion parallax of highlights. Our method was found to outperform physical highlight depiction and highlight depiction with microdisparity in terms of depth perception and realism, as demonstrated by experimental results...

Previous LCD-based multiplicative compressive light field (CLF) display has the trade-off between the brightness and the depth of field (DOF). In this paper, we propose a hybrid CLF display using a reflective polarizer and RGB mini-LED panel. By the polarization-multiplexing and the reflector dam (RD) designed on the mini-LED panel, the proposed system can preserve high brightness while enhancing the DOF. Then, a decomposition algorithm is proposed to improve the image quality by depth segmentation and limiting the motion parallax...

To address the limitation of narrow field-of-view in local oral cavity images that fail to capture large-area targets at once, this paper designs a method for generating natural dental panoramas based on oral endoscopic imaging that consists of two main stages: the anti-perspective transformation feature extraction and the coarse-to-fine global optimization matching. In the first stage, we increase the number of matched pairs and improve the robustness of the algorithm to viewpoint transformation by normalizing the anti-affine transformation region extracted from the Gaussian scale space and using log-polar coordinates to compute the gradient histogram of the octagonal region to obtain the set of perspective transformation resistant feature points...

Conventional spatial light modulator (SLM)-based holographic 3D display faces limited field of view (FOV) and eyebox, due to its limited pixel number. In this paper, a lens array is used to expand the FOV and eyebox of an SLM-based holographic display. The hologram is calculated to reconstruct a 3D sub-image array, each sub-image corresponding to a specific perspective of the 3D object. Then, the 3D sub-image array is imaged and magnified by the lens array to integrate to the original 3D image. The FOV is expanded due to the large numerical aperture of the lens, and the eyebox is expanded because the lens array generates multiple viewpoints with a large pitch...

When an observer moves in space, the retinal projection of a stationary object either expands if the motion is toward the object or shifts horizontally if the motion contains a lateral component. This study examined the impact of expansive optic flow and lateral motion parallax on the accuracy of depth perception for observers with normal or artificially reduced acuity and asked whether any benefit is due to the continuous motion or to the discrete object image displacement. Stationary participants viewed a virtual room on a computer screen...

Multi-layer images are currently the most prominent scene representation for viewing natural scenes under full-motion parallax in virtual reality. Layers ordered in diopter space contain color and transparency so that a complete image is formed when the layers are composited in a view-dependent manner. Once baked, the same limitations apply to multi-layer images as to conventional single-layer photography, making it challenging to remove obstructive objects or otherwise edit the content. Object removal before baking can benefit from filling disoccluded layers with pixels from background layers...

Depth estimation is an ill-posed problem; objects of different shapes or dimensions, even if at different distances, may project to the same image on the retina. Our brain uses several cues for depth estimation, including monocular cues such as motion parallax and binocular cues such as diplopia. However, it remains unclear how the computations required for depth estimation are implemented in biologically plausible ways. State-of-the-art approaches to depth estimation based on deep neural networks implicitly describe the brain as a hierarchical feature detector...

The performance in restoring compressed multi-view video (MVV) of the existing learning-based methods is limited because they only utilize information of temporally adjacent frames or parallax neighboring views. However, the compression artifacts caused by multi-view coding (MVC) may be related to the reference errors of intra-frame, inter-frame, and inter-view. In this paper, with delicately utilizing the stereo information from both temporal and parallax domains, a motion-parallax complementation network (MPCNet) is proposed to restore the quality of compressed MVV more efficiently...

The dynamics of head and eye gaze between two or more individuals displayed during verbal and nonverbal face-to-face communication contains a wealth of information and is used for both volitionary and unconscious signaling. Current video communication systems convey visual signals about gaze behavior and other directional cues, but the information they carry is often spurious and potentially misleading. I discuss the consequences of this situation, identify the source of the problem as a more general lack of deictic consistency, and demonstrate that using display technologies that simulate motion parallax are both necessary and sufficient to alleviate it...

Current efforts with light field displays are mainly concentrated on the widest possible viewing angle, while a single viewer only needs to view the display in a specific viewing direction. To make the light field display a practical practice, a super multi-view light field display is proposed to compress the information in the viewing zone of a single user by reducing the redundant viewpoints. A quasi-directional backlight is proposed, and a lenticular lens array is applied to achieve the restricted viewing zone...

Depth information is important for postural stability and is generated by two visual systems: binocular and motion parallax. The effect of each type of parallax on postural stability remains unclear. We investigated the effects of binocular and motion parallax loss on static postural stability using a virtual reality (VR) system with a head-mounted display (HMD). A total of 24 healthy young adults were asked to stand still on a foam surface fixed on a force plate. They wore an HMD and faced a visual background in the VR system under four visual test conditions: normal vision (Control), absence of motion parallax (Non-MP)/binocular parallax (Non-BP), and absence of both motion and binocular parallax (Non-P)...

This work introduces a perspective-corrected video see-through mixed-reality head-mounted display with edge-preserving occlusion and low-latency capabilities. To realize the consistent spatial and temporal composition of a captured real world containing virtual objects, we perform three essential tasks: 1) to reconstruct captured images so as to match the user's view; 2) to occlude virtual objects with nearer real objects, to provide users with correct depth cues; and 3) to reproject the virtual and captured scenes to be matched and to keep up with users' head motions...

Natural, dynamic eye contact behaviour is critical to social interaction but is dysfunctional in video conferencing. In analysing the problem, I introduce the concept of directionality and emphasize the critical role of motion parallax. I then sketch approaches towards re-establishing directionality and enabling natural, dynamic eye contact in video conferences.

Due to the widespread applications of high-dimensional representations in many fields, the three-dimension (3D) display technique is increasingly being used for commercial purpose in a holographic-like and immersive demonstration. However, the visual discomfort and fatigue of 3D head mounts demonstrate the limits of usage in the sphere of marketing. The compressive light field (CLF) display is capable of providing binocular and motion parallaxes by stacking multiple liquid crystal screens without any extra accessories...

Neurons in the rat postrhinal cortex (POR) respond to the egocentric (observer-centered) bearing and distance of the boundaries, or geometric center, of an enclosed space. Understanding of the precise geometric and sensory properties of the environment that generate these signals is limited. Here we model how this signal may relate to visual perception of motion parallax along environmental boundaries. A behavioral extension of this tuning is the known 'centering response', in which animals follow a spatial gradient function based on boundary parallax to guide behavior toward the center of a corridor or enclosure...