Enabling Saccadic Redirection Through Real-time Saccade Prediction
The paper Enabling Saccadic Redirection Through Real-time Saccade Prediction by Yashas Joshi and Charalambos Poullis has been accepted for publication in the Computer Games and Virtual Worlds journal. A provisional patent has been issued for this technology (Licensing contact: Axelys). A short video presentation of the technique is shown below.
TL;DR: Our proposed Redirected Walking technique improves on current solutions by leveraging temporary visual blindness caused by saccades for redirection without requiring additional eye-tracking hardware and enables saccadic redirection on widely used consumer-grade hardware, like mobile VR. Using a deep neural network trained on head rotation data, we predict saccades during an apparent head rotation and apply rigid transformations to the virtual environment for redirection. This allows users to infinitely walk in a perceived straight direction from within a physical tracked space of 3.5x3.5 sq.m.
Preprint: https://arxiv.org/pdf/2205.15846.pdf