CHIST-ERA GENESIS LeveraGing nEuromarkers for Next-gEneration immerSIve Systems

Our aim is to pave the way to a new generation of virtual reality (VR) systems leveraging the electrophysiological activity of the brain through a passive brain-computer interface (BCI) to level-up the immersion in virtual environments. The objective is to provide VR systems with means to evaluate the users' mental states through the real-time classification of electroencephalographic (EEG) data. This will improve users' immersion in VR by reducing or preventing cybersickness, and by increasing levels of embodiment through the real time adaptation of the virtual content to the users' mental states as provided by the BCI.

In order to reach this objective, the proposed methodology is to (i) investigate neurophysiological markers associated with early signs of cybersickness, as well as neuromarkers associated with the occurrence of VR anomalies; (ii) build on existing signal processing methods for the real-time classification of these markers associating them with corresponding mental states and (iii) provide mechanisms for the adaptation of the virtual content to the estimated mental states.