The goal of the research on this theme was to create authentic multisensory virtual experiences that fully replicate the equivalent real world experience.  The objectives were to create new algorithms and methodologies by doing the following:

  • Fully define the scenarios being considered, including the product, context and person.
  • From the knowledge obtained, determine: the level of realism required to achieve perceptual equivalence between the multisensory real world scenario and its virtual simulation, the personal parameters of the person undertaking the experience and the multisensory stimuli present and their interaction in the 3D context.
  • Integrate these findings into a Real Virtuality Platform that will selectively compute and deliver in real-time a virtual experience that is highly correlated with the equivalent real world experience.
  • Thoroughly validate this virtual experience against its real world equivalent for clearly defined tasks within a number of challenging scenarios.
 rendering of the virtual track used in the experimentation phase

rendering of the virtual track used in the experimentation phase

A detailed experiment was undertaken in which participants experienced a real driving scenario and a multisensory virtual equivalent at different quality levels. The senses considered were visuals, audio, smell and the motion of the car. There were three "events" in the scenario: an emergency stop, a swerve and the release of a smell. Objective and subjective quality metrics were used to establish the correlation between the real and virtual world experiences and a high correlation was achieved between the real experience and the highest quality virtual experience.