Personalized and Immersive Presentation of Video, Audio and Subtitles in 360º Environments: An Opera Use Case

Abstract

This paper presents an end-to-end system for a personalized presentation of accessibility and immersive contents in multi-screen scenarios, by focusing on an opera use case. In particular, the system allows experiencing the opera event using the classical audiovisual formats, but it additionally supports a seamless integration of 360o video, spatial audio and the use of Head Mounted Displays (HMDs). The availability of multiple 360o cameras allows experiencing the event from the preferred viewpoint, while the presented audio will match the selected camera position and current user’s viewpoint, providing a highly immersive and realistic experience. Finally, a personalized and assistive presentation of subtitles also contributes to a higher accessibility.