Realism and immersion in the reproduction of audio-visual recordings for urban soundscape evaluation

Abstract

Within the framework of the Urban Soundscapes of the World project, a comprehensive database of high quality immersive audio-visual recordings is being collected at various urban locations worldwide. The recordings combine 360-degree video, for presentation using a head-mounted display, with spatial audio, including binaural and first order ambisonics. Recording sites are being selected trough a perception-based protocol that consists of an online questionnaire conducted among panels of local experts, leading to a range of urban sites with a wide variety of soundscapes. This paper reports on the results of a two-stage immersive perception experiment, conducted using a subset of the audio-visual recordings already in the database. In the first stage, the audio-visual recordings are assessed in terms of pleasantness/eventfulness of the soundscape, and in terms of how much the soundscape might interfere with activities. In the second stage, both binaural and first order ambisonics spatial audio techniques are assessed in terms of the degree of realism and immersion they provide, for the different types of soundscapes considered. The results of this benchmark listening test will steer the design of future experiments on the effect of soundscape interventions and on the effect of inter-cultural differences on soundscape perception.