Influence of performance gestures on the identification of spatial sound trajectories in a concert hall

Abstract

An experimental study was performed on the effects of the visibility of a performer's gestures on the identification of virtual sound trajectories in the concert hall. We found that when working in synchrony, the performer's gestures integrate with the audio cues to significantly increase identification performance, normalize for the effects of off-centre listening in the hall and overcome problems related to the complexity of the soundscape. In the absence of visual cues, identification performance depends on the listening seat, the sound trajectory and the complexity of the soundscape.