On the Simultaneous Perception of Sound and Three-Dimensional Objects

Although examples of work investigating the perceptual relationship and possibilities of sound and image are common, relatively litle work has been carried out into multimedia works combining sound and three-dimensional objects. A practice-based investigation into this subject is presented with original artworks and contectual material from sound art, sculpture, moving image and psychology. The project sets out to more examine the perception of multimedia work, specifically through the creation and analysis of artworks combining sound and physical objects. It considers three main areas of study: sound’s ability to draw attention to, or modify, the existing properties of an object; techniques which encourage sound and object to appear cohesively as part of the same work; and a discussion of cognitive effects that may occur as a result of their simulataneous perception. Using the concept of the search space from evolutionary computing as an example, the case is made that multimedia artworksde can present a larger field of creative opportunity than single-media works, due to the enhanced interplay between the two media and the viewer's a priori knowledge. The roles of balance, dynamism and interactivity in multimedia work are also explored. Throughout the thesis examples of original artworks are given which exemplify the issues raised. The main outcome of the study is a proposed framework for categorising and analysing the perception of multimedia artworks, based on increasing semantic separation between the sensory elements. It is claimed that as the relationship between these elements becomes less obvious, more work is demanded of the viewer's imagination in trying to reconcile the gap, leading to active engagement and the possibility of extra imaginary forms which do not exist in the original material. It is proposed that the framework and ideas in this document will be applicable beyond the sound/object focus of this study, and it is hoped they will inform research into multimedia work in other forms.

Grantor dc:publisher

Oxford Brookes University

Year dc:date

2014

Author dc:creator

• Blow, M P

Statement dc:rights

• All rights reserved

Language dc:language

en

DOI dc:identifier

https://doi.org/10.24384/k0xf-cy46

OAI identifier oai:identifier

tle:e307eecc-8abc-4b62-a4fe-9e43f632a3c0:d6bd9758-527a-46cd-bfe2-c433766e8fca:1