|Real-Time Sound/Image Manipulation
and Mapping in a Performance Setting
Thomas Ciufo, Brown University
"So strongly do these color phenomena appeal to me that I venture to predict that in the not very distant future there may be a color art analogous to the art of music--a color music."
Albert Michelson, Light Waves and Their Uses. 1899
Although the idea of combining sound and image is not new, recent developments
in computing have made this idea more tangible. Real-time image and
sound processing systems enable artists to affect sound and image generation,
playback, and processing, based on expressive performance attributes. One
unique potential of these new performance works is that of direct sound
to image and image to sound mapping, making sound and image structurally
integrated. To achieve this integration, specific aspects of the audio
can be analyzed and used to directly control the manipulation of specific
aspects of the image, and visa versa.