During the course "Musical Interfaces" at the FH-Potsdam, we developed an interactive model to make drawings audible. It contains the interaction between human and computer and combines the visual sense with the sense of hearing.
The "machine" is based on an interactive projection, controlled by video tracked pen containing a pressure sensor. The rear projected visuals provide a graphical feedback.
The user can draw several strokes on screen, each of them representing a twin-sound, based on the input parameters position, pressure and movements.
To create sounds we utilize a custom synthesizer patch for the software "NI Reaktor".
Our software prototype isn't just a connector between sensor values and Reactor controllers but tries to map behaviours to their logical consequences on the generated sound.
Link to this comment:
All Comments (11)