Re:MARK (Demo video, 2002)

Re:MARK (2002: by Tmema [Golan Levin and Zachary Lieberman] with production support from the Ars Electronica Futurelab) presents the fiction that speech casts visible shadows. With the help of voice analysis technology, motion sensing, and real-time computer animation, this interactive installation for two participants converts speech into whimsically animated letters and shapes that appear to float upwards from the shadow of the speaker's head. Visitors can also manipulate these forms directly, using the shadow of their own body. When a phoneme is recognized by the software with sufficient confidence, it is spelled out on the installation's display. If the visitor's utterance is not recognized by the software, an abstract shape is generated instead, whose form is tightly coupled to the speaker's vocal timbre. The result is a playful illusion in which visitors become actors in a shadow world of reactive cartoon language.

Category:

Science & Technology

Tags:

• interactive
• art
• speech
• visualization
• computer
• vision
• synesthesia
• shadows

[daguswan]

is there any chance to get the software you are using? I want to work with this amazing thing for a project at university. any feedback is welcome.

thanks a lot!