My friend Nick Strong graciously helped with this, being my actor I got to put on the spot for a nearly improvised plot around my little installation. I used After Effects to make a hand-drawn animation to loop, and then used Processing to manipulate it.
Processing uses a video camera to watch where the laser is shone on the screen, and then draws pixels in the same place. It listens through a mic in my laptop behind the screen to hear when something sounds louder than a certain threshold. Upon that trigger, the animation switches from a loop of the monster sleeping to a clip of it eating the picture frame, and the drawn pixels follow the frame down. Nick was mostly responsible for coming up with the narrative. : )
sweet!
GeoffDeibel 1 year ago