Audio Responsive Projection Mapping

Made this video to show a simple projection mapping created using Photoshop and Processing.

The Processing sketch checks the left, right and mix of the mic input, then based on the levels it swaps out a different smiling/singing face on the boxes. The left channel is blue, the right channel is red, and the white is a mix of the two.

The laptop mic isn't the greatest ever, but hopefully this shows that it can pickup any sound and animate the projection mappings in real-time.

Being a big YouTube nerd, I decided to throw the audio from Trolololo guy into the background so the boxes sing with him.

In a previous setup, I used ultrasonic sensors the vary the animations, but after seeing an experiment by Disney Research during Siggraph I decided audio input and smilies would be more fun.

Category:

Science & Technology

Tags:

• projection
• mapping
• map
• processing
• boxes
• photoshop
• singing
• trolololo
• youtube
• ultrasonic
• sensors
• mic
• audio
• input
• diy
• make
• disney
• siggraph
• minim
• ultra short throw projector
• project

[VJLOADVJ]

Hello I need some advice .... what kind of paper you used to fill the boxes? It seems like a very shiny white paper.

Hello

[cruxphotography]

@VJLOADVJ it's just christmas wrapping paper

[sundeepv80]

This is so cool dude, which software did you use for this?

[cruxphotography]

@sundeepv80 It's a processing sketch that I wrote. 

[cerupcat]

Have you posted this anywhere? You should submit it to some tech blogs. It's really great stuff!

[cruxphotography]

@cerupcat it was really just more of a quick thing I did for my going away party. I'd like to redo it at a larger scale, maybe projecting on building or for a karaoke night since one of my friends in Brooklyn is a karaoke dj.

[jcarlosbloise]

you're a monster.

[Liniformans]

@zupernowa You can use madmapper or you can make mask in adobe photoshop in import into resolume

[zupernowa]

Hi, would you tell little bit more about project. You create faces in photoshop, but what software you use to separate and align projection to boxes? And any other steps or software?

[mediaman5]

Please make a tutorial where you walkthrough step by step to make this! Thanks!

[silva324]

Hi:)

Nice work, i like it a lot...

Can you send me the source files of that? im trying to do some like that:)

silva324@hotmail.com

Tnkx a lot

[CrzayMazy]

Toying around with those while on shrooms or acid would be so cool!

[drtitislash]

wooooow!

[Aguinaldo06]

@f8thie It's really good