DJing using Kinect

Using the OpenNI framework and the FAAST toolkit I used my Kinect to map gestures to keypresses in the Numark Cue (Virtual DJ) software.

I mapped left arm forwards and right arm forwards to play, left arm out to cue, left arm up to swap active deck, right arm up to sync (auto beatmatch). The lean forward triggers the beatgrid effect module and the side to side leans control the crossfader. To make it easy for the demo I preloaded tracks and set a second cue point to mix from, triggered by the right arm across the body.

The tracks are Armin van Buuren "Drowning (Avicii Mix)" and Kyau and Albert - "On The Way (Original)".

If you want to try yourself, download the Virtual DJ home free edition from VirtualDJ.com or the Numark Cue 5 20 day trial (what I used). You'll need to adjust the default key mappings to match what you set up in FAAST. Get FAAST from http://projects.ict.usc.edu/mxr/faast/. I used one standard Kinect (Xbox 360 add on).

Here are my mappings:

left_arm_up 20 key_press tab
left_arm_forwards 20 key_hold shift
right_arm_forwards 20 key_press p
right_arm_up 20 key_press q
left_arm_out 20 key_press c
lean_forwards 20 key_press e
lean_left 20 key_press z
lean_right 20 key_press x
right_arm_across 20 key_press j

Have fun!

Category:

Science & Technology

Tags:

• DJ
• Kinect
• hack

[TriptonicTV]

Very cool indeed. Nicely done Si!

[Jaytube01]

There was a time when we moved to the beat of the music. Now when we move we can create the beat of the music! Great stuff Simon!