I programmed it to recognize my motions and passed the virtual button presses to the NES emulator. I could have placed a simulated keypad right in front of me that I can ...
using OpenKinect(drivers) + OpenCV(image processing and recognition) + FestVox (speech synthesis). All of the processing and recognition occurs in real time.