Ghost over the Shell - a new take on touchless interaction with the Kinect

Here's a slightly different take on "multitouch" interaction with the Kinect: to mitigate previous problems like not being able to properly hit UI objects, a ghost overlay of the user is shown on top of the GUI, enabling more precise touchless interaction.
Built on Ubuntu using libTISCH 2.0 Alpha 1 ( http://tisch.sf.net ) and libfreenect ( http://openkinect.net ).

P.S. Yes, I know it's not perfect, esp. the keyboard - it's a prototype after all.

Category:

Science & Technology

Tags:

• touchless
• interaction
• multitouch
• kinect
• libtisch

[shobley]

I'm going to play devil's advocate - how do you address the "gorilla arm" problem?

[floemuc]

@shobley: good question - i think this is mostly suitable for brief, casual interaction with, e.g., a public display. either that, or many trips to the gym :-)

[flyboy2000008]

It's the future :D lol

[robvh2]

Excellent work. The goal seems to be a Mirority Report type of experience but I've maintained since very early on that a ghost would be required in the absence of a head-mounted display... or holograms.

I think your video would benefit a great deal from a more visible ghost image. I found it very difficult to see the overlay throughout most of the video. Perhaps you could tint or darken the image and post another clip.

Keep up the good work!