Two-Handed Interaction in Open Space

(See http://www.cs.rug.nl/~isenberg/VideosAndDemos/Vlaming2008PTI )
Based on Johnny Lee's original idea of finger tracking with a Wii Remote, we created a finger tracking system that uses the Wii Remote and gloves fitted with retro-reflective markers. The hardware setup consists of the Wii Remote, an array of infrared LEDs, and a bluetooth dongle, in addition to a laptop and projector presentation setup. The project aimed at enabling free-handed multi-touch interaction, where problems arise such as having to identify the fingers of each hand and to recognize pinching for interaction. The final system allows dual-»touch« interaction with videos, images, and slide decks, and is designed to be used for presentations.
we are reachable via tabletop2008@asperientje.net)

Category:

Science & Technology

Tags:

• wiimote
• two
• handed
• interaction
• open
• space
• minority
• report
• presentation
• mode
• led
• array
• wii
• remote
• virtual
• reality
• VR
• display
• finger
• tracking
• interactive
• computer
• nintendo
• immersive
• window

[thescowlingschnauzer]

Wow, that's even simpler than Andy Wilson's pinch gesture, and he works for MSR! Nicely done.

Is this a private project or is there free- or shareware available? I'd love to try it out.

[asperientje]

Its free. There is a C# source code version available, but only the pairing is ported there. There is also a C++ version available with the presentation software included, but only as a binary.

[thescowlingschnauzer]

How does it recognize the pinch?

[asperientje]

When a point disappears, a pinch can be registered, according to whether or not the last known distance between the points is smaller than a certain threshold

[craigrm19]

Very nice! Please can you share with me the code for the "Interacting with Individual Objects" part? Very impressive!

[BitzFit]

wow thats a cool solution. I wouldnt have thought of that.

[communicabledance]

incredibly amazing work! I look forward to checking this out when I've got a little more free time