Medusa is a Microsoft Surface that has been instrumented with 138 proximity sensors. These proximity sensors enable the Surface to sense the users around it, as well as the hands and arms above its display. Not only are these sensors inexpensive and simple to configure, but also they enable an integrated hardware solution, without requiring any markers, cameras, or other sensing devices external to the display platform itself. As Medusa has an awareness of users' locations, it can for example, identify touch points by user, and disambiguate between touches made with left or right hands. This video demonstrates a number of interaction techniques that are now possible using this information. Medusa's additional sensing is meant to enhance the touch sensing of the underlying multi-touch tabletop, rather than to supplant or replace touch-based interaction.
This work is a research project that was conducted by Michelle Annett (http://ualberta.ca/~mkannett) while she was an intern at Autodesk Research (http://www.autodeskresearch.com/publications/medusa).
Citation:
Michelle Annett, Tovi Grossman, Daniel Wigdor, George Fitzmaurice. 2011 - To Appear. Medusa: A Proximity-Aware Multi-touch Tabletop. To Appear In The Proceedings of the 24th Annual ACM Symposium on User interface Software and Technology (Santa Barbara, California, October 16 - 19, 2011). UIST '11. ACM, New York, NY. 10 Pages.
How it deals with crossing hands?
feki00 4 months ago
1) I think adding proximity detection to the touch surface is a brilliant idea.
2) but the implementation looks pretty complex, expensive (anything times 138 is expensive), and fragile. Wouldn't it be possible to do something similar with kinect or camera based technology? (yes, I know that doing video processing to implement proximity detection seems like overkill, but with today's cheap cameras and excess available computing power, it might work better...)
westfw 4 months ago
This is some fantastic research, keep it up.
ReadyWater 4 months ago
You guys are off to a good start and on to something very good and useful. Keep up the good work. Maybe smaller sensors and more of them could further improve the resolution in later projects. Thanks for sharing.
UNHCoffee 4 months ago
from the video it looks like it barely works and lags like crap
rasz 4 months ago
This evokes Interesting ideas. Surprisingly laggy in the demo however.
konrad303 4 months ago