Natural User Interfaces with Physiological Sensing

Microsoft has innovated continually in developing novel interaction modalities, or natural user interfaces. Surface and Project Natal are two examples. While these modalities rely on sensors and devices situated in the environment, we believe there is a need for new modalities that enhance the mobile experience. We take advantage of sensing technologies that enable us to decode the signals generated by the body. We will demo muscle-computer interfaces, electromyography-based armbands that sense muscular activation directly to infer finger gestures on surfaces and in free space, and bio-acoustic interfaces, mechanical sensors on the body that enable us to turn the entire body into a tap-based input device.

Category:

Science & Technology

Tags:

• TechFest
• Microsoft Research
• body intervace
• natural interface
• NUI Physiological

[EpsilonVector]

I agree that it's probably not a good idea for an entire product, but I can definitely see it incorporated into other products. I may not want to control stuff like this all the time, but I may want to use a gesture or tap something in specific circumstances where it is natural.

[geosave]

I don't believe this is a good idea. You probably will have carpal tunnel before you finish learning how to use it. The software will be controlling you and not the other way around...

Can you play a piano app? Multi-touch? 3D movements? Sensorial feedback?

If you are thinking about gaming, I would prefer the actual control in my hands.

Body sensors are way to superficial to capture real time reflexes and movements.

Touch sensibility is completely out-of-control.

[georgeodst]

owned jeje xD esta bueno , pero falta mucho por mejorar muy retrasado , no parece comodo con guitar hero :S a ninguna le dio jaja