UIST'09: Enabling Always-Available Input with Muscle-Computer Interfaces

Presented at UIST (ACM Symposium on User Interface Software and Technology) http://www.acm.org/uist/

PAPER ABSTRACT:
Previous work has demonstrated the viability of applying offline analysis to interpret forearm electromyography (EMG) and classify finger gestures on a physical surface. We extend those results to bring us closer to using musclecomputer interfaces for always-available input in real-world applications. We leverage existing taxonomies of natural human grips to develop a gesture set covering interaction in free space even when hands are busy with other objects. We present a system that classifies these gestures in real-time and we introduce a bi-manual paradigm that enables use in interactive systems. We report experimental results demonstrating four-finger classification accuracies averaging 79% for pinching, 85% while holding a travel mug, and 88% when carrying a weighted bag. We further show generalizability across different arm postures and explore the tradeoffs of providing real-time visual feedback.

AUTHORS:
T. Scott Saponas, Desney S. Tan, Dan Morris, Ravin Balakrishnan, Jim Turner, James A. Landay
University of Washington, Microsoft Research, Microsoft Corporation, University of Toronto

LINK TO PUBLICATION:
http://doi.acm.org/10.1145/1622176.1622208

ACM COPYRIGHT NOTICE. Copyright © 2009 by the Association for Computing Machinery, Inc. Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, to republish, to post on servers, or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from Publications Dept., ACM, Inc., fax +1 (212) 869-0481, or permissions@acm.org.

Category:

Science & Technology

Tags:

• UIST
• user
• interface
• software
• technology
• research
• muscle
• computer
• Electromyography
• EMG
• mobile

[absulitcr]

the idea is not play guitar hero, it is a demo, so people like you could understand

[Hildoz2]

It's possible to control a computer with your eyes already. Search for COGAIN on youtube if you want to see demo's and stuff ;)

[AirSickPlains]

i want to know what the input is

[ravifreekk]

gr8 :)

[TheFXGuy]

It'd be ironic to play Terminator with this... lol

[TheSkrylove]

really interesting :)

[240SSONLY]

good technology guys.... but i think this is very useless... just cause your holding bags or running doesnt mean that you need wires up your ass to read how your butt checks move to change tracks on your ipod.... i like the wireless idea... but even then, stuff like this should read brain wave pulsewidth modulation... to levitate things... lol but seriously lets tap into the brain to let a pc understand the frequencies i give off when i want to change or pause a track.

[VictorLooser]

ofcoz it's possible!

[jnvdswehf]

RONALDO

[welstijlfilms]

I published this video on the Dutch website WELSTIJL (5 january) kind regards Sem Mallee

[CptnMarc]

this is obviously a preview for the new star wars movie coming out

[Turglith]

@635574 Oh please. It's backwards fundamentalist bullshit like that that keeps things from moving forward.

Go back to your fuckin caves and throw rocks at that big shiny thing in the sky at night.