(OLD VERSION) Imaginary Interfaces: Spatial Interaction with Empty Hands and Without Visual Feedback

An expanded and updated version of this video is available here:
http://www.youtube.com/watch?v=718RDJeISNA

Imaginary Interfaces is a research project from Sean Gustafson, Daniel Bierwirth and Patrick Baudisch at the Hasso Plattner Institute in Potsdam, Germany.

More details: http://www.hpi.uni-potsdam.de/baudisch/projects/imaginary_interfaces.html

Abstract:

Screen-less wearable devices allow for the smallest form factor and thus the maximum mobility. However, current screen-less devices only support buttons and gestures. Pointing and direct manipulation are not supported because users have nothing to point to. We challenge the notion that spatial interaction requires a screen and propose a method for bringing spatial interaction to screen-less devices.

We present Imaginary Interfaces, screen-less devices that allow users to perform spatial interaction with empty hands and without visual feedback. Unlike projection-based solutions, such as Sixth Sense, all "feedback" takes place in the user's imagination. Users define the origin of an imaginary space by forming an L-shaped coordinate cross with their non-dominant hand. Users then point and draw with their dominant hand in the resulting space. The interaction is tracked by a tiny camera device clipped to the user's clothing and pointed at the user's hands.

To validate our design we conducted three user studies that required participants to create simple drawings, annotate an existing drawing, and point at locations described in imaginary space. Our findings suggest that Imaginary Interaction is enabled by user's visual short-term memory.

Category:

Science & Technology

Tags:

• research
• hci
• chi
• uist
• mobile
• phone