LightGuide: Projected Visualizations for Hand Movement Guidance

LightGuide is a system that explores a new approach to
gesture guidance where we project guidance hints directly
on a user's body. These projected hints guide the user in
completing the desired motion with their body part which is
particularly useful for performing movements that require
accuracy and proper technique, such as during exercise or
physical therapy. Our proof-of-concept implementation
consists of a single low-cost depth camera and projector
and we present four novel interaction techniques that are
focused on guiding a user's hand in mid-air. Our
visualizations are designed to incorporate both feedback
and feedforward cues to help guide users through a range of
movements. We quantify the performance of LightGuide in
a user study comparing each of our on-body visualizations
to hand animation videos on a computer display in both
time and accuracy. Exceeding our expectations, participants
performed movements with an average error of 21.6mm,
nearly 85% more accurately than when guided by video.

Paper: http://rsodhi.com/LightGuide.pdf

• Category

  People & Blogs

[assalychris]

Amazing possibilities imagined. Good job Rajinder.

[johnburkeakajjstyles]

Wow!

[Harminder Singh]

Interesting! I've seen some projections on the body before, but this is one I could actually see being useful.

I teach students how to play the violin and one of the biggest problems is when they drift away from the right posture. Just showing those red dots alone when they drift would be awesome!

[Moe Jenkins]

This is great! It's not all about software recognizing gestures as much as it is about software that provides visual feedback. Recognizing gestures with software is an important step, but communicating how well you are performing the gesture through feedback, particularly when we care about the movement in the gesture is crucial (you guys had a good example with physical therapy). I can imagine using this in a number of scenarios and this would be great in my Karate class! Cool stuff!