Accelerometer - Based Gesture Recognition with the iPhone





The interactive transcript could not be loaded.



Rating is available when the video has been rented.
This feature is not available right now. Please try again later.
Uploaded on Nov 20, 2009

ABGDemo - iPhone App for free-form hand gesture recognition.
Note: App not yet available on app store

MSc Project, Cognitive Computing, Goldsmiths University of London
by Marco Klingmann,

Many thanks to the Goldsmiths staff for their support and guidance: Dr. Nikolay Nikolaev, Dr. Mark Bishop, Dr. Mick Grierson

Abstract of the paper:
The growing number of small sensors built into consumer electronic devices, such as mobile phones, allow experiments with alternative interaction methods in favour of more physical, intuitive and pervasive human computer interaction. This paper examines hand gestures as an alternative or supplementary input modality for mobile devices. The iPhone is chosen as sensing and processing device. Based on its built-in accelerometer, hand movements are detected and classified into previously trained gestures. A software library for accelerometer-based gesture recognition and a demonstration iPhone application have been developed. The system allows the training and recognition of free-from hand gestures. Discrete hidden Markov models form the core part of the gesture recognition apparatus. Five test gestures have been defined and used to evaluate the performance of the application. The evaluation shows that with 10 training repetitions, an average recognition rate of over 90 percent can be achieved.

Read the full paper "Accelerometer-Based Gesture Recognition with the iPhone" on http://klingmann.ch


When autoplay is enabled, a suggested video will automatically play next.

Up next

to add this to Watch Later

Add to

Loading playlists...