Accelerometer - Based Gesture Recognition with the iPhone

ABGDemo - iPhone App for free-form hand gesture recognition.
Note: App not yet available on app store - link will be posted here - check back soon!

MSc Project, Cognitive Computing, Goldsmiths University of London
by Marco Klingmann,

Many thanks to the Goldsmiths staff for their support and guidance: Dr. Nikolay Nikolaev, Dr. Mark Bishop, Dr. Mick Grierson

Abstract of the paper:
The growing number of small sensors built into consumer electronic devices, such as mobile phones, allow experiments with alternative interaction methods in favour of more physical, intuitive and pervasive human computer interaction. This paper examines hand gestures as an alternative or supplementary input modality for mobile devices. The iPhone is chosen as sensing and processing device. Based on its built-in accelerometer, hand movements are detected and classified into previously trained gestures. A software library for accelerometer-based gesture recognition and a demonstration iPhone application have been developed. The system allows the training and recognition of free-from hand gestures. Discrete hidden Markov models form the core part of the gesture recognition apparatus. Five test gestures have been defined and used to evaluate the performance of the application. The evaluation shows that with 10 training repetitions, an average recognition rate of over 90 percent can be achieved.

Read the full paper "Accelerometer-Based Gesture Recognition with the iPhone" on http://klingmann.ch

Category:

Science & Technology

Tags:

• gesture recognition
• accelerometer
• ai
• hidden markov models
• gestures
• iphone
• hci
• interaction
• artificial intelligence
• goldsmiths university
• cognitive computing
• london
• computer scrience
• pattern recognition
• neural networks