adaptive game interface

adaptive game interface, used a pair of IR glasses to control Pong on a Processing applet (simple demo, frame rate is also pretty slow), the Wii IR camera was used and not the video input (this is only for demonstration), so left right head movements move the paddle up and down, code could easily be adapted to control mouse, trigger keyboard keys (using JAVA robot class) or used in conjunction with Arduino and sensors to allow users with limited hand movement/ co-ordination to interface with software systems, e.g. second life, etc. Could also integrate face tracking, zone triggering, color tracking, accelerometer gesture identification (see my other videos) which opens up many possibilities for interface. Also used a max/msp patch to do something with audio, just to demonstrate that multi control streams of data can be sent to multiple applications using Open Sound Control, really this means that the control data can be multicast to many applications on the local computer and the internet (for online gaming). Could also record IR trail and use Hidden Markov Model analysis so shapes could be translated into actions, this is done already by analysing move movements on a tablet, you just need to integrate the IR to control the mouse, but you get the idea....have an implementation of SPHINX http://cmusphinx.sourceforge.net/sphinx4/ voice command recognition using JAVA coming soon.

Category:

Education

Tags:

• adaptive game interface pong
• wii pong
• IR Pong