Game control using Webcam Tracking

A video from our third semester Medialogy project at Aalborg University Esbjerg, Denmark. We wanted to make a system to control the leaning motion of the protagonist in a FPS game using webcam head tracking. This video shows Jesper playing a beta version of a game that was used for our initial testing scenarios.

The Lean Mean Ninja Game was developed in Blitz 3D especially for this purpose. A C program tracks the head of the player using OpenCV and a tracker algorithm called Camshift. This data is fed into PPJoy and used to simulate an analog joystick which in turn controls the gradual leaning of the game protagonist.

The idea is of course to implement a similar system as a plugin for commercial games.

MED3-5 2006 group:

Jesper Kondrup
Nicolaj K. Nielsen
Jens M. Petersen
Thor Sarup

Category:

Howto & Style

Tags:

• webcam
• tracking
• game
• leaning
• control
• gradual
• eyetoy
• head
• tracker
• face
• trackir
• presence
• blitz
• 3d
• camshift
• medialogy

[mariobyb]

What is the game developed with? blitz3d?

[Kinkobal]

Thanks...

Yes it was made in Blitz3d. The game world was made in 3D World Studio

[dak1st]

And which dll did u use?

[Kinkobal]

None as far as I remember. We used the OpenCV libraries to grab data from the cameras. The camera was a Bisoncam NB pro if that helps

[dak1st]

Thats cool. I wanted to make something like that with but i had problems with dlls for wabcams... which one did u use?

[Kinkobal]

The webcam was a built in on my notebook which was high rez (640x480). That is why the tracking lags a little. With low rex cameras the tracking was realtime and still tracked perfectly

[crazekiller123x]

ur usin the keybaord

[kilsya1]

I know its real, but some people could mistake your fingers for pressing the q and e keys to lean

[Tutorialreporter]

what pc?

[avatarelite]

@diabeticman2 no he is not.

[TaskinKosedag]

you just movin your hands...T_T

[radsimu]

that is a very boring game

[cool4usarkar]

pretty cool!

[ThaPaddeProductions]

WOW cool Download?

[eclipsexz]

i need this program helpme

[forsakenfallenangel]

man ide love to have this for fps to shoot around corners =D be great