Real-time People detection and tracking with multiple Kinect cameras

Automatic detection and tracking of people with several microsoft kinect cameras in real-time. Cameras are connected to a single laptop. People are detected given the noisy depth measurements from multiple kinects. Stationary and moving people are detected in day or night time or with highly varying lighting conditions.

(Work partly funded by the FP7 European project APIDIS)

Category:

Science & Technology

Tags:

• Multiple
• Several
• Kinect
• microsoft
• camera
• automatic
• 3D
• people
• detection
• tracking
• real-time
• hacked
• laptop
• EPFL

[noamize]

lol real life aimbot

[alexutubeutube]

Using multiple kinects adds noise to the depth measurement but can still be used for advanced processing.

[timothymanzella]

This video went viral on El Salvador

[jbheroxx]

Which framework was used to make this?

[guyver30ful]

An important application for me is to detect in a room how many persons are present. This is for security purposes.

For example:

0 persons present -> no alarm

1 person -> alarm

2 or more persons -> no alarm

Where can I download the code?

[supadupagmailcom]

@noamize I say hook up some usb nerf guns and have some fun!

[Nikias]

This could have very interesting applications in security alarm systems. Such as a system that, when armed, goes off if there is a person present. No security guard watching the monitors needed.

[popularlong]

which driver you used in your Program？ OpenNI？

[oconn355]

Cool project! Was source code for this project ever released? I have a project that this seems like it would be perfect for.

[xxmrbloodxx]

@noamize LOLYES! XD

[zattytoast]

It is great! keep up the good work ;)

[peterhoth]

@alexutubeutube I am looking for people counting solution. Saw a few nice solutions in youtube but i think they are selling the product. I am looking for some free source samples to try my hand on the solution.

[aStrayforMyTime]

well now they are gonna real life mw2 sentry guns. We'll never get away!!

[alexutubeutube]

@peterhoth Working with 2 kinects allows you to detect people occluding each other. Given 1 kinect, you can probably detect people up to approximatively 8 meters. Merging several of them enables you to monitor a large scene.

Yes, it can easily detect a group of people standing together waiting for the elevator. What kind of application do you have in mind?

[peterhoth]

@alexutubeutube If it can work with one kinect, what's the advantage of working with two kinect then ? How far away can it detect a group of people ? Must it see the whole body ? Can it detect say a group of people standing together waiting for the elevator ?

[alexutubeutube]

@peterhoth The code is written in C/C++ using the OpenCV library.

[alexutubeutube]

@okreylos Thanks okreylos!

[peterhoth]

@alexutubeutube Great work !!! I've been looking for this solution for a while now. Looking forward to your library and code samples. Hope to use C#/.NET for my test.

[skulpture]

Brilliant work!

[okreylos]

@bobabest 21888000 bytes per second payload, plus a few percent protocol overhead.

[bobabest]

@alexutubeutube I thought it was dependent on the number of the available hubs and datarate. So probably a better question is what is the kinect datarate?

[alexutubeutube]

@bobabest it depends on the number of available USB port ;-).

So far, we tried with 2 kinects or 3 webcams and it worked fine!

[bobabest]

Nice! How many kinects were you able to hook up to a single computer?

[alexutubeutube]

@IgorCarron Cool!