Kinect Projection mapping with box2D physics

Another projection mapping experiment at Temple University CFL lab. After calibrating kinect and projector, we track the contour of the users body and use it's shape in the box2d physics engine. This was done using opencv, libfreenect and box2d.

Category:

Entertainment

Tags:

• Kinect
• projection mapping
• box2d
• openframeworks
• opencv
• openni
• physics simulation
• opengl animation
• kinect sdk
• windows kinect
• visual studio
• C++
• michael Korostelev

[sj2404]

Hi, I am very interested in learning 3d projector mapping...but no idea how I can create this...

I am searching for classes near Philadelphia area but couldn't find it...

Could you explain about 3D mapping for me plz? (what program u use for... and what device I need to learn it, etc etc)

[korostelevm]

@sj2404 I have a one hour presentation on how this works on my channel. I use c++ with opencv, and libfreenect to do processing from the kinect sensor and openframeworks to do the graphics

If you just want to do static 3d mapping, you can just use modeling software like 3dsMax and have video textures on your models. Then use a virtual camera inside the software to display in the projectors view.

I havent heard of any classes but we're at Temple University if you wanna check it out

[sreustle]

"After calibrating the kinect depth and rgb images" Can you explain this in some depth, or link to somewhere that does? Thanks!

[korostelevm]

@sreustle I have a one hour long thesis defense on it here on my channel lol But simply, since the depth and image camera are separated by some distance and are really two cameras with different lenses, their images don't match up (at least with using the libfreenect driver). If you wanted to find the depth of some pixel, youd need to find its location in the corresponding depth image.

[z08840]

awful physics simulation

[korostelevm]

@z08840 This is demonstrating accurate projection mapping, not physics simulations



[CurryGamingLTD]

mute - then watch :D

[TerranWTF]

@CaptainHalodude someone have probably done that allready.

[CaptainHalodude]

Imagine cupping a virtual woman's breasts when this is combined with jiggleh bewb physics

[ReidoDesign]

very cool

[Andy19902011]

cool

[DavidHasAPerm]

but will it blend

[pawlopascual]

20 years ago. no one would ever believe this tech could exist.

[silkroad54541]

future of man: girls on kinect.

[AzraelofLegion]

A cat would go ape shit over something like this XD

[JungleAim]

aw yeah just turn your arm in to a mathematical function

[macgyver2210]

Projecting a single image field on a flat wall is not projection mapping.