Augmented Reality Optical Tracking Pushed to the Limit

This video shows one of the worst environment you can meet when you want to track something to do augmented reality.
No markers, no nice textures, many moving parts, very poor lighting, occlusions with the hand and the arm, only a rough 3D model known beforehand, etc. A mixed result : It still manages to work a bit, but it is far from perfect. Most notably, I have to go back to a starting position twice in two minutes, despite rather slow movements.

Category:

Science & Technology

Tags:

• Augmented
• Reality
• Mixed
• Total
• Immersion
• Tracking

[ExtantFrodo]

The metal object with the t-bars you were pulling out and putting  in was all virtual?

[EmmanuelMFr]

Everything but the green lines is real.

[twdarkflame]

Impressive stuff. The flicking lighting dosnt seem to effect it much.

Makes me wish Microsoft hurrays up with progression on Photosythn, because that sort of tech could give lots of real-world referance models for this sort of tech ;)

[EmmanuelMFr]

The flicking lighting happens mostly because the camera (from the USA) is 60 Hz and the lighting (from an office in France) is 50 Hz !

[Dutchdrummer99]

Is this software only? i mean do you first take the camera shots and then use a software program to overlay this image? Or is this camera connected to a pc so it can track objects real time (like Asimo with human faces but ofcourse better)?

Ps..very cool

[EmmanuelMFr]

It's real time, that's why I can go back when I see the tracking is lost.

[alizta]

Given the conditions, i do think the result is highly impressive.

[fewzebrank]

amazing

[HAWXLEADER]

did u input the green model or did the software generate it???

if it is generation than it's unhumanly cool and applicable!!!!!

[kinggilgamesh76]

would a sonar system work for some of this tracking stuff or would that create too many variables?

[troy1002x]

Can you see augmented reality through shades that uses cameras? If so, :D. I oughta plan.

[Bytecutter]

Pretty impressive

[ExtantFrodo]

oh silly me I had that quite backwards didn't I? This must be one of the older tries. Your stuff lately is so great I fully expected the metal parts were the virtual. Love your stuff dude.

[fishfromchina]

really great software!! The developer must be a team of genius. Thumb up..