Spot the ad - Recognition and tracking

This is Studio Tracking. Well, I mean, we are tracking every ad in the French magazine "Studio". This early prototype has a low framerate when it is in search mode, but you can see we have the real-time tracking back in action as soon as the search is over. All the 40 ads in this magazine were taught to the PC. This is done with a standard PC and a standard - even sub-standard actually ! - webcam.

Category:

Science & Technology

Tags:

• Augmented
• Reality
• Mixed
• Total
• Immersion
• Tracking
• Recognition

[roidroid]

very accurate. i'm eager to see improved prototypes that track multiple ads at once, and have a less pronouced search mode.

i noticed the tracker draws not just one but multiple polygons over the ads. Does this hint that you will one day be attempting to follow the "bend" of the paper? ie: will the system recognise and map the 3D bend of the paper.

[EmmanuelMFr]

I already have a less pronounced search mode :-) As for multiple tracking, well, if we are asked by a customer, why not. For the moment we have many things to do with one tracking.

Finally, to see research done on the tracking of the bend of the paper, you can google search "deformations of a piece of paper" and you'll find some impressive results on that by several universities, one of them we already have worked a lot with to make all our stuff.

[EmmanuelMFr]

[continued]

But here we consider more the bending of a paper as something we should be robust against, not really something we should track. At least for the moment.

[ExtantFrodo]

ah something to block out the billlboards as I drive down the highway.

[sonic4532]

cool.

[sanity93]

I think the multiple polygons is a big hint to the processing used, you have a grid of color space fft texture samples and a roughly calibrated matched 3d mesh to which edges are approximated at known relative angles to the mesh. Texture tracking is carried out relatively to the mesh fft samples. Just a guess.