Augmented Reality Origami

Here is a video of a prototype that uses one of the simplest origami foldings to turn a sheet of paper into a kind of 3D mouse. Once the origami is done, first you see the result of the tracking algorithm and then the final result in an Augmented Reality scene. The car levitates above the origami and can be seen from angles you would have troubles to reach with the standard flat AR markers.

Music (chosen because of the title) : "Strange about your hands" - Sensations Fix, 1976.

Category:

Science & Technology

Tags:

• Augmented
• Reality
• Mixed
• Markerless
• Tracking
• Origami
• Total
• Immersion

[Shakespeare1612]

You use the word mouse, but I would really love to see it work as a mouse. Can you take all other video out of the picture and just track one point? Then feed that point to the operating system as the location of the mouse pointer?

[EmmanuelMFr]

Yes I could but I do this in my spare time so be patient :) And I also need a more robust "click" than the one I currently have (by detecting that I close the origami)

[roidroid]

Wow, it's almost entirely seemless!

Would a Kalman filter make it perfect?

[EmmanuelMFr]

I'm still skeptical a Kalman filter is really that pertinent when the input is a man made motion, I don't see where it could find any redundancy to be better than a simple smoothing filter.

[Eddieost0309]

how can i download?



[twdarkflame]

excellent work, pretty stable and looks pretty useful.

I think this isnt exactly like a mouse though, more a 3d positioner. I could picture a more pointer like device being tracked in the other hand (say, a pen/stylus), which you use to edit the object being held. Id love to use that to model 3d. (if - sigh - someone made decent ar hmds...)

[josemartinez629]

Mongrel...Meets His Maker

[Shakespeare1612]

Yes. maybe your could have a four sided prism with a glyph on each side. One glyph for, "Just track me and put the mouse pointer here", one glyph for left button down, which could also be used for dragging objects and when rotated back to "track me" that could register a "left mouse button up" or your classic "click", and one glyph for, "right button down". Lastly, one glyph to swith to window scroll mode, and when in this mode: moving the wand up moves the doc up, down moves it down.

[roidroid]

Won't a simple smoothing filter introduce a few frames of lag?

I'm not sure if the 3d car's shaking is caused by imperfectly captured data - or natural hand shaking.

With the P5 Glove we had both problems, and a Kalman filter worked great, with no lag.

[emdotambient]

He he...interesting video, but I gave you 5 stars for the choice of songs. One of my favorites from the 70s...Italian prog space rock. How can you go wrong?

[Quezako]

As usual, a great demo!