AR Lego - Machine Maintenance in Augmented Reality (2004)

This video demonstrates a prototype for a machine assembly and maintenance application in an Augmented Reality environment. A virtual repairman helps assemble a LEGO Mindstorms(R) robot and explains about its operation by superimposing virtual objects on top of the real robot. The virtual repairman agent's gestures and its explanation about various engines and sensors are synchronized to infrared commands that are automatically generated and sent over to the real robot, which trigger physical actions like switching engines on /off, querying push or light sensors etc. The user holds a tracked PDA, which acts as a hand novel interaction device. Firstly, it renders a dynamically generated GUI using the Personal Universal Controller software to change the controllable attributes of the LEGO robot (engine status, engine power, sensor type etc.) and the virtual character (rendering mode, character type, scale etc.). Moreover, the PDA acts as a tangible interface to position the agent in the user's mixed reality environment and switch between the LEGO robot's and the user's reference frame.

Istvan Barakonyi, Graz University of Technology

Category:

Science & Technology

Tags:

• augmented
• reality

[joemiked]

whoa does the leggos come with that cool software?

is this something you made?

[barainvienna]

These are standard blocks from a LEGO Mindstorms kit. I got the 3D model of them, registered them with the real parts with the help of a fiducial marker + computer vision algorithm, and rendered the virtual models + animated character from the correct viewpoint.

[UChyrra]

vo é catar mina em vez de usar isso

[japinha112]

LIXOOOOOO!!!

[bigfoot0101010]

wow! amazing!