Hand sketching is used here as a natural way for creating Augmented Reality mechanical experiments.
The user can sketch experiments and watch them simulated in 3D.
The user interacts with the system by creating, modifying, and presenting sketches to the camera.
Check it out at
http://gamesalfresco.com/2009/10/16/ismar-2009-sketch-and... (less info)