Portable Lumipen is a portable dynamic projection mapping system that tracks a target at 1,000fps with 3ms response time.
In recent years, projection mapping systems for dynamically moving targets have been proposed and this field is called "dynamic projection mapping."
In Dynamic projection mapping, the moving target is tracked by a high-speed camera, and the projection is controlled at high speed.
By achieving high responsiveness in sensing and feedback, these systems enable dynamic and immersive applications.
However, they are not truly dynamic because the systems are fixed in a room.
In this reseach, we use a 3D-stacked vision chip and an optical gaze contoller and realize a portable dynamic projection mapping system.
The 3D-stacked vision chip enables to omit a huge workstation and inefficient data transfer,
and the optical gaze controller enables high-speed tracking shot and also tracking projection.
The portable system enables a variety of applications including wearable user interface, projector-based makeup and combination with a drone, and this device will take projection mapping a step further.