ARAMIS - Human-Smart Environment Interaction - 3D pointing

The input interaction is based on three modalities: deictic gestures, symbolic gestures and isolated-words. Only the gesture based interaction are presented in this video.
The deictic gesture is interpreted using the PTAMM (Parallel Tracking and Multiple Mapping) method exploiting a camera handheld or worn on the user arm. The PTAMM algorithm tracks in real-time the position and orientation of the hand in the environment. This information is used to point real or virtual objects, previously added to the environment, using the optical camera axis. Symbolic hand-gestures and isolated voice commands are recognized and used to interact with the pointed target. Haptic and acoustic feedback are provided to the user in order to improve the quality of the interaction.

Category:

Science & Technology

Tags:

• HCI
• Technology
• Gesture Recognition