TongueTetris

Many patients with paralyzing injuries or medical conditions retain the use of their cranial nerves, which control the eyes, jaw, and tongue. While researchers have explored eye-tracking, speech recognition, and other technologies for these patients, we believe there is potential for directly sensing explicit tongue movement for controlling computers.

In our work, we explore a novel approach of using infrared optical sensors embedded within a dental retainer to sense tongue gestures. Our first prototype discriminates among four simple gestures: swiping left, swiping right, taping up, and holding up. We have demonstrated using these gestures for real-time control of applications through the game Tetris

Category:

Science & Technology

Tags:

• Tongue
• Tetris