This is an example application of the use of 3D point-of-gaze estimation. The system uses video images of the eyes to compute the location of the eyes in 3D space, the line along which the eyes are looking, and the intersection (or rather the closest point of approach) of the left and right eye lines-of-sight. The 3D point-of-gaze will be an important tool for interaction with 3D displays, as the standard 2D mouse will no longer have sufficient degrees of freedom.
The application is 3D Tic Tac Toe, played in a volume of space in front of the screen. The game of 3D Tic Tac Toe is played just like 3 levels of the 2D game, however, you can win by connecting any diagonal or vertical row of 3 positions in any of the 3 dimensions. In this system the positions are marked using red or green LED's. The closest point on the 3x3x3 grid to the players 3D point-of-gaze always flashes green. When the player wishes to play a position they press a key to end their turn. The computer then plays its turn, marked with a red LED. The last played computer position will blink red. The first to 3 in a row wins.
If you look carefully as the game plays, the screen shows a model of the internal state of the system including the position of the eyes (as red spheres) the lines-of-sight as orange lines, and the intersection point. A 3x3x3 model of the game is also rendered on the screen showing the positions played.
For more information see:
www.ece.ubc.ca/~craigah/
thats pretty cool! keep it up!
diajeanz 3 years ago
From just the video I can't tell how many LEDs your system is employing, shots from a few more angles would help.
dmcmanam 3 years ago