cARtAble is a table-based Tangible User Interface which attempts to sonically augment children's play with cars in a non-intrusive way. It tracks the cars and the users via fiducial tracking using a webcam and the reacTIVision framework. The car's position and orientation data is mapped to car sound states and these sounds are positioned spatially by comparing the user's position and rotation to the car's position. The sound is generated through the Max/MSP programming environment and is played back to the user through wireless headphones. Furthermore the cARtAble has the functionality of including static objects and background sounds -- exemplified in the prototype by city ambience and an audible positioned construction work site.
Although running relatively stable, the current prototype does not satisfy the robustness required of a system meant for children's play. The main problems lie in the tracking of the fiducials and relate to the camera and the lighting setup.
This is the best video I have ever seen!
KasperAae 4 years ago
I concur. It is absolutely brilliant!
Spred the word! :)
lykkesM 4 years ago