Loading...

ARmonica: A Collaborative Sonic Environment

6,042 views

Loading...

Loading...

Loading...

Rating is available when the video has been rented.
This feature is not available right now. Please try again later.
Uploaded on Jan 4, 2011

ARmonica: A Collaborative Sonic Environment

ARmonica is a 3D audiovisual augmented reality environment in which players can position and edit virtual bars that play the sounds of tuned percussion instruments when struck by virtual balls launched under the influence of physics. Players experience ARmonica through head-tracked, head-worn displays (Vuzix Wrap 920AR stereo video-see-through displays) and and interact using tracked Wii remotes. The goal is for players to collaborate in the creation and editing of an evolving sonic environment. To encourage novices, a player's own Wii remote is overlaid with labels that document how the controls are used to edit the bars and ball launchers, and the bars are labeled using scientific pitch notation.

3D position and orientation tracking is performed with the VTT ALVAR optical marker tracking package, using the cameras built into the head-worn displays, In this video, two large stationary marker arrays establish the 3D stage on which the bars and ball launchers are deployed, and each Wii remote has an attached set of smaller arrays. Rather than wearing head-worn displays, players can instead opt to hold tracked handheld ultramobile personal computers (Sony Vaio VGN-UX390N) and interact using touch-screen taps, although this is not shown in the video.

While the two large marker arrays are visible in the first part of the video, they are covered with opaque background textures in the second part. Each Wii remote is also overlaid with a semitransparent model of the remote, allowing part of its player's hand to be seen.

ARmonica is implemented with Goblin XNA ( http://goblinxna.codeplex.com ), which uses Havok Physics, and is based in part on a final project developed for Columbia's graduate course on 3D User Interfaces and Augmented Reality ( http://www.cs.columbia.edu/graphics/c... ). ARmonica was demonstrated at ACM UIST 2010 in October 2010, and is inspired by many earlier systems, including Budge's Pinball Construction Set, Lytle's More Bells and Whistles, Lieberman and Paluska's Absolut Quartet, Vincent's Mandala, Poupyrev et al.'s Augmented Groove, and Nimoy's Balldroppings.

This work was funded in part by generous gifts from Microsoft Research, VTT, and Vuzix.

For more information, see Mengu Sukan, Ohan Oda, Xiang Shi, Manuel Entrena, Shrenik Sadalgi, Jie Qi, and Steven Feiner. ARmonica: a collaborative sonic environment. In Adjunct Proceedings of UIST 2010 (23rd Annual ACM Symposium on User interface Software and Technology), October 3-6, New York, NY, pp. 401-402. http://doi.acm.org/10.1145/1866218.18...

  • Category

  • License

    • Standard YouTube License

Loading...

When autoplay is enabled, a suggested video will automatically play next.

Up next


to add this to Watch Later

Add to

Loading playlists...