Surface Computing with ZOIL and Squidy

This video shows how our workgroups software frameworks "ZOIL UI framework" and "Squidy Interaction" Library can be used for designing multi-modal, multi-display and multi-touch work environments (in this case demonstrated within our Media Room at the University of Konstanz).

Squidy integrates different input modalities (ranging from multi-touch input to laser pointer-, eye- or gesture-tracking) into an input abstraction layer, on which ready-to-use signal processing filters and data pipes can be visually composed and iteratively improved by the interaction designer or application developer. This Squidy layer is then accessed by the application to receive the desired low- or high-level multi-modal input events. Squidy also contains a proof-of-concept for a converter of Surface SDK events to TUIO and vice versa enabling designers to integrate the MS Surface table seamlessly into new and existing work environments.

The ZOIL UI Framework supports interaction designers to build feature-rich zoomable user interfaces as shared visual workplaces following the ZOIL (Zoomable Object-oriented Information Landscape) paradigm. The ZOIL framework facilitates the construction of a large visual and zoomable workspace as application user interface. This UI can be shared across display and device boundaries and presents all content and functionality in an object-oriented manner using semantic zooming. Each ZOIL client (e.g. a MS Surface table, peripheral high-definition cube displays connected to a PC, a UMPC, ) can be used to navigate and manipulate the content and functionality within this information landscape independently or can also be synchronized with other clients to serve as an overview or detail view. Building upon Squidys input layer, ZOIL applications can easily make use of novel input devices such as Anoto pens or the Nintendo Wiimote or make use of MS Surface SDK features even on non-Surface multi-touch table tops.

Category:

Science & Technology

Tags:

• ZOIL
• Squidy
• HCI Konstanz
• Surface Computing
• Multitouch
• CHI 2009
• Werner A. König
• Hans-Christian Jetter
• permaedia
• Chris Jetter

[YoLninYo]

@HCiKonstanz Thanks for the link, it is pure gold! It should be featured prominently somewhere on squidy websites. I will play with app and report back any questions. Happy Holidays.

[HCiKonstanz]

@YoLninYo A quick solution would be my master thesis, which you will find here (hci.uni-konstanz.de/downloads­/MA_Raedle.pdf). Especially, chapter 4. Also I will try to prepare a condensed "how to" over christmas and new year. If you have any questions please feel free to contact me anytime (Roman.Raedle at uni-konstanz.de)

[YoLninYo]

@romanraedle Thanks for your willingness to share with end-users. For me, it would be great to see a simple how-to or step by step tutorial on how one can use squidy app and squidy to control real world objects. Things like what are basic nodes, how to connect them, how it will work. If you need example, please look at PureData tutorials (also a "visual language") which don't assume a user is as familiar with the system as the creators themselves. and which walks you through it w/o patronizing

[romanraedle]

@YoLninYo We agree on your point that manuals are important for open source projects. Therefore we put at least some effort in "how tos". You can find it here: wiki.squidy-lib.de. If the information in our wiki is not sufficient you are welcome to either write an email or leave a message post in our forum or both (forum.squidy-lib.de).

We'd be happy to see Squidy used in different projects. Therefore, we are looking forward to get your response.

[YoLninYo]

You know what's worse than closed source software? so called "open source" software which has no documentation and no howtos. on squidy, there are two silent films showing it in action. No how to, no tutorial, no manual NOTHING! ....

You could have kept it closed source and still posted the silent films. Since it's all about obfuscating information and keeping it in as few hands as possible.

[cwhitenight18]

i would like to get in on the work!!! i would love to learn how to make these kinds of technology.

[x3JoeysGirl08]

this is freakin awesome

[GisselVelarde]

preatty nice job!

[paulHoover]

I'm an interaction designer who works on the Surface team. You've got some good work going on in this video. Are you having fun with Surface?