Evaluating speech-enabled multimodal dialogue systems

As part of our work in the Interactive Multimodal Information Management (IM2) project, we developed a multimodal dialogue-driven interface for browsing and searching recorded and annotated meeting data in a multimedia database. The challenge lay in creating an interface that was easy to use and which smoothly blended direct manipulation and natural language interaction (both voice and keyboard based).

Archivus was developed in part using the Wizard of Oz technique during extensive experiments with naïve test subjects. In its current state, our Wizard's Controller Interface is quite an efficient tool for a wizard to control semantic interpretation of users multimodal input and to control dialogue aspects of the interaction in real-time.

The work presented here is part of the Swiss NCCR on "Interactive Multimodal Information Management" (IM2, http://www.im2.ch), funded by the Swiss National Science Foundation.

Category:

Science & Technology

Tags:

• Wizard of Oz
• multimodality
• dialogue
• experiments
• Archivus
• EPFL
• meeting
• browsing
• searching