MixT: Automatic Generation of Step-by-Step Mixed Media Tutorials

We present MixT, a system that automatically generates step-by-step mixed media tutorials with static instructions and per-step videos from user demonstrations. MixT segments screencapture video into steps using logs of application commands and input events, applies video compositing techniques to focus on salient information, and highlights interactions through mouse trails. Informal evaluation suggests that automatically generated mixed media tutorials were as effective in helping users complete tasks as tutorials that were created manually.

Pei-Yu (Peggy) Chi, Sally Ahn, Amanda Ren, Mira Dontcheva, Wilmot Li, Björn Hartmann
University of California, Berkeley — Computer Science Division and Advanced Technology Labs, Adobe

• Category

  Science & Technology