Interact, excite, and feel

Abstract

This paper presents a dynamic system approach to the design of multimodal interactive systems. We use an example where we support human behavior in a browsing task, by adapting the dynamics of navigation using speed-dependent automatic zooming (SDAZ), allowing the user to switch smoothly among different modes of control. We show how the user's intention is coupled to the browsing technique via the dynamic model, and how the SDAZ method couples the document structure to audio samples using a model-based sonification. We demonstrate that this approach is well suited to mobile and wearable applications, and audio feedback provides valuable information, supporting intermittent interaction, i.e. allowing movement-based interaction techniques to continue while the user is simultaneously involved with real life tasks.