Statestream: a developer-centric approach towards unifying interaction models and architecture

Haan2009StateStream_300px.jpg

G. de Haan and F. H. Post, Statestream: a developer-centric approach towards unifying interaction models and architecture, in EICS '09: Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems, (New York, NY, USA), pp. 13--22, ACM, 2009.

<< An illustration of a statecharts and a dataflow diagram of a simple interaction. The interaction is using a ray-casting manipulation tool to manipulate the airplane object. Both the interaction tool and the object each have their own statechart, while their (continuous) interplay is reflected in the streams of the dataflow graph.

Fulltext and bibliographic information

Abstract

Complex and dynamic interaction behaviors in applications such as Virtual Reality (VR) systems are difficult to design and develop. Reasons for this include the complexity and limitations in specification models and their integration with the underlying architecture, and lack of supporting development tools. In this paper we present our StateStream approach, which uses a dynamic programming language to bridge the gap between the behavioral model descriptions, the underlying VR architecture and customized development tools. Whereas the dynamic language allows full flexibility, the interaction model adds explicit structures for interactive behavior. A dual modeling mechanism is used to capture both discrete and continuous interaction behavior. The models are described and executed in the dynamic language itself, unifying the description of interaction, its execution and the connection with external software components.

We will highlight the main features of StateStream, and illustrate how the tight integration of interaction model and architecture enables a flexible and open-ended development environment. We will demonstrate the use of StateStream in a prototype system for studying and adapting complex 3D interaction techniques for VR.

Media

* Video: StateStream Model and Architecture: video (WMV, 28 MB)

Publications/Haan2009StateStream (last edited 2010-06-21 14:53:07 by localhost)