NiMMiT: A NOTATION FOR MODELING MULTIMODAL INTERACTION TECHNIQUES

Davy Vanacken, Joan De Boeck, Chris Raymaekers, Karin Coninx

2006

Abstract

The past few years, multimodal interaction has been gaining importance in virtual environments. Although multimodality makes interaction with the environment more intuitive and natural, the development cycle of such an environment is often a long and expensive process. In our overall field of research, we investigate how model-based design can help shorten this process by designing the application with the use of high-level diagrams. In this scope, we present ‘NiMMiT’, a graphical notation suitable for expressing multimodal user interaction. We elaborate on the NiMMiT primitives and illustrate the notation in practice with a comprehensive example.

References

  1. Ambler, S. (2004). Object Primer, The Agile Model-Driven Development with UML 2.0. Cambridge University Press.
  2. Cuppens, E., Raymaekers, C., and Coninx, K. (2005). A model-based design process for interactive virtual environments. In Proceedings of 12th International Workshop on Design, Specification and Verification of Interactive Systems (DSVIS'05), pages 239-250, Newcastle upon Tyne, UK.
  3. De Boeck, J., Cuppens, E., De Weyer, T., Raymaekers, C., and Coninx, K. (2004). Multisensory interaction metaphors with haptics and proprioception in virtual environments. In Proceedings of the third ACM Nordic Conference on Human-Computer Interaction (NordiCHI 2004), Tampere, FI.
  4. De Boeck, J., Raymaekers, C., and Coninx, K. (2005). Are existing metaphors in virtual environments suitable for haptic interaction. In Proceedings of 7th International Conference on Virtual Reality (VRIC 2005), pages 261-268, Laval, France.
  5. Dragicevic, P. and Fekete, J.-D. (2004). Support for input adaptability in the ICON toolkit. In Proceedings of the 6th international conference on multimodal interfaces (ICMI04), pages 212-219, State College, PA, USA.
  6. Esposito, C. (1996). User interfaces for virtual reality systems. In Human Factors in Computing Systems, CHI96 Conference Turorial Notes.
  7. Figueroa, P., Green, M., and Hoover, H. (2002). InTml: A description language for VR applications. In Proceedings of Web3D'02, Arizona, USA.
  8. Harel, D. (1987). Statecharts: A visual formalism for complex systems. In Science of Computer Programming, volume 8, pages 231-274.
  9. Nigay, L. and Coutaz, J. (1997). Intelligence and Multimodality in Multimedia Interfaces: Research and Applications, chapter Multifeature Systems: The CARE Properties and Their Impact on Software Design. AAAI Press.
  10. Palanque, P. and Bastide, R. (1994). Petri net based design of user-driven interfaces using the interactive cooperative objects formalism. In Interactive Systems: Design, Specification, and Verification, pages 383-400. Springer-Verlag.
  11. Sturm, J., Bakx, I., Cranen, B., Terken, J., and Wang, F. (2002). The effect of prolonged use on multimodal interaction. In Proceedings of ISCA Workshop on Multimodal Interaction in Mobile Environments, Kloster Irsee, Germany.
Download


Paper Citation


in Harvard Style

Vanacken D., De Boeck J., Raymaekers C. and Coninx K. (2006). NiMMiT: A NOTATION FOR MODELING MULTIMODAL INTERACTION TECHNIQUES . In Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, ISBN 972-8865-39-2, pages 224-231. DOI: 10.5220/0001357902240231


in Bibtex Style

@conference{grapp06,
author={Davy Vanacken and Joan De Boeck and Chris Raymaekers and Karin Coninx},
title={NiMMiT: A NOTATION FOR MODELING MULTIMODAL INTERACTION TECHNIQUES},
booktitle={Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP,},
year={2006},
pages={224-231},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001357902240231},
isbn={972-8865-39-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP,
TI - NiMMiT: A NOTATION FOR MODELING MULTIMODAL INTERACTION TECHNIQUES
SN - 972-8865-39-2
AU - Vanacken D.
AU - De Boeck J.
AU - Raymaekers C.
AU - Coninx K.
PY - 2006
SP - 224
EP - 231
DO - 10.5220/0001357902240231