BIOSTORIES - Dynamic Multimedia Interfaces based on Automatic Real-time User Emotion Assessment

Vasco Vinhas, Eugénio Oliveira, Luís Paulo Reis

2010

Abstract

BioStories is the outcome of a three and a half years research project focused in uniting affective and ubiquitous computing with context aware multimedia content generation and distribution. Its initial premise was based in the possibility of performing real-time automatic emotion assessment trough online biometric channels monitoring and use this information to design on-the-fly dynamic multimedia storylines emotionally adapted, so that end users would unconsciously be choosing the story flow. The emotion assessment process was based on dynamic fusion of biometric channels such as EEG, GSR, respiration rate and volume, skin temperature and heart rate on top of Russell’s circumplex model of affect. BioStories’ broad scope also allowed for some spin-off projects namely mouse control through EMG that resulted in a patented technology for alternative/inclusive interfaces. Exhaustive experiments showed 87% of success rate for emotion assessment in a dynamic tridimensional virtual environment with an immersiveness score of 4.2 out of 5. The success of the proposed approach allows the vision of its appliance in several domains such as virtual entertainment, videogames and cinema as well as direct marketing, digital TV and domotic appliances.

Paper Citation

in Harvard Style

Vinhas V., Oliveira E. and Reis L. (2010). BIOSTORIES - Dynamic Multimedia Interfaces based on Automatic Real-time User Emotion Assessment . In Proceedings of the 12th International Conference on Enterprise Information Systems - Volume 5: ICEIS, ISBN 978-989-8425-08-9, pages 21-29. DOI: 10.5220/0002866700210029

in Bibtex Style

@conference{iceis10,
author={Vasco Vinhas and Eugénio Oliveira and Luís Paulo Reis},
title={BIOSTORIES - Dynamic Multimedia Interfaces based on Automatic Real-time User Emotion Assessment},
booktitle={Proceedings of the 12th International Conference on Enterprise Information Systems - Volume 5: ICEIS,},
year={2010},
pages={21-29},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002866700210029},
isbn={978-989-8425-08-9},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Conference on Enterprise Information Systems - Volume 5: ICEIS,
TI - BIOSTORIES - Dynamic Multimedia Interfaces based on Automatic Real-time User Emotion Assessment
SN - 978-989-8425-08-9
AU - Vinhas V.
AU - Oliveira E.
AU - Reis L.
PY - 2010
SP - 21
EP - 29
DO - 10.5220/0002866700210029