CROSSMODAL PERCEPTION OF MISMATCHED EMOTIONAL EXPRESSIONS BY EMBODIED AGENTS

Yu Suk Cho, Ji He Suk, Kwang Hee Han

2009

Abstract

Today an embodied agent generates a large amount of interest because of its vital role for human-human interactions and human-computer interactions in virtual world. A number of researchers have found that we can recognize and distinguish between emotions expressed by an embodied agent. In addition many studies found that we respond to simulated emotions in a similar way to human emotion. This study investigates interpretation of mismatched emotions expressed by an embodied agent (e.g. a happy face with a sad voice). The study employed a 4 (visual: happy, sad, warm, cold) X 4 (audio: happy, sad, warm, cold) within-subjects repeated measure design. The results suggest that people perceive emotions not depending on just one channel but depending on both channels. Additionally facial expression (happy face vs. sad face) makes a difference in influence of two channels; Audio channel has more influence in interpretation of emotions when facial expression is happy. People were able to feel other emotion which was not expressed by face or voice from mismatched emotional expressions, so there is a possibility that we may express various and delicate emotions with embodied agent by using only several kinds of emotions.

Paper Citation

in Harvard Style

Suk Cho Y., He Suk J. and Hee Han K. (2009). CROSSMODAL PERCEPTION OF MISMATCHED EMOTIONAL EXPRESSIONS BY EMBODIED AGENTS . In Proceedings of the 11th International Conference on Enterprise Information Systems - Volume 5: ICEIS, ISBN 978-989-8111-88-3, pages 178-181. DOI: 10.5220/0001992001780181

in Bibtex Style

@conference{iceis09,
author={Yu Suk Cho and Ji He Suk and Kwang Hee Han},
title={CROSSMODAL PERCEPTION OF MISMATCHED EMOTIONAL EXPRESSIONS BY EMBODIED AGENTS},
booktitle={Proceedings of the 11th International Conference on Enterprise Information Systems - Volume 5: ICEIS,},
year={2009},
pages={178-181},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001992001780181},
isbn={978-989-8111-88-3},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 11th International Conference on Enterprise Information Systems - Volume 5: ICEIS,
TI - CROSSMODAL PERCEPTION OF MISMATCHED EMOTIONAL EXPRESSIONS BY EMBODIED AGENTS
SN - 978-989-8111-88-3
AU - Suk Cho Y.
AU - He Suk J.
AU - Hee Han K.
PY - 2009
SP - 178
EP - 181
DO - 10.5220/0001992001780181